2024-04-16T15:25:34.693 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T15:25:34.694 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead} --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183 -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/orig.config.yaml 2024-04-16T15:25:34.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T15:25:34.832 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183 branch: wip-lusov-shared-log-segment description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead} email: null first_in_suite: false job_id: '7658183' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIx9kZC+lVom0nFnzCWg1XxdZn4eNWQ+XOA2Gv00Mg33JSCk86vxGlXPJQ/FD0YNo+vCjknszownuXqyqAmySRM= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaAVmZYISIJ2eqh9M2N6NzEeO5QbrKgcEIHdfIeia9rKDrAj+gTp+DfEd8fEp7RZXq7aS8u38p719bgaoGNQI8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_readahead teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T15:25:34.833 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T15:25:34.833 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T15:25:34.834 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T15:25:34.835 INFO:teuthology.task.internal:Checking packages... 2024-04-16T15:25:34.860 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T15:25:34.861 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T15:25:34.861 INFO:teuthology.packaging:ref: None 2024-04-16T15:25:34.861 INFO:teuthology.packaging:tag: None 2024-04-16T15:25:34.861 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T15:25:34.861 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:25:34.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T15:25:35.116 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T15:25:35.117 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T15:25:35.124 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T15:25:35.124 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T15:25:35.138 INFO:teuthology.task.internal:Saving configuration 2024-04-16T15:25:35.170 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T15:25:35.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:25:35.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:42.385987', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIx9kZC+lVom0nFnzCWg1XxdZn4eNWQ+XOA2Gv00Mg33JSCk86vxGlXPJQ/FD0YNo+vCjknszownuXqyqAmySRM='} 2024-04-16T15:25:35.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:42.387674', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaAVmZYISIJ2eqh9M2N6NzEeO5QbrKgcEIHdfIeia9rKDrAj+gTp+DfEd8fEp7RZXq7aS8u38p719bgaoGNQI8='} 2024-04-16T15:25:35.244 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T15:25:35.250 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-16T15:25:35.250 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-16T15:25:35.250 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T15:25:35.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ac6d91160>, signals=[15]) 2024-04-16T15:25:35.324 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T15:25:35.330 INFO:teuthology.task.internal:Opening connections... 2024-04-16T15:25:35.330 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:25:35.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:25:35.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:25:35.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:25:35.531 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T15:25:35.538 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-04-16T15:25:35.558 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-04-16T15:25:35.558 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-04-16T15:25:35.614 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-04-16T15:25:35.614 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T15:25:35.615 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T15:25:35.616 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-04-16T15:25:35.631 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-16T15:25:35.649 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-16T15:25:35.649 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-16T15:25:35.703 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T15:25:35.704 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T15:25:35.705 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T15:25:35.705 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-16T15:25:35.722 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T15:25:35.732 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T15:25:35.738 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T15:25:35.738 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-04-16T15:25:35.741 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-04-16T15:25:35.760 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T15:25:35.767 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T15:25:35.767 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-04-16T15:25:35.797 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-04-16T15:25:35.830 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T15:25:35.877 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T15:25:35.892 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-16T15:25:35.892 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-16T15:25:35.892 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T15:25:35.893 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T15:25:35.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:25:35.911 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-16T15:25:35.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:25:35.912 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-16T15:25:35.970 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-361.el9.x86_64 2024-04-16T15:25:35.970 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-361.el9.x86_64 2024-04-16T15:25:35.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-04-16T15:25:35.972 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-361.el9.x86_64 2024-04-16T15:25:35.972 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-361.el9.x86_64 2024-04-16T15:25:35.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-04-16T15:25:38.276 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-04-16T15:25:38.294 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 9.9 MB/s | 6.7 MB 00:00 2024-04-16T15:25:39.785 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2024-04-16T15:25:39.787 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2024-04-16T15:25:40.553 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-04-16T15:25:40.776 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-16T15:25:43.385 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-16T15:25:45.254 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-16T15:25:48.202 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.2 MB 00:01 2024-04-16T15:25:49.362 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-16T15:25:49.671 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-16T15:25:50.796 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 16 kB 00:00 2024-04-16T15:25:52.290 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 21 MB 00:02 2024-04-16T15:25:54.900 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 21 MB 00:03 2024-04-16T15:25:57.262 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-16T15:25:59.643 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T15:25:59.643 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T15:25:59.730 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-16T15:25:59.740 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-04-16T15:25:59.741 INFO:teuthology.orchestra.run.smithi080.stdout:Install 4 Packages 2024-04-16T15:25:59.741 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:25:59.741 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 77 M 2024-04-16T15:25:59.741 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 123 M 2024-04-16T15:25:59.741 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-16T15:25:59.889 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-16T15:25:59.921 INFO:teuthology.orchestra.run.smithi080.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2024-04-16T15:26:00.746 INFO:teuthology.orchestra.run.smithi080.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 15 MB/s | 15 MB 00:01 2024-04-16T15:26:01.938 INFO:teuthology.orchestra.run.smithi080.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-04-16T15:26:02.196 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T15:26:02.196 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T15:26:02.296 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-16T15:26:02.308 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-16T15:26:02.308 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-04-16T15:26:02.308 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-04-16T15:26:02.309 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:02.310 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 77 M 2024-04-16T15:26:02.310 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 123 M 2024-04-16T15:26:02.310 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-04-16T15:26:02.613 INFO:teuthology.orchestra.run.smithi080.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 10 MB/s | 28 MB 00:02 2024-04-16T15:26:02.616 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:26:02.616 INFO:teuthology.orchestra.run.smithi080.stdout:Total 27 MB/s | 77 MB 00:02 2024-04-16T15:26:02.617 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-16T15:26:02.666 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 780 kB/s | 277 kB 00:00 2024-04-16T15:26:02.990 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-16T15:26:02.991 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-16T15:26:03.574 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 12 MB/s | 15 MB 00:01 2024-04-16T15:26:03.860 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-16T15:26:03.861 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-16T15:26:04.591 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-04-16T15:26:05.024 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 12 MB/s | 28 MB 00:02 2024-04-16T15:26:05.028 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:26:05.028 INFO:teuthology.orchestra.run.smithi087.stdout:Total 28 MB/s | 77 MB 00:02 2024-04-16T15:26:05.029 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-04-16T15:26:05.393 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-04-16T15:26:05.394 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-04-16T15:26:06.178 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-16T15:26:06.216 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-04-16T15:26:06.216 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-04-16T15:26:06.784 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:26:06.875 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:08.533 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-04-16T15:26:09.136 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:26:09.233 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:09.604 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:09.753 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:11.984 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:12.370 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:14.467 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:14.725 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:17.083 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:17.219 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:19.485 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:21.986 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:48.585 INFO:teuthology.orchestra.run.smithi080.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T15:26:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:26:48.629 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:48.973 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:48.973 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:26:48.973 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:48.973 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:49.384 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:26:49.385 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-16T15:26:49.729 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:26:49.835 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.835 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:26:49.835 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T15:26:49.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T15:26:49.836 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T15:26:49.836 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-16T15:26:49.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T15:26:49.836 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:26:49.916 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:49.917 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:26:49.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.06 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 68.el9 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Group : Unspecified 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 8264254 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T15:26:49.959 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : builder@centos.org 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : CentOS 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:26:49.960 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T15:26:49.961 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T15:26:49.961 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 5.14.0-438.el9.x86_64 2024-04-16T15:26:49.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T15:26:50.550 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-04-16T15:26:51.420 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:51.420 INFO:teuthology.orchestra.run.smithi087.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T15:26:51.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:51.467 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T15:26:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T15:26:51.810 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T15:26:51.948 INFO:teuthology.orchestra.run.smithi080.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T15:26:51.983 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-04-16T15:26:51.985 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-04-16T15:26:52.000 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.vQslWRiWQ6 2024-04-16T15:26:52.001 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vQslWRiWQ6 2024-04-16T15:26:52.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.vQslWRiWQ6 2024-04-16T15:26:52.210 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.vQslWRiWQ6 is 6KB 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.255 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.256 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:52.256 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-16T15:26:52.259 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.vQslWRiWQ6 2024-04-16T15:26:52.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T15:26:52.356 INFO:teuthology.orchestra.run.smithi080.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T15:26:52.356 INFO:teuthology.orchestra.run.smithi080.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T15:26:52.356 INFO:teuthology.orchestra.run.smithi080.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T15:26:52.356 INFO:teuthology.orchestra.run.smithi080.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T15:26:52.357 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.524 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-04-16T15:26:52.579 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:26:52.678 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.678 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:26:52.678 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T15:26:52.678 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T15:26:52.678 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T15:26:52.679 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-16T15:26:52.679 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T15:26:52.679 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T15:26:52.758 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T15:26:52.759 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T15:26:52.759 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-04-16T15:26:52.792 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T15:26:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T15:26:52.794 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-04-16T15:26:52.795 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:26:52.795 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T15:26:52.795 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T15:26:52.796 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-438.el9.x86_64 2024-04-16T15:26:52.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T15:26:53.401 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-04-16T15:26:54.764 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T15:26:54.799 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-04-16T15:26:54.801 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-04-16T15:26:54.816 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.DlIglZLG6s 2024-04-16T15:26:54.816 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DlIglZLG6s 2024-04-16T15:26:54.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.DlIglZLG6s 2024-04-16T15:26:55.030 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.DlIglZLG6s is 6KB 2024-04-16T15:26:55.079 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.DlIglZLG6s 2024-04-16T15:26:55.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T15:26:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T15:26:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T15:26:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T15:26:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T15:26:55.159 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T15:26:55.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-04-16T15:27:22.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-16T15:27:22.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-16T15:27:22.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:27:25.316 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-16T15:27:25.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:27:25.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:27:43.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-16T15:27:52.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:27:52.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:27:55.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-16T15:28:07.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:28:07.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:28:22.553 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T15:28:31.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-16T15:28:31.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:28:31.998 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-16T15:28:32.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-16T15:28:32.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T15:28:32.510 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-04-16T15:28:32.525 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-438.el9.x86_64 2024-04-16T15:28:32.525 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T15:28:32.525 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T15:28:32.525 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T15:28:33.526 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-16T15:28:33.526 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T15:28:33.601 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-04-16T15:28:33.646 DEBUG:teuthology.parallel:result is None 2024-04-16T15:28:39.495 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-16T15:28:39.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:28:39.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-438.el9.x86_64"... 2024-04-16T15:28:39.897 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-16T15:28:39.912 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-438.el9.x86_64 2024-04-16T15:28:39.912 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T15:28:39.912 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T15:28:39.912 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T15:28:40.913 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-16T15:28:40.913 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T15:28:40.966 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-04-16T15:28:41.001 DEBUG:teuthology.parallel:result is None 2024-04-16T15:28:41.001 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T15:28:41.008 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T15:28:41.009 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T15:28:41.012 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T15:28:41.028 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T15:28:41.033 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T15:28:41.040 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T15:28:41.040 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T15:28:41.071 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T15:28:41.113 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T15:28:41.120 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T15:28:41.120 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T15:28:41.150 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T15:28:41.182 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:28:41.182 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:28:41.195 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:28:41.197 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T15:28:41.198 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T15:28:41.205 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T15:28:41.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T15:28:41.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T15:28:41.271 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T15:28:41.280 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T15:28:41.280 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:28:41.312 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:28:41.327 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:28:41.409 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:28:41.463 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:28:41.543 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:28:41.590 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:28:41.590 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T15:28:41.658 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:28:41.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T15:28:41.753 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:28:41.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T15:28:41.879 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:28:41.879 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T15:28:41.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-04-16T15:28:41.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-04-16T15:28:42.001 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:28:42.039 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:28:42.509 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T15:28:42.518 INFO:teuthology.task.internal:Starting timer... 2024-04-16T15:28:42.518 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T15:28:42.528 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T15:28:42.537 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T15:28:42.537 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-04-16T15:28:42.606 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-04-16T15:28:42.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-04-16T15:28:42.671 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-04-16T15:28:42.673 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T15:28:42.673 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-04-16T15:28:42.712 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-04-16T15:28:42.712 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-04-16T15:28:42.732 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-04-16T15:28:42.732 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi080.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive'} 2024-04-16T15:28:42.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:28:42.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:28:42.781 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:28:42.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:28:42.810 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T15:28:42.811 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-04-16T15:28:42.856 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-04-16T15:28:42.893 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T15:28:42.903 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-16T15:28:42.908 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-16T15:28:43.041 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T15:28:43.057 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T15:28:43.058 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T15:32:58.199 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2024-04-16T15:32:58.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-16T15:32:58.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:32:58.295 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-04-16T15:32:58.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-04-16T15:32:58.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:32:58.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T15:32:58.480 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-16T15:32:58.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-16T15:32:58.570 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T15:32:58.582 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T15:32:58.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T15:32:58.583 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:32:58.585 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T15:32:58.585 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:32:58.615 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T15:32:58.633 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T15:32:58.643 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T15:32:58.660 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T15:32:58.663 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-04-16T15:32:58.678 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-04-16T15:32:58.690 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-04-16T15:32:58.697 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T15:32:58.704 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-04-16T15:32:58.712 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T15:32:58.722 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T15:32:58.740 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T15:32:58.776 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.779 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.793 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:32:58.796 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:32:58.797 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-16T15:32:58.797 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.797 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.797 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.797 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:32:58.798 INFO:teuthology.run_tasks:Running task install... 2024-04-16T15:32:58.806 DEBUG:teuthology.task.install:project ceph 2024-04-16T15:32:58.806 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T15:32:58.806 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T15:32:58.807 INFO:teuthology.task.install:Using flavor: default 2024-04-16T15:32:58.812 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T15:32:58.812 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T15:32:58.813 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T15:32:58.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:32:58.816 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T15:32:58.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:32:58.969 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T15:32:58.969 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T15:32:59.037 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T15:32:59.037 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T15:32:59.139 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T15:32:59.139 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:32:59.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T15:32:59.146 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T15:32:59.147 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:32:59.147 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T15:32:59.169 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T15:32:59.170 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T15:32:59.177 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T15:32:59.177 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T15:32:59.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T15:32:59.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T15:32:59.323 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T15:32:59.328 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T15:32:59.391 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-04-16T15:32:59.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-04-16T15:32:59.396 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-04-16T15:32:59.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-04-16T15:32:59.640 INFO:teuthology.orchestra.run.smithi087.stdout:74 files removed 2024-04-16T15:32:59.653 INFO:teuthology.orchestra.run.smithi080.stdout:74 files removed 2024-04-16T15:32:59.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T15:32:59.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T15:33:00.294 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 272 kB/s | 83 kB 00:00 2024-04-16T15:33:00.439 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 177 kB/s | 83 kB 00:00 2024-04-16T15:33:00.686 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-16T15:33:00.865 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-16T15:33:01.134 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-16T15:33:01.282 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-16T15:33:01.548 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-04-16T15:33:01.676 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - AppStream 19 MB/s | 6.7 MB 00:00 2024-04-16T15:33:03.131 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2024-04-16T15:33:03.577 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2024-04-16T15:33:04.022 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T15:33:04.334 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.0 MB 00:00 2024-04-16T15:33:06.094 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-04-16T15:33:08.098 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 19 MB 00:02 2024-04-16T15:33:11.311 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-04-16T15:33:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-16T15:33:13.056 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.2 MB 00:01 2024-04-16T15:33:14.482 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-04-16T15:33:15.567 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-16T15:33:15.713 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-04-16T15:33:20.684 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-16T15:33:20.763 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-16T15:33:23.395 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.395 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.407 INFO:teuthology.orchestra.run.smithi080.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T15:33:23.408 INFO:teuthology.orchestra.run.smithi080.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.410 INFO:teuthology.orchestra.run.smithi080.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T15:33:23.410 INFO:teuthology.orchestra.run.smithi080.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.412 INFO:teuthology.orchestra.run.smithi080.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.414 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.418 INFO:teuthology.orchestra.run.smithi080.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T15:33:23.477 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.478 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.492 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T15:33:23.493 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T15:33:23.494 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-04-16T15:33:23.494 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T15:33:23.495 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.497 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.500 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T15:33:23.501 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T15:33:23.512 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T15:33:23.513 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T15:33:23.514 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T15:33:23.515 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T15:33:23.516 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T15:33:23.517 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T15:33:23.518 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T15:33:23.519 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T15:33:23.520 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T15:33:23.521 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T15:33:23.522 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T15:33:23.523 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T15:33:23.524 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T15:33:23.525 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout:Install 150 Packages 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 24 Packages 2024-04-16T15:33:23.526 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:33:23.527 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 228 M 2024-04-16T15:33:23.527 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-04-16T15:33:23.580 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================================ 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================================ 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T15:33:23.596 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T15:33:23.597 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T15:33:23.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T15:33:23.599 INFO:teuthology.orchestra.run.smithi087.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T15:33:23.600 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T15:33:23.601 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T15:33:23.602 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T15:33:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T15:33:23.604 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T15:33:23.605 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T15:33:23.606 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T15:33:23.607 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T15:33:23.608 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================================ 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout:Install 150 Packages 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 24 Packages 2024-04-16T15:33:23.609 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:33:23.610 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 228 M 2024-04-16T15:33:23.610 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-04-16T15:33:24.273 INFO:teuthology.orchestra.run.smithi087.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-04-16T15:33:24.418 INFO:teuthology.orchestra.run.smithi080.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-16T15:33:24.473 INFO:teuthology.orchestra.run.smithi087.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 4.3 MB/s | 890 kB 00:00 2024-04-16T15:33:24.557 INFO:teuthology.orchestra.run.smithi087.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 1.7 MB/s | 145 kB 00:00 2024-04-16T15:33:24.885 INFO:teuthology.orchestra.run.smithi080.stdout:(2/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 7.7 MB/s | 5.4 MB 00:00 2024-04-16T15:33:24.969 INFO:teuthology.orchestra.run.smithi080.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 1.7 MB/s | 145 kB 00:00 2024-04-16T15:33:24.990 INFO:teuthology.orchestra.run.smithi087.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 5.5 MB/s | 2.4 MB 00:00 2024-04-16T15:33:25.269 INFO:teuthology.orchestra.run.smithi080.stdout:(4/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 8.0 MB/s | 2.4 MB 00:00 2024-04-16T15:33:25.274 INFO:teuthology.orchestra.run.smithi087.stdout:(5/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 4.5 MB/s | 5.4 MB 00:01 2024-04-16T15:33:25.316 INFO:teuthology.orchestra.run.smithi087.stdout:(6/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-04-16T15:33:25.444 INFO:teuthology.orchestra.run.smithi080.stdout:(5/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-04-16T15:33:25.861 INFO:teuthology.orchestra.run.smithi080.stdout:(6/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 617 kB/s | 890 kB 00:01 2024-04-16T15:33:25.966 INFO:teuthology.orchestra.run.smithi087.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 6.8 MB/s | 4.7 MB 00:00 2024-04-16T15:33:26.053 INFO:teuthology.orchestra.run.smithi080.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 7.7 MB/s | 4.7 MB 00:00 2024-04-16T15:33:27.366 INFO:teuthology.orchestra.run.smithi087.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 7.1 MB/s | 10 MB 00:01 2024-04-16T15:33:27.462 INFO:teuthology.orchestra.run.smithi080.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 7.1 MB/s | 10 MB 00:01 2024-04-16T15:33:27.503 INFO:teuthology.orchestra.run.smithi080.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 608 kB/s | 25 kB 00:00 2024-04-16T15:33:27.558 INFO:teuthology.orchestra.run.smithi087.stdout:(9/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 7.5 MB/s | 17 MB 00:02 2024-04-16T15:33:27.595 INFO:teuthology.orchestra.run.smithi087.stdout:(10/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el 110 kB/s | 25 kB 00:00 2024-04-16T15:33:27.709 INFO:teuthology.orchestra.run.smithi087.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 1.9 MB/s | 225 kB 00:00 2024-04-16T15:33:27.801 INFO:teuthology.orchestra.run.smithi087.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 295 kB/s | 27 kB 00:00 2024-04-16T15:33:27.901 INFO:teuthology.orchestra.run.smithi087.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 317 kB/s | 32 kB 00:00 2024-04-16T15:33:28.093 INFO:teuthology.orchestra.run.smithi087.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 3.8 MB/s | 746 kB 00:00 2024-04-16T15:33:28.185 INFO:teuthology.orchestra.run.smithi087.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 1.7 MB/s | 163 kB 00:00 2024-04-16T15:33:28.277 INFO:teuthology.orchestra.run.smithi087.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 1.4 MB/s | 127 kB 00:00 2024-04-16T15:33:28.385 INFO:teuthology.orchestra.run.smithi087.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 4.5 MB/s | 500 kB 00:00 2024-04-16T15:33:29.136 INFO:teuthology.orchestra.run.smithi087.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 7.0 MB/s | 5.2 MB 00:00 2024-04-16T15:33:29.361 INFO:teuthology.orchestra.run.smithi087.stdout:(19/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 4.0 MB/s | 21 MB 00:05 2024-04-16T15:33:29.386 INFO:teuthology.orchestra.run.smithi087.stdout:(20/174): python3-ceph-argparse-19.0.0-2868.gc3 180 kB/s | 45 kB 00:00 2024-04-16T15:33:29.445 INFO:teuthology.orchestra.run.smithi087.stdout:(21/174): python3-ceph-common-19.0.0-2868.gc3c8 1.6 MB/s | 135 kB 00:00 2024-04-16T15:33:29.478 INFO:teuthology.orchestra.run.smithi087.stdout:(22/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 1.7 MB/s | 161 kB 00:00 2024-04-16T15:33:29.546 INFO:teuthology.orchestra.run.smithi087.stdout:(23/174): python3-rados-19.0.0-2868.gc3c87ed0.e 3.1 MB/s | 320 kB 00:00 2024-04-16T15:33:29.579 INFO:teuthology.orchestra.run.smithi087.stdout:(24/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 2.9 MB/s | 298 kB 00:00 2024-04-16T15:33:29.638 INFO:teuthology.orchestra.run.smithi087.stdout:(25/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.1 MB/s | 99 kB 00:00 2024-04-16T15:33:29.672 INFO:teuthology.orchestra.run.smithi087.stdout:(26/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 928 kB/s | 85 kB 00:00 2024-04-16T15:33:29.772 INFO:teuthology.orchestra.run.smithi087.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T15:33:29.864 INFO:teuthology.orchestra.run.smithi087.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 372 kB/s | 34 kB 00:00 2024-04-16T15:33:29.964 INFO:teuthology.orchestra.run.smithi087.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.4 MB/s | 142 kB 00:00 2024-04-16T15:33:30.406 INFO:teuthology.orchestra.run.smithi087.stdout:(30/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 4.0 MB/s | 3.1 MB 00:00 2024-04-16T15:33:30.481 INFO:teuthology.orchestra.run.smithi087.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 6.8 MB/s | 3.5 MB 00:00 2024-04-16T15:33:30.598 INFO:teuthology.orchestra.run.smithi087.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 2.1 MB/s | 249 kB 00:00 2024-04-16T15:33:30.690 INFO:teuthology.orchestra.run.smithi087.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 538 kB/s | 49 kB 00:00 2024-04-16T15:33:30.799 INFO:teuthology.orchestra.run.smithi087.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 152 kB/s | 16 kB 00:00 2024-04-16T15:33:30.932 INFO:teuthology.orchestra.run.smithi087.stdout:(35/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 1.9 MB/s | 264 kB 00:00 2024-04-16T15:33:31.124 INFO:teuthology.orchestra.run.smithi087.stdout:(36/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 3.9 MB/s | 762 kB 00:00 2024-04-16T15:33:31.216 INFO:teuthology.orchestra.run.smithi087.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 199 kB/s | 18 kB 00:00 2024-04-16T15:33:31.358 INFO:teuthology.orchestra.run.smithi087.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-04-16T15:33:31.408 INFO:teuthology.orchestra.run.smithi087.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-04-16T15:33:31.442 INFO:teuthology.orchestra.run.smithi087.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-04-16T15:33:31.484 INFO:teuthology.orchestra.run.smithi087.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-04-16T15:33:31.518 INFO:teuthology.orchestra.run.smithi087.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 954 kB/s | 32 kB 00:00 2024-04-16T15:33:31.627 INFO:teuthology.orchestra.run.smithi087.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-16T15:33:31.660 INFO:teuthology.orchestra.run.smithi087.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 517 kB/s | 17 kB 00:00 2024-04-16T15:33:31.694 INFO:teuthology.orchestra.run.smithi087.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-04-16T15:33:31.727 INFO:teuthology.orchestra.run.smithi087.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-16T15:33:31.761 INFO:teuthology.orchestra.run.smithi087.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T15:33:31.803 INFO:teuthology.orchestra.run.smithi087.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-04-16T15:33:31.845 INFO:teuthology.orchestra.run.smithi087.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-04-16T15:33:31.879 INFO:teuthology.orchestra.run.smithi087.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.3 MB/s | 46 kB 00:00 2024-04-16T15:33:31.920 INFO:teuthology.orchestra.run.smithi087.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2024-04-16T15:33:31.954 INFO:teuthology.orchestra.run.smithi087.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 5.4 MB/s | 187 kB 00:00 2024-04-16T15:33:31.988 INFO:teuthology.orchestra.run.smithi087.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2024-04-16T15:33:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:(54/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-04-16T15:33:32.155 INFO:teuthology.orchestra.run.smithi087.stdout:(55/174): ceph-mgr-diskprediction-local-19.0.0- 4.2 MB/s | 7.4 MB 00:01 2024-04-16T15:33:32.214 INFO:teuthology.orchestra.run.smithi087.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-04-16T15:33:32.256 INFO:teuthology.orchestra.run.smithi087.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-04-16T15:33:32.289 INFO:teuthology.orchestra.run.smithi087.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 817 kB 00:00 2024-04-16T15:33:32.315 INFO:teuthology.orchestra.run.smithi087.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 132 kB 00:00 2024-04-16T15:33:32.432 INFO:teuthology.orchestra.run.smithi087.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-04-16T15:33:32.465 INFO:teuthology.orchestra.run.smithi087.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-04-16T15:33:32.490 INFO:teuthology.orchestra.run.smithi087.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-04-16T15:33:32.616 INFO:teuthology.orchestra.run.smithi087.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2024-04-16T15:33:32.641 INFO:teuthology.orchestra.run.smithi087.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2024-04-16T15:33:32.666 INFO:teuthology.orchestra.run.smithi087.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-04-16T15:33:32.691 INFO:teuthology.orchestra.run.smithi087.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-16T15:33:32.725 INFO:teuthology.orchestra.run.smithi087.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 537 kB/s | 32 kB 00:00 2024-04-16T15:33:33.036 INFO:teuthology.orchestra.run.smithi080.stdout:(10/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 8.8 MB/s | 49 MB 00:05 2024-04-16T15:33:33.103 INFO:teuthology.orchestra.run.smithi080.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 3.3 MB/s | 225 kB 00:00 2024-04-16T15:33:33.145 INFO:teuthology.orchestra.run.smithi080.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 653 kB/s | 27 kB 00:00 2024-04-16T15:33:33.167 INFO:teuthology.orchestra.run.smithi087.stdout:(68/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 8.7 MB/s | 49 MB 00:05 2024-04-16T15:33:33.187 INFO:teuthology.orchestra.run.smithi080.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 755 kB/s | 32 kB 00:00 2024-04-16T15:33:33.243 INFO:teuthology.orchestra.run.smithi087.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 4.8 MB 00:00 2024-04-16T15:33:33.268 INFO:teuthology.orchestra.run.smithi087.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 403 kB/s | 217 kB 00:00 2024-04-16T15:33:33.293 INFO:teuthology.orchestra.run.smithi087.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2024-04-16T15:33:33.296 INFO:teuthology.orchestra.run.smithi080.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 6.7 MB/s | 746 kB 00:00 2024-04-16T15:33:33.310 INFO:teuthology.orchestra.run.smithi087.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-04-16T15:33:33.335 INFO:teuthology.orchestra.run.smithi087.stdout:(73/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-04-16T15:33:33.346 INFO:teuthology.orchestra.run.smithi080.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 3.2 MB/s | 163 kB 00:00 2024-04-16T15:33:33.360 INFO:teuthology.orchestra.run.smithi087.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-04-16T15:33:33.386 INFO:teuthology.orchestra.run.smithi087.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T15:33:33.396 INFO:teuthology.orchestra.run.smithi080.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 2.5 MB/s | 127 kB 00:00 2024-04-16T15:33:33.411 INFO:teuthology.orchestra.run.smithi087.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-04-16T15:33:33.436 INFO:teuthology.orchestra.run.smithi087.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-04-16T15:33:33.461 INFO:teuthology.orchestra.run.smithi087.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 570 kB/s | 43 kB 00:00 2024-04-16T15:33:33.472 INFO:teuthology.orchestra.run.smithi080.stdout:(17/174): libradosstriper1-19.0.0-2868.gc3c87ed 6.5 MB/s | 500 kB 00:00 2024-04-16T15:33:33.603 INFO:teuthology.orchestra.run.smithi087.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 278 kB/s | 39 kB 00:00 2024-04-16T15:33:33.629 INFO:teuthology.orchestra.run.smithi087.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 250 kB/s | 41 kB 00:00 2024-04-16T15:33:33.806 INFO:teuthology.orchestra.run.smithi080.stdout:(18/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 16 MB/s | 5.2 MB 00:00 2024-04-16T15:33:33.812 INFO:teuthology.orchestra.run.smithi087.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-16T15:33:33.837 INFO:teuthology.orchestra.run.smithi087.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 942 kB/s | 220 kB 00:00 2024-04-16T15:33:33.862 INFO:teuthology.orchestra.run.smithi087.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 151 kB/s | 35 kB 00:00 2024-04-16T15:33:33.888 INFO:teuthology.orchestra.run.smithi087.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 618 kB/s | 46 kB 00:00 2024-04-16T15:33:33.913 INFO:teuthology.orchestra.run.smithi087.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-04-16T15:33:33.938 INFO:teuthology.orchestra.run.smithi087.stdout:(86/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-04-16T15:33:33.964 INFO:teuthology.orchestra.run.smithi087.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 833 kB/s | 63 kB 00:00 2024-04-16T15:33:33.989 INFO:teuthology.orchestra.run.smithi087.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-04-16T15:33:34.014 INFO:teuthology.orchestra.run.smithi080.stdout:(19/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 2.1 MB/s | 21 MB 00:09 2024-04-16T15:33:34.015 INFO:teuthology.orchestra.run.smithi087.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-04-16T15:33:34.039 INFO:teuthology.orchestra.run.smithi080.stdout:(20/174): python3-ceph-argparse-19.0.0-2868.gc3 193 kB/s | 45 kB 00:00 2024-04-16T15:33:34.040 INFO:teuthology.orchestra.run.smithi087.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-04-16T15:33:34.073 INFO:teuthology.orchestra.run.smithi087.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-04-16T15:33:34.098 INFO:teuthology.orchestra.run.smithi080.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 2.7 MB/s | 161 kB 00:00 2024-04-16T15:33:34.098 INFO:teuthology.orchestra.run.smithi087.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-04-16T15:33:34.115 INFO:teuthology.orchestra.run.smithi080.stdout:(22/174): python3-ceph-common-19.0.0-2868.gc3c8 1.3 MB/s | 135 kB 00:00 2024-04-16T15:33:34.123 INFO:teuthology.orchestra.run.smithi087.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-04-16T15:33:34.149 INFO:teuthology.orchestra.run.smithi087.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-04-16T15:33:34.150 INFO:teuthology.orchestra.run.smithi080.stdout:(23/174): python3-rados-19.0.0-2868.gc3c87ed0.e 6.2 MB/s | 320 kB 00:00 2024-04-16T15:33:34.241 INFO:teuthology.orchestra.run.smithi080.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 1.1 MB/s | 99 kB 00:00 2024-04-16T15:33:34.266 INFO:teuthology.orchestra.run.smithi080.stdout:(25/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 1.9 MB/s | 298 kB 00:00 2024-04-16T15:33:34.316 INFO:teuthology.orchestra.run.smithi087.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 977 kB/s | 187 kB 00:00 2024-04-16T15:33:34.333 INFO:teuthology.orchestra.run.smithi080.stdout:(26/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 927 kB/s | 85 kB 00:00 2024-04-16T15:33:34.341 INFO:teuthology.orchestra.run.smithi087.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-16T15:33:34.374 INFO:teuthology.orchestra.run.smithi087.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-16T15:33:34.433 INFO:teuthology.orchestra.run.smithi087.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 235 kB/s | 21 kB 00:00 2024-04-16T15:33:34.433 INFO:teuthology.orchestra.run.smithi080.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T15:33:34.458 INFO:teuthology.orchestra.run.smithi087.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-16T15:33:34.517 INFO:teuthology.orchestra.run.smithi087.stdout:(100/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-04-16T15:33:34.542 INFO:teuthology.orchestra.run.smithi080.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 316 kB/s | 34 kB 00:00 2024-04-16T15:33:34.559 INFO:teuthology.orchestra.run.smithi087.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2024-04-16T15:33:34.592 INFO:teuthology.orchestra.run.smithi087.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.8 MB/s | 94 kB 00:00 2024-04-16T15:33:34.651 INFO:teuthology.orchestra.run.smithi087.stdout:(103/174): openssl-devel-3.0.7-27.el9.x86_64.rp 19 MB/s | 4.1 MB 00:00 2024-04-16T15:33:34.679 INFO:teuthology.orchestra.run.smithi087.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-04-16T15:33:34.679 INFO:teuthology.orchestra.run.smithi080.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.0 MB/s | 142 kB 00:00 2024-04-16T15:33:34.702 INFO:teuthology.orchestra.run.smithi087.stdout:(105/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.3 MB/s | 248 kB 00:00 2024-04-16T15:33:34.743 INFO:teuthology.orchestra.run.smithi087.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-04-16T15:33:35.044 INFO:teuthology.orchestra.run.smithi087.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-04-16T15:33:35.144 INFO:teuthology.orchestra.run.smithi087.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 698 kB/s | 309 kB 00:00 2024-04-16T15:33:35.167 INFO:teuthology.orchestra.run.smithi080.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 7.2 MB/s | 3.5 MB 00:00 2024-04-16T15:33:35.178 INFO:teuthology.orchestra.run.smithi087.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-16T15:33:35.203 INFO:teuthology.orchestra.run.smithi087.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-04-16T15:33:35.236 INFO:teuthology.orchestra.run.smithi087.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 827 kB/s | 49 kB 00:00 2024-04-16T15:33:35.262 INFO:teuthology.orchestra.run.smithi087.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-16T15:33:35.412 INFO:teuthology.orchestra.run.smithi087.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 860 kB/s | 151 kB 00:00 2024-04-16T15:33:35.538 INFO:teuthology.orchestra.run.smithi087.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-04-16T15:33:35.585 INFO:teuthology.orchestra.run.smithi080.stdout:(31/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 2.3 MB/s | 3.1 MB 00:01 2024-04-16T15:33:35.605 INFO:teuthology.orchestra.run.smithi087.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-04-16T15:33:35.622 INFO:teuthology.orchestra.run.smithi087.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-04-16T15:33:35.663 INFO:teuthology.orchestra.run.smithi087.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-04-16T15:33:35.689 INFO:teuthology.orchestra.run.smithi087.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 223 kB/s | 15 kB 00:00 2024-04-16T15:33:35.731 INFO:teuthology.orchestra.run.smithi087.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-16T15:33:35.760 INFO:teuthology.orchestra.run.smithi080.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 1.4 MB/s | 249 kB 00:00 2024-04-16T15:33:35.798 INFO:teuthology.orchestra.run.smithi087.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-16T15:33:35.840 INFO:teuthology.orchestra.run.smithi087.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-16T15:33:35.873 INFO:teuthology.orchestra.run.smithi087.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-16T15:33:35.894 INFO:teuthology.orchestra.run.smithi080.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 370 kB/s | 49 kB 00:00 2024-04-16T15:33:35.957 INFO:teuthology.orchestra.run.smithi087.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-04-16T15:33:36.002 INFO:teuthology.orchestra.run.smithi080.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 152 kB/s | 16 kB 00:00 2024-04-16T15:33:36.057 INFO:teuthology.orchestra.run.smithi087.stdout:(124/174): libarrow-9.0.0-10.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-04-16T15:33:36.082 INFO:teuthology.orchestra.run.smithi087.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-16T15:33:36.125 INFO:teuthology.orchestra.run.smithi087.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-16T15:33:36.158 INFO:teuthology.orchestra.run.smithi087.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-16T15:33:36.169 INFO:teuthology.orchestra.run.smithi080.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 7.4 MB/s | 7.4 MB 00:01 2024-04-16T15:33:36.192 INFO:teuthology.orchestra.run.smithi087.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-04-16T15:33:36.194 INFO:teuthology.orchestra.run.smithi080.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 1.3 MB/s | 264 kB 00:00 2024-04-16T15:33:36.225 INFO:teuthology.orchestra.run.smithi087.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-04-16T15:33:36.259 INFO:teuthology.orchestra.run.smithi087.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-16T15:33:36.334 INFO:teuthology.orchestra.run.smithi087.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-04-16T15:33:36.359 INFO:teuthology.orchestra.run.smithi087.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-04-16T15:33:36.370 INFO:teuthology.orchestra.run.smithi080.stdout:(37/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x8 1.6 MB/s | 17 MB 00:10 2024-04-16T15:33:36.393 INFO:teuthology.orchestra.run.smithi087.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-16T15:33:36.395 INFO:teuthology.orchestra.run.smithi080.stdout:(38/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 91 kB/s | 18 kB 00:00 2024-04-16T15:33:36.426 INFO:teuthology.orchestra.run.smithi087.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2024-04-16T15:33:36.437 INFO:teuthology.orchestra.run.smithi080.stdout:(39/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 2.8 MB/s | 762 kB 00:00 2024-04-16T15:33:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:(135/174): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-04-16T15:33:36.494 INFO:teuthology.orchestra.run.smithi087.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-16T15:33:36.519 INFO:teuthology.orchestra.run.smithi087.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-16T15:33:36.553 INFO:teuthology.orchestra.run.smithi087.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 485 kB/s | 28 kB 00:00 2024-04-16T15:33:36.578 INFO:teuthology.orchestra.run.smithi087.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-16T15:33:36.603 INFO:teuthology.orchestra.run.smithi087.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-04-16T15:33:36.604 INFO:teuthology.orchestra.run.smithi080.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 911 kB/s | 106 kB 00:00 2024-04-16T15:33:36.628 INFO:teuthology.orchestra.run.smithi087.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-16T15:33:36.646 INFO:teuthology.orchestra.run.smithi080.stdout:(41/174): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 662 kB 00:00 2024-04-16T15:33:36.654 INFO:teuthology.orchestra.run.smithi087.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-04-16T15:33:36.679 INFO:teuthology.orchestra.run.smithi087.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-16T15:33:36.680 INFO:teuthology.orchestra.run.smithi080.stdout:(42/174): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 920 kB 00:00 2024-04-16T15:33:36.704 INFO:teuthology.orchestra.run.smithi087.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-16T15:33:36.705 INFO:teuthology.orchestra.run.smithi080.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 307 kB 00:00 2024-04-16T15:33:36.730 INFO:teuthology.orchestra.run.smithi087.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-16T15:33:36.730 INFO:teuthology.orchestra.run.smithi080.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 380 kB/s | 32 kB 00:00 2024-04-16T15:33:36.755 INFO:teuthology.orchestra.run.smithi087.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-16T15:33:36.755 INFO:teuthology.orchestra.run.smithi080.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 341 kB/s | 17 kB 00:00 2024-04-16T15:33:36.789 INFO:teuthology.orchestra.run.smithi087.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-04-16T15:33:36.822 INFO:teuthology.orchestra.run.smithi087.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-16T15:33:36.847 INFO:teuthology.orchestra.run.smithi087.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-16T15:33:36.858 INFO:teuthology.orchestra.run.smithi080.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 79 kB/s | 10 kB 00:00 2024-04-16T15:33:36.881 INFO:teuthology.orchestra.run.smithi080.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2024-04-16T15:33:36.931 INFO:teuthology.orchestra.run.smithi080.stdout:(48/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-16T15:33:36.957 INFO:teuthology.orchestra.run.smithi080.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 44 kB 00:00 2024-04-16T15:33:36.991 INFO:teuthology.orchestra.run.smithi080.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2024-04-16T15:33:37.015 INFO:teuthology.orchestra.run.smithi080.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 46 kB 00:00 2024-04-16T15:33:37.023 INFO:teuthology.orchestra.run.smithi087.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-04-16T15:33:37.041 INFO:teuthology.orchestra.run.smithi080.stdout:(52/174): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-04-16T15:33:37.066 INFO:teuthology.orchestra.run.smithi080.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-04-16T15:33:37.091 INFO:teuthology.orchestra.run.smithi080.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2024-04-16T15:33:37.106 INFO:teuthology.orchestra.run.smithi087.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-04-16T15:33:37.116 INFO:teuthology.orchestra.run.smithi080.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2024-04-16T15:33:37.142 INFO:teuthology.orchestra.run.smithi080.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-04-16T15:33:37.190 INFO:teuthology.orchestra.run.smithi087.stdout:(152/174): librados2-19.0.0-2868.gc3c87ed0.el9. 9.3 MB/s | 3.4 MB 00:00 2024-04-16T15:33:37.232 INFO:teuthology.orchestra.run.smithi087.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 15 MB/s | 1.8 MB 00:00 2024-04-16T15:33:37.248 INFO:teuthology.orchestra.run.smithi087.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 707 kB/s | 41 kB 00:00 2024-04-16T15:33:37.274 INFO:teuthology.orchestra.run.smithi087.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-04-16T15:33:37.292 INFO:teuthology.orchestra.run.smithi080.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-04-16T15:33:37.299 INFO:teuthology.orchestra.run.smithi087.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-04-16T15:33:37.334 INFO:teuthology.orchestra.run.smithi080.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.5 MB 00:00 2024-04-16T15:33:37.358 INFO:teuthology.orchestra.run.smithi087.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 625 kB/s | 36 kB 00:00 2024-04-16T15:33:37.359 INFO:teuthology.orchestra.run.smithi080.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 817 kB 00:00 2024-04-16T15:33:37.383 INFO:teuthology.orchestra.run.smithi087.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 71 kB 00:00 2024-04-16T15:33:37.384 INFO:teuthology.orchestra.run.smithi080.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 132 kB 00:00 2024-04-16T15:33:37.443 INFO:teuthology.orchestra.run.smithi080.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-16T15:33:37.458 INFO:teuthology.orchestra.run.smithi087.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.9 MB/s | 192 kB 00:00 2024-04-16T15:33:37.517 INFO:teuthology.orchestra.run.smithi087.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-04-16T15:33:37.553 INFO:teuthology.orchestra.run.smithi080.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2024-04-16T15:33:37.568 INFO:teuthology.orchestra.run.smithi087.stdout:(161/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 4.4 MB/s | 3.1 MB 00:00 2024-04-16T15:33:37.577 INFO:teuthology.orchestra.run.smithi080.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 404 kB/s | 78 kB 00:00 2024-04-16T15:33:37.592 INFO:teuthology.orchestra.run.smithi087.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-04-16T15:33:37.626 INFO:teuthology.orchestra.run.smithi087.stdout:(163/174): libacl-2.3.1-4.el9.x86_64.rpm 138 kB/s | 23 kB 00:00 2024-04-16T15:33:37.660 INFO:teuthology.orchestra.run.smithi087.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 155 kB 00:00 2024-04-16T15:33:37.669 INFO:teuthology.orchestra.run.smithi080.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 5.8 MB 00:00 2024-04-16T15:33:37.686 INFO:teuthology.orchestra.run.smithi080.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-04-16T15:33:37.693 INFO:teuthology.orchestra.run.smithi087.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 136 kB 00:00 2024-04-16T15:33:37.703 INFO:teuthology.orchestra.run.smithi080.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 147 kB/s | 18 kB 00:00 2024-04-16T15:33:37.710 INFO:teuthology.orchestra.run.smithi087.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 569 kB/s | 29 kB 00:00 2024-04-16T15:33:37.728 INFO:teuthology.orchestra.run.smithi087.stdout:(167/174): libsmartcols-2.37.4-18.el9.x86_64.rp 633 kB/s | 64 kB 00:00 2024-04-16T15:33:37.728 INFO:teuthology.orchestra.run.smithi080.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-04-16T15:33:37.754 INFO:teuthology.orchestra.run.smithi080.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 628 kB/s | 32 kB 00:00 2024-04-16T15:33:37.854 INFO:teuthology.orchestra.run.smithi080.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-04-16T15:33:37.879 INFO:teuthology.orchestra.run.smithi080.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-16T15:33:37.904 INFO:teuthology.orchestra.run.smithi080.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-04-16T15:33:37.930 INFO:teuthology.orchestra.run.smithi080.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 919 kB/s | 69 kB 00:00 2024-04-16T15:33:37.955 INFO:teuthology.orchestra.run.smithi080.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-04-16T15:33:37.980 INFO:teuthology.orchestra.run.smithi080.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-04-16T15:33:38.005 INFO:teuthology.orchestra.run.smithi080.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T15:33:38.031 INFO:teuthology.orchestra.run.smithi080.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-04-16T15:33:38.056 INFO:teuthology.orchestra.run.smithi080.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-04-16T15:33:38.069 INFO:teuthology.orchestra.run.smithi087.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 3.2 MB/s | 1.2 MB 00:00 2024-04-16T15:33:38.081 INFO:teuthology.orchestra.run.smithi080.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-04-16T15:33:38.153 INFO:teuthology.orchestra.run.smithi087.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.9 MB/s | 2.2 MB 00:00 2024-04-16T15:33:38.219 INFO:teuthology.orchestra.run.smithi087.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 468 kB/s | 31 kB 00:00 2024-04-16T15:33:38.345 INFO:teuthology.orchestra.run.smithi087.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 1.6 MB/s | 465 kB 00:00 2024-04-16T15:33:38.387 INFO:teuthology.orchestra.run.smithi087.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.5 MB/s | 2.3 MB 00:00 2024-04-16T15:33:38.398 INFO:teuthology.orchestra.run.smithi080.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-04-16T15:33:38.424 INFO:teuthology.orchestra.run.smithi080.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 114 kB/s | 39 kB 00:00 2024-04-16T15:33:38.445 INFO:teuthology.orchestra.run.smithi087.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.8 MB/s | 1.1 MB 00:00 2024-04-16T15:33:38.448 INFO:teuthology.orchestra.run.smithi080.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 112 kB/s | 41 kB 00:00 2024-04-16T15:33:38.470 INFO:teuthology.orchestra.run.smithi087.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 593 kB/s | 74 kB 00:00 2024-04-16T15:33:38.474 INFO:teuthology.orchestra.run.smithi080.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2024-04-16T15:33:38.477 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:33:38.477 INFO:teuthology.orchestra.run.smithi087.stdout:Total 15 MB/s | 228 MB 00:14 2024-04-16T15:33:38.499 INFO:teuthology.orchestra.run.smithi080.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 696 kB/s | 35 kB 00:00 2024-04-16T15:33:38.524 INFO:teuthology.orchestra.run.smithi080.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 616 kB/s | 46 kB 00:00 2024-04-16T15:33:38.550 INFO:teuthology.orchestra.run.smithi080.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-04-16T15:33:38.575 INFO:teuthology.orchestra.run.smithi080.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-16T15:33:38.600 INFO:teuthology.orchestra.run.smithi080.stdout:(87/174): uuid-1.6.2-55.el9.x86_64.rpm 751 kB/s | 56 kB 00:00 2024-04-16T15:33:38.626 INFO:teuthology.orchestra.run.smithi080.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 584 kB/s | 44 kB 00:00 2024-04-16T15:33:38.651 INFO:teuthology.orchestra.run.smithi080.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-04-16T15:33:38.684 INFO:teuthology.orchestra.run.smithi080.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-16T15:33:38.718 INFO:teuthology.orchestra.run.smithi080.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-04-16T15:33:38.743 INFO:teuthology.orchestra.run.smithi080.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-04-16T15:33:38.769 INFO:teuthology.orchestra.run.smithi080.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-04-16T15:33:38.794 INFO:teuthology.orchestra.run.smithi080.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-16T15:33:38.875 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-04-16T15:33:38.919 INFO:teuthology.orchestra.run.smithi080.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-16T15:33:38.944 INFO:teuthology.orchestra.run.smithi080.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-16T15:33:38.970 INFO:teuthology.orchestra.run.smithi080.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-16T15:33:38.995 INFO:teuthology.orchestra.run.smithi080.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-04-16T15:33:39.054 INFO:teuthology.orchestra.run.smithi080.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 197 kB/s | 21 kB 00:00 2024-04-16T15:33:39.079 INFO:teuthology.orchestra.run.smithi080.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 233 kB/s | 25 kB 00:00 2024-04-16T15:33:39.150 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-04-16T15:33:39.150 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-04-16T15:33:39.206 INFO:teuthology.orchestra.run.smithi080.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.6 MB/s | 245 kB 00:00 2024-04-16T15:33:39.230 INFO:teuthology.orchestra.run.smithi080.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.6 MB/s | 248 kB 00:00 2024-04-16T15:33:39.263 INFO:teuthology.orchestra.run.smithi080.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-16T15:33:39.289 INFO:teuthology.orchestra.run.smithi080.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-16T15:33:39.339 INFO:teuthology.orchestra.run.smithi080.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-16T15:33:39.573 INFO:teuthology.orchestra.run.smithi080.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-04-16T15:33:39.615 INFO:teuthology.orchestra.run.smithi080.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 471 kB/s | 19 kB 00:00 2024-04-16T15:33:39.648 INFO:teuthology.orchestra.run.smithi080.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-04-16T15:33:39.690 INFO:teuthology.orchestra.run.smithi080.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-04-16T15:33:39.732 INFO:teuthology.orchestra.run.smithi080.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-16T15:33:39.774 INFO:teuthology.orchestra.run.smithi080.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-16T15:33:39.833 INFO:teuthology.orchestra.run.smithi080.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-16T15:33:40.016 INFO:teuthology.orchestra.run.smithi080.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-16T15:33:40.150 INFO:teuthology.orchestra.run.smithi080.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-04-16T15:33:40.209 INFO:teuthology.orchestra.run.smithi080.stdout:(115/174): openssl-devel-3.0.7-27.el9.x86_64.rp 3.4 MB/s | 4.1 MB 00:01 2024-04-16T15:33:40.234 INFO:teuthology.orchestra.run.smithi080.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 518 kB/s | 43 kB 00:00 2024-04-16T15:33:40.301 INFO:teuthology.orchestra.run.smithi080.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 359 kB/s | 15 kB 00:00 2024-04-16T15:33:40.368 INFO:teuthology.orchestra.run.smithi080.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 202 kB/s | 32 kB 00:00 2024-04-16T15:33:40.477 INFO:teuthology.orchestra.run.smithi080.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 980 kB/s | 172 kB 00:00 2024-04-16T15:33:40.535 INFO:teuthology.orchestra.run.smithi080.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-04-16T15:33:40.577 INFO:teuthology.orchestra.run.smithi080.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 845 kB/s | 35 kB 00:00 2024-04-16T15:33:40.661 INFO:teuthology.orchestra.run.smithi080.stdout:(122/174): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-04-16T15:33:40.711 INFO:teuthology.orchestra.run.smithi080.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 1.5 MB/s | 203 kB 00:00 2024-04-16T15:33:40.770 INFO:teuthology.orchestra.run.smithi080.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-16T15:33:40.795 INFO:teuthology.orchestra.run.smithi080.stdout:(125/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 952 kB/s | 303 kB 00:00 2024-04-16T15:33:40.821 INFO:teuthology.orchestra.run.smithi080.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-04-16T15:33:40.846 INFO:teuthology.orchestra.run.smithi080.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-16T15:33:40.871 INFO:teuthology.orchestra.run.smithi080.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-04-16T15:33:40.897 INFO:teuthology.orchestra.run.smithi080.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-16T15:33:40.922 INFO:teuthology.orchestra.run.smithi080.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-16T15:33:40.964 INFO:teuthology.orchestra.run.smithi080.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-16T15:33:41.006 INFO:teuthology.orchestra.run.smithi080.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-16T15:33:41.048 INFO:teuthology.orchestra.run.smithi080.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-16T15:33:41.131 INFO:teuthology.orchestra.run.smithi080.stdout:(134/174): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-04-16T15:33:41.165 INFO:teuthology.orchestra.run.smithi080.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-16T15:33:41.166 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-04-16T15:33:41.166 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-04-16T15:33:41.190 INFO:teuthology.orchestra.run.smithi080.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-04-16T15:33:41.217 INFO:teuthology.orchestra.run.smithi080.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-04-16T15:33:41.241 INFO:teuthology.orchestra.run.smithi080.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-04-16T15:33:41.258 INFO:teuthology.orchestra.run.smithi080.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 736 kB/s | 31 kB 00:00 2024-04-16T15:33:41.292 INFO:teuthology.orchestra.run.smithi080.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-04-16T15:33:41.317 INFO:teuthology.orchestra.run.smithi080.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-16T15:33:41.342 INFO:teuthology.orchestra.run.smithi080.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-04-16T15:33:41.368 INFO:teuthology.orchestra.run.smithi080.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-16T15:33:41.410 INFO:teuthology.orchestra.run.smithi080.stdout:(144/174): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-04-16T15:33:41.435 INFO:teuthology.orchestra.run.smithi080.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-16T15:33:41.477 INFO:teuthology.orchestra.run.smithi080.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 482 kB/s | 20 kB 00:00 2024-04-16T15:33:41.527 INFO:teuthology.orchestra.run.smithi080.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-16T15:33:41.569 INFO:teuthology.orchestra.run.smithi080.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-16T15:33:41.695 INFO:teuthology.orchestra.run.smithi080.stdout:(149/174): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-04-16T15:33:41.862 INFO:teuthology.orchestra.run.smithi080.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-04-16T15:33:41.945 INFO:teuthology.orchestra.run.smithi080.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 28 MB/s | 2.3 MB 00:00 2024-04-16T15:33:42.012 INFO:teuthology.orchestra.run.smithi080.stdout:(152/174): librados2-19.0.0-2868.gc3c87ed0.el9. 7.7 MB/s | 3.4 MB 00:00 2024-04-16T15:33:42.054 INFO:teuthology.orchestra.run.smithi080.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-04-16T15:33:42.080 INFO:teuthology.orchestra.run.smithi080.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 629 kB/s | 41 kB 00:00 2024-04-16T15:33:42.105 INFO:teuthology.orchestra.run.smithi080.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.8 MB/s | 248 kB 00:00 2024-04-16T15:33:42.138 INFO:teuthology.orchestra.run.smithi080.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-04-16T15:33:42.180 INFO:teuthology.orchestra.run.smithi080.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 954 kB/s | 71 kB 00:00 2024-04-16T15:33:42.206 INFO:teuthology.orchestra.run.smithi080.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 544 kB/s | 36 kB 00:00 2024-04-16T15:33:42.248 INFO:teuthology.orchestra.run.smithi080.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-16T15:33:42.281 INFO:teuthology.orchestra.run.smithi080.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-04-16T15:33:42.307 INFO:teuthology.orchestra.run.smithi080.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 392 kB/s | 23 kB 00:00 2024-04-16T15:33:42.332 INFO:teuthology.orchestra.run.smithi080.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-16T15:33:42.357 INFO:teuthology.orchestra.run.smithi080.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-04-16T15:33:42.382 INFO:teuthology.orchestra.run.smithi080.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-16T15:33:42.408 INFO:teuthology.orchestra.run.smithi080.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-04-16T15:33:42.433 INFO:teuthology.orchestra.run.smithi080.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 570 kB/s | 29 kB 00:00 2024-04-16T15:33:42.492 INFO:teuthology.orchestra.run.smithi080.stdout:(167/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 3.9 MB/s | 3.1 MB 00:00 2024-04-16T15:33:42.542 INFO:teuthology.orchestra.run.smithi080.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 9.0 MB/s | 1.2 MB 00:00 2024-04-16T15:33:42.592 INFO:teuthology.orchestra.run.smithi080.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-04-16T15:33:42.626 INFO:teuthology.orchestra.run.smithi080.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 465 kB 00:00 2024-04-16T15:33:42.643 INFO:teuthology.orchestra.run.smithi080.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 619 kB/s | 31 kB 00:00 2024-04-16T15:33:42.693 INFO:teuthology.orchestra.run.smithi080.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-16T15:33:42.743 INFO:teuthology.orchestra.run.smithi080.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 9.1 MB/s | 2.3 MB 00:00 2024-04-16T15:33:42.768 INFO:teuthology.orchestra.run.smithi080.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 594 kB/s | 74 kB 00:00 2024-04-16T15:33:42.776 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-04-16T15:33:42.776 INFO:teuthology.orchestra.run.smithi080.stdout:Total 12 MB/s | 228 MB 00:19 2024-04-16T15:33:43.153 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-04-16T15:33:43.427 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-04-16T15:33:43.427 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-04-16T15:33:45.432 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-04-16T15:33:45.432 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-04-16T15:33:48.020 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-04-16T15:33:48.109 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T15:33:48.233 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T15:33:48.290 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:33:48.301 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:33:48.355 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T15:33:48.412 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T15:33:48.452 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T15:33:48.485 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T15:33:48.538 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T15:33:48.875 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T15:33:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:33:49.067 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:33:49.102 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:33:49.185 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:33:49.223 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:33:49.260 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T15:33:49.446 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T15:33:49.496 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T15:33:49.524 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:33:49.627 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:33:49.650 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:33:49.715 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:33:49.754 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T15:33:49.776 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:33:49.793 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:33:49.987 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:33:50.016 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:33:50.048 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T15:33:50.239 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T15:33:50.367 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:33:50.422 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:33:50.540 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:50.590 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:50.814 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:50.923 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T15:33:51.025 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T15:33:51.061 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T15:33:51.088 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T15:33:51.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T15:33:51.233 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T15:33:51.285 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T15:33:51.323 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T15:33:51.388 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T15:33:51.423 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T15:33:51.466 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T15:33:51.499 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T15:33:51.526 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T15:33:51.597 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T15:33:51.631 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T15:33:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T15:33:51.703 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T15:33:51.774 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T15:33:51.817 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T15:33:51.891 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T15:33:52.027 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T15:33:52.078 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T15:33:52.474 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-04-16T15:33:52.556 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T15:33:52.599 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T15:33:52.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T15:33:52.683 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T15:33:52.687 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:33:52.736 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T15:33:52.769 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T15:33:52.818 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:33:52.828 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:33:52.858 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T15:33:52.898 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T15:33:52.937 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T15:33:52.955 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T15:33:52.967 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T15:33:53.017 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T15:33:53.050 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T15:33:53.075 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T15:33:53.118 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T15:33:53.250 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T15:33:53.398 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T15:33:53.446 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T15:33:53.468 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T15:33:53.510 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:33:53.511 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T15:33:53.631 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:33:53.648 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T15:33:53.661 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:33:53.698 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T15:33:53.752 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:33:53.776 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:33:53.817 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T15:33:53.930 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T15:33:53.993 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T15:33:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T15:33:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T15:33:54.050 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T15:33:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T15:33:54.069 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:33:54.116 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T15:33:54.151 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T15:33:54.184 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:33:54.203 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T15:33:54.204 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:33:54.244 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T15:33:54.269 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T15:33:54.317 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T15:33:54.339 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:33:54.355 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T15:33:54.377 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T15:33:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T15:33:54.456 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T15:33:54.496 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T15:33:54.541 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:33:54.563 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T15:33:54.591 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T15:33:54.602 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T15:33:54.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T15:33:54.662 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T15:33:54.678 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T15:33:54.695 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T15:33:54.770 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T15:33:54.774 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T15:33:54.904 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T15:33:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:33:55.012 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T15:33:55.053 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T15:33:55.119 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T15:33:55.174 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T15:33:55.230 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T15:33:55.348 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:55.377 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T15:33:55.408 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:55.424 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T15:33:55.553 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T15:33:55.589 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T15:33:55.621 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T15:33:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T15:33:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:33:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T15:33:55.696 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T15:33:55.736 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T15:33:55.741 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T15:33:55.833 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T15:33:55.843 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T15:33:55.863 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T15:33:55.890 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T15:33:55.956 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T15:33:55.990 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T15:33:56.025 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T15:33:56.078 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T15:33:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T15:33:56.150 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T15:33:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T15:33:56.215 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T15:33:56.255 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T15:33:56.259 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T15:33:56.292 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T15:33:56.300 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T15:33:56.311 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T15:33:56.341 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T15:33:56.372 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T15:33:56.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T15:33:56.408 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T15:33:56.451 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T15:33:56.465 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T15:33:56.480 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T15:33:56.548 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T15:33:56.555 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T15:33:56.594 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T15:33:56.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T15:33:56.630 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T15:33:56.668 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T15:33:56.676 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T15:33:56.773 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T15:33:56.801 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T15:33:56.822 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T15:33:56.847 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T15:33:57.362 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T15:33:57.433 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T15:33:57.522 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T15:33:57.552 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T15:33:57.570 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:33:57.580 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T15:33:57.594 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T15:33:57.602 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T15:33:57.628 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T15:33:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T15:33:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T15:33:57.680 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T15:33:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T15:33:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T15:33:57.807 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T15:33:57.983 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T15:33:57.999 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T15:33:58.011 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T15:33:58.094 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T15:33:58.207 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T15:33:58.296 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T15:33:58.340 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T15:33:58.492 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T15:33:58.543 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T15:33:58.597 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T15:33:58.662 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T15:33:58.693 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T15:33:58.730 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T15:33:58.751 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T15:33:58.776 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T15:33:58.813 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T15:33:58.854 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T15:33:58.855 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T15:33:58.898 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T15:33:59.023 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T15:33:59.078 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T15:33:59.109 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T15:33:59.158 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T15:33:59.251 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T15:33:59.292 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T15:33:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T15:33:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T15:33:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T15:33:59.475 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T15:33:59.599 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T15:33:59.698 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T15:33:59.740 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T15:33:59.814 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T15:33:59.869 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T15:34:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T15:34:00.072 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T15:34:00.103 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T15:34:00.158 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T15:34:00.188 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T15:34:00.220 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T15:34:00.231 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T15:34:00.247 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T15:34:00.276 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T15:34:00.317 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T15:34:00.347 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:34:00.375 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T15:34:00.410 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T15:34:00.449 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T15:34:00.489 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T15:34:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T15:34:00.552 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T15:34:00.577 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:34:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T15:34:00.629 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T15:34:00.662 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T15:34:00.668 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:34:00.698 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T15:34:00.703 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T15:34:00.738 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T15:34:00.738 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T15:34:00.827 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T15:34:00.917 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T15:34:00.961 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T15:34:00.992 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T15:34:01.039 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T15:34:01.145 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T15:34:01.193 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T15:34:01.207 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T15:34:01.248 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:34:01.317 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:34:01.340 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T15:34:01.922 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T15:34:01.965 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T15:34:02.008 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T15:34:02.056 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T15:34:02.144 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T15:34:02.192 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T15:34:02.370 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T15:34:02.398 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T15:34:02.476 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T15:34:03.128 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T15:34:03.254 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T15:34:03.566 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:03.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:04.155 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:04.190 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:34:04.286 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:34:04.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T15:34:04.286 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T15:34:04.286 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:04.324 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:34:04.488 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T15:34:04.565 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T15:34:04.596 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T15:34:04.627 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T15:34:04.655 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T15:34:04.966 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T15:34:04.993 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:34:05.066 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T15:34:05.090 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T15:34:05.118 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T15:34:05.593 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T15:34:05.621 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:34:05.692 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T15:34:05.714 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T15:34:07.901 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:07.936 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:08.475 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T15:34:08.514 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:34:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T15:34:08.607 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T15:34:08.608 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T15:34:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:08.649 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:34:15.972 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-04-16T15:34:15.973 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:16.152 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:34:16.169 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:34:16.169 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:16.170 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T15:34:16.170 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:17.638 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:34:17.665 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:34:17.665 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:17.665 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T15:34:17.665 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:34:17.665 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:34:17.666 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:17.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:34:17.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:18.364 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:34:18.388 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:18.483 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T15:34:18.910 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:34:18.939 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:34:18.971 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T15:34:19.032 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T15:34:19.062 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:34:20.101 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:34:20.131 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-04-16T15:34:20.639 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:20.811 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:34:20.826 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T15:34:20.826 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:20.826 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T15:34:20.826 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:21.096 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:34:21.114 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:34:21.214 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:34:21.385 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T15:34:21.416 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:34:21.440 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:21.484 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:34:21.495 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:34:21.548 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T15:34:22.288 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T15:34:22.315 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:22.440 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T15:34:22.469 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:34:22.493 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:22.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:34:22.544 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T15:34:22.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:34:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.568 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T15:34:22.568 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:22.620 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:22.643 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:22.643 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.643 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T15:34:22.643 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:34:22.644 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:34:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:22.954 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:34:22.978 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:34:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T15:34:23.021 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:23.021 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T15:34:23.021 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:34:23.021 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T15:34:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:23.108 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T15:34:23.561 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:34:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T15:34:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T15:34:23.682 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T15:34:23.704 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:34:24.731 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T15:34:24.773 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:34:25.732 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T15:34:25.765 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:34:25.865 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T15:34:26.026 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T15:34:26.050 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:34:26.073 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T15:34:26.074 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:26.074 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T15:34:26.074 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:34:26.074 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T15:34:26.074 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:26.118 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:34:26.129 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T15:34:26.183 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T15:34:27.062 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T15:34:27.086 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:34:27.109 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T15:34:27.110 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:27.110 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T15:34:27.110 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:34:27.110 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T15:34:27.110 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:27.153 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:34:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T15:34:27.176 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:27.176 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T15:34:27.176 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:27.229 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T15:34:27.252 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:27.555 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:34:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:34:27.578 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T15:34:27.578 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T15:34:27.579 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T15:34:27.579 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:34:27.579 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T15:34:27.579 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:27.608 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T15:34:27.638 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T15:34:27.665 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T15:34:27.843 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T15:34:27.956 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T15:34:27.996 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T15:34:28.058 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T15:34:28.105 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T15:34:28.139 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T15:34:28.164 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T15:34:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T15:34:28.225 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T15:34:28.291 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T15:34:28.369 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T15:34:28.409 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T15:34:29.056 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:29.098 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:29.119 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:29.946 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T15:34:30.018 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T15:34:30.060 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T15:34:30.160 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T15:34:30.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T15:34:30.221 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T15:34:30.246 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T15:34:30.273 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T15:34:30.273 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:34:30.377 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:34:30.415 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T15:34:30.415 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:34:30.500 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:34:30.527 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T15:34:30.559 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T15:34:30.585 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T15:34:30.609 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T15:34:30.644 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T15:34:30.694 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T15:34:30.731 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T15:34:30.756 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T15:34:30.781 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T15:34:30.806 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:34:30.832 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T15:34:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:30.839 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:31.026 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:31.026 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:34:31.109 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:34:31.141 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:34:31.168 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T15:34:31.194 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T15:34:31.218 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T15:34:31.284 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:34:32.143 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:34:32.183 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T15:34:32.214 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T15:34:32.241 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T15:34:32.427 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T15:34:32.549 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T15:34:32.597 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T15:34:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T15:34:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T15:34:32.740 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T15:34:32.773 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T15:34:32.805 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T15:34:32.835 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T15:34:32.905 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T15:34:32.970 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T15:34:33.000 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T15:34:33.554 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:33.591 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:33.611 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T15:34:34.435 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T15:34:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T15:34:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T15:34:34.643 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T15:34:34.673 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T15:34:34.698 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T15:34:34.724 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T15:34:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T15:34:34.750 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:34:34.855 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T15:34:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T15:34:34.884 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:34:34.969 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T15:34:34.995 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T15:34:35.028 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T15:34:35.054 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T15:34:35.079 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T15:34:35.114 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T15:34:35.152 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T15:34:35.183 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T15:34:35.208 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T15:34:35.234 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T15:34:35.259 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:34:35.284 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T15:34:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:35.291 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:35.470 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T15:34:35.470 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:34:35.545 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T15:34:35.577 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:34:35.604 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T15:34:35.630 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T15:34:35.663 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T15:34:35.728 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T15:34:36.714 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T15:34:36.715 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T15:34:36.716 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T15:34:36.732 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T15:34:36.733 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T15:34:36.734 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T15:34:36.735 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T15:34:36.736 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T15:34:36.737 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T15:34:36.738 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T15:34:36.739 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T15:34:36.740 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T15:34:36.741 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T15:34:36.742 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T15:34:36.743 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T15:34:36.744 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T15:34:39.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T15:34:39.883 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:39.883 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-04-16T15:34:39.883 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.884 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T15:34:39.885 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.886 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T15:34:39.887 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: jq-1.6-16.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.888 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T15:34:39.889 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T15:34:39.890 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T15:34:39.891 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T15:34:39.892 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T15:34:39.893 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T15:34:39.894 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T15:34:39.895 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T15:34:39.896 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T15:34:39.897 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T15:34:39.897 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:39.897 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-16T15:34:40.340 DEBUG:teuthology.parallel:result is None 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T15:34:41.429 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T15:34:41.430 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T15:34:41.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T15:34:41.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T15:34:41.431 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T15:34:41.447 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T15:34:41.448 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T15:34:41.449 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T15:34:41.450 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T15:34:41.451 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T15:34:41.452 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T15:34:41.453 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T15:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T15:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T15:34:41.456 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T15:34:41.457 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T15:34:41.458 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T15:34:41.459 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T15:34:41.460 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:44.336 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.337 INFO:teuthology.orchestra.run.smithi080.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T15:34:44.338 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.339 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T15:34:44.340 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: jq-1.6-16.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T15:34:44.341 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T15:34:44.342 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T15:34:44.343 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T15:34:44.344 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T15:34:44.345 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T15:34:44.346 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T15:34:44.347 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T15:34:44.348 INFO:teuthology.orchestra.run.smithi080.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T15:34:44.349 INFO:teuthology.orchestra.run.smithi080.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T15:34:44.349 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T15:34:44.349 INFO:teuthology.orchestra.run.smithi080.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T15:34:44.349 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:44.349 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-04-16T15:34:44.834 DEBUG:teuthology.parallel:result is None 2024-04-16T15:34:44.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:34:44.986 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T15:34:45.008 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:34:45.009 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:34:45.009 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T15:34:45.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T15:34:45.234 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T15:34:45.261 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:34:45.261 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T15:34:45.261 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T15:34:45.263 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T15:34:45.263 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:45.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T15:34:45.296 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:45.296 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T15:34:45.337 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T15:34:45.337 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:45.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T15:34:45.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T15:34:45.434 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:45.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T15:34:45.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T15:34:45.538 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T15:34:45.539 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:45.539 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T15:34:45.568 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T15:34:45.636 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:45.636 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T15:34:45.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T15:34:45.737 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T15:34:45.738 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:45.738 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T15:34:45.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T15:34:45.833 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:45.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T15:34:45.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T15:34:45.933 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T15:34:46.020 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T15:34:46.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-04-16T15:34:46.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-04-16T15:34:46.052 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T15:34:46.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T15:34:46.090 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T15:34:46.122 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T15:34:46.122 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T15:34:46.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T15:34:46.198 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T15:34:46.199 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T15:34:46.200 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T15:34:46.200 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:46.200 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T15:34:46.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T15:34:46.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T15:34:46.392 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:46.392 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T15:34:46.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T15:34:46.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T15:34:46.567 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T15:34:46.568 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T15:34:46.568 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead}', 'email': None, 'first_in_suite': False, 'job_id': '7658183', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIx9kZC+lVom0nFnzCWg1XxdZn4eNWQ+XOA2Gv00Mg33JSCk86vxGlXPJQ/FD0YNo+vCjknszownuXqyqAmySRM=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaAVmZYISIJ2eqh9M2N6NzEeO5QbrKgcEIHdfIeia9rKDrAj+gTp+DfEd8fEp7RZXq7aS8u38p719bgaoGNQI8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_readahead']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T15:34:46.568 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T15:34:46.571 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T15:34:46.618 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T15:34:46.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T15:34:46.686 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:46.686 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T15:34:46.710 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T15:34:46.710 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-04-16T15:34:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T15:34:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:46.765 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-16T15:34:46.765 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:46.765 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:46.766 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-16 15:34:36.080380535 +0000 2024-04-16T15:34:46.766 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-16 15:32:34.313580529 +0000 2024-04-16T15:34:46.766 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-16 15:32:34.313580529 +0000 2024-04-16T15:34:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-16 15:32:34.313580529 +0000 2024-04-16T15:34:46.766 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T15:34:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-16T15:34:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-16T15:34:46.832 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00018379 s, 2.8 MB/s 2024-04-16T15:34:46.833 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T15:34:46.889 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-16 15:34:36.080380535 +0000 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-16 15:32:34.653572345 +0000 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-16 15:32:34.653572345 +0000 2024-04-16T15:34:46.944 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-16 15:32:34.653572345 +0000 2024-04-16T15:34:46.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T15:34:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-16T15:34:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-16T15:34:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000188366 s, 2.7 MB/s 2024-04-16T15:34:47.012 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T15:34:47.068 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-04-16T15:34:47.123 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T15:34:47.123 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:47.123 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-16T15:34:47.123 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:47.124 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:47.124 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-16 15:34:36.081380511 +0000 2024-04-16T15:34:47.124 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-16 15:32:34.992564185 +0000 2024-04-16T15:34:47.124 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-16 15:32:34.992564185 +0000 2024-04-16T15:34:47.124 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-16 15:32:34.992564185 +0000 2024-04-16T15:34:47.124 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T15:34:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-16T15:34:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-16T15:34:47.189 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000194647 s, 2.6 MB/s 2024-04-16T15:34:47.191 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T15:34:47.247 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-04-16 15:34:36.081380511 +0000 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-04-16 15:32:35.346555665 +0000 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-04-16 15:32:35.346555665 +0000 2024-04-16T15:34:47.303 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-04-16 15:32:35.346555665 +0000 2024-04-16T15:34:47.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T15:34:47.369 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-04-16T15:34:47.370 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-04-16T15:34:47.370 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000180182 s, 2.8 MB/s 2024-04-16T15:34:47.371 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T15:34:47.427 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:47.427 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:47.427 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T15:34:47.446 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T15:34:47.446 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-04-16T15:34:47.504 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-16 15:34:31.637316918 +0000 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-16 15:32:34.320633840 +0000 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-16 15:32:34.320633840 +0000 2024-04-16T15:34:47.505 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-16 15:32:34.320633840 +0000 2024-04-16T15:34:47.505 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T15:34:47.574 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-16T15:34:47.575 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-16T15:34:47.575 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000196267 s, 2.6 MB/s 2024-04-16T15:34:47.576 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T15:34:47.636 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-04-16T15:34:47.693 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T15:34:47.693 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:47.693 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-16T15:34:47.693 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:47.694 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:47.694 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-16 15:34:31.637316918 +0000 2024-04-16T15:34:47.694 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-16 15:32:34.657625932 +0000 2024-04-16T15:34:47.694 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-16 15:32:34.657625932 +0000 2024-04-16T15:34:47.694 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-16 15:32:34.657625932 +0000 2024-04-16T15:34:47.694 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T15:34:47.763 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-16T15:34:47.763 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-16T15:34:47.763 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000200652 s, 2.6 MB/s 2024-04-16T15:34:47.764 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T15:34:47.822 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:47.879 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-16 15:34:31.637316918 +0000 2024-04-16T15:34:47.880 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-16 15:32:35.001617859 +0000 2024-04-16T15:34:47.880 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-16 15:32:35.001617859 +0000 2024-04-16T15:34:47.880 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-16 15:32:35.001617859 +0000 2024-04-16T15:34:47.880 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T15:34:47.948 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-16T15:34:47.948 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-16T15:34:47.948 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000191144 s, 2.7 MB/s 2024-04-16T15:34:47.949 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T15:34:48.007 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-16 15:34:31.638316894 +0000 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-16 15:32:35.346609764 +0000 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-16 15:32:35.346609764 +0000 2024-04-16T15:34:48.064 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-16 15:32:35.346609764 +0000 2024-04-16T15:34:48.065 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T15:34:48.132 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-16T15:34:48.132 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-16T15:34:48.132 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000200537 s, 2.6 MB/s 2024-04-16T15:34:48.133 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T15:34:48.190 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:48.190 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T15:34:48.191 INFO:tasks.ceph:Generating config... 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] pid file = 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T15:34:48.192 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T15:34:48.192 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T15:34:48.192 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T15:34:48.192 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T15:34:48.193 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T15:34:48.194 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T15:34:48.194 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T15:34:48.194 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T15:34:48.194 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-16T15:34:48.194 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T15:34:48.195 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T15:34:48.195 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T15:34:48.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T15:34:48.252 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T15:34:48.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T15:34:48.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:34:48.330 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.80'), ('mon.b', '172.21.15.87'), ('mon.c', '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]')] 2024-04-16T15:34:48.331 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.80,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T15:34:48.332 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:48.332 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T15:34:48.387 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.80 --add b 172.21.15.87 --addv c '[v2:172.21.15.87:3301,v1:172.21.15.87:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:48.473 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:48.473 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: generated fsid a7d324ba-fc74-42df-88c0-3e8f3a7e8eab 2024-04-16T15:34:48.473 INFO:teuthology.orchestra.run.smithi080.stdout:setting min_mon_release = quincy 2024-04-16T15:34:48.473 INFO:teuthology.orchestra.run.smithi080.stdout:epoch 0 2024-04-16T15:34:48.473 INFO:teuthology.orchestra.run.smithi080.stdout:fsid a7d324ba-fc74-42df-88c0-3e8f3a7e8eab 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:last_changed 2024-04-16T15:34:48.475419+0000 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:created 2024-04-16T15:34:48.475419+0000 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:min_mon_release 17 (quincy) 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:election_strategy: 1 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:1: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.b 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:2: [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] mon.c 2024-04-16T15:34:48.474 INFO:teuthology.orchestra.run.smithi080.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T15:34:48.476 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T15:34:48.491 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a7d324ba-fc74-42df-88c0-3e8f3a7e8eab... 2024-04-16T15:34:48.492 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T15:34:48.533 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-04-16T15:34:48.584 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-04-16T15:34:48.585 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T15:34:48.586 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.80,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = a7d324ba-fc74-42df-88c0-3e8f3a7e8eab 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-04-16T15:34:48.587 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.588 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-04-16T15:34:48.589 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 20 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 20 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-16T15:34:48.590 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 10 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-16T15:34:48.591 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-04-16T15:34:48.592 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-04-16T15:34:48.593 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: mon down mkfs grace = 300 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: mon op complaint time = 120 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: client mount timeout = 600 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: debug client = 20 2024-04-16T15:34:48.594 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = "" 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout:[mds] 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds = 20 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: debug mds balancer = 20 2024-04-16T15:34:48.595 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug frag = True 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug scatterstat = True 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: mds debug zombie log segments = True 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: mds op complaint time = 180 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: mds verify scatter = True 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: osd op complaint time = 180 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: rados mon op timeout = 900 2024-04-16T15:34:48.596 INFO:teuthology.orchestra.run.smithi080.stdout: rados osd op timeout = 900 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.597 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-04-16T15:34:48.598 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.599 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.80,172.21.15.87,[v2:172.21.15.87:3301,v1:172.21.15.87:6790]" 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = a7d324ba-fc74-42df-88c0-3e8f3a7e8eab 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-04-16T15:34:48.600 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-04-16T15:34:48.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.602 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-04-16T15:34:48.603 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.604 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-16T15:34:48.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.606 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: mon down mkfs grace = 300 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-16T15:34:48.607 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = "" 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-04-16T15:34:48.608 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug zombie log segments = True 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-04-16T15:34:48.609 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-04-16T15:34:48.611 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T15:34:48.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T15:34:48.709 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T15:34:48.709 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:48.709 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T15:34:48.725 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:48.725 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T15:34:48.781 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:34:48.782 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:48.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T15:34:48.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:34:48.864 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:34:48.864 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:48.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:34:48.919 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:48.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T15:34:48.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T15:34:48.962 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:34:48.963 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:49.018 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T15:34:49.018 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T15:34:49.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T15:34:49.075 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T15:34:49.078 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T15:34:49.140 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T15:34:49.142 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T15:34:49.142 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T15:34:49.200 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T15:34:49.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T15:34:49.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T15:34:49.329 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T15:34:49.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-16T15:34:49.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T15:34:49.417 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T15:34:49.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T15:34:49.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T15:34:49.544 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T15:34:49.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-16T15:34:49.575 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T15:34:49.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T15:34:49.620 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T15:34:49.636 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-16T15:34:49.679 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-16T15:34:49.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T15:34:49.740 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-16T15:34:49.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-16T15:34:49.800 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-16T15:34:49.816 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T15:34:49.816 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T15:34:49.816 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T15:34:49.845 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:49.845 INFO:tasks.ceph:role: osd.0 2024-04-16T15:34:49.845 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:34:49.845 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:34:49.921 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:34:49.922 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:34:50.432 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-16T15:34:50.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-16T15:34:50.435 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T15:34:50.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T15:34:50.591 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T15:34:50.660 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:50.660 INFO:tasks.ceph:role: osd.1 2024-04-16T15:34:50.660 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:34:50.660 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:34:50.736 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:34:51.188 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-16T15:34:51.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-16T15:34:51.190 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T15:34:51.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T15:34:51.333 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T15:34:51.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:51.402 INFO:tasks.ceph:role: osd.2 2024-04-16T15:34:51.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:34:51.402 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T15:34:51.477 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:34:51.477 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:34:51.477 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:34:51.477 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:34:51.478 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:34:51.960 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-16T15:34:51.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-16T15:34:51.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T15:34:52.081 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T15:34:52.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T15:34:52.184 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T15:34:52.184 INFO:tasks.ceph:role: osd.3 2024-04-16T15:34:52.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:34:52.185 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T15:34:52.260 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:34:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:34:52.260 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:34:52.261 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:34:52.777 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-04-16T15:34:52.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-04-16T15:34:52.780 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T15:34:52.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T15:34:52.942 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:53.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.040+0000 7f5e54c13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T15:34:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.041+0000 7f5e54c13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T15:34:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.041+0000 7f5e54c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:34:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.041+0000 7f5e54c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:34:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.041+0000 7f5e54c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T15:34:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:53.041+0000 7f5e54c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T15:34:55.886 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T15:34:55.919 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T15:34:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T15:34:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:34:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:34:56.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T15:34:56.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:56.013+0000 7f6de6d81640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T15:34:58.864 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T15:34:58.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:34:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.995+0000 7faac280f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T15:34:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.996+0000 7faac280f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T15:34:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.996+0000 7faac280f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:34:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.996+0000 7faac280f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:34:58.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.996+0000 7faac280f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T15:34:58.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:34:58.996+0000 7faac280f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T15:35:01.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T15:35:01.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.977+0000 7f839a99e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.977+0000 7f839a99e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.977+0000 7f839a99e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.977+0000 7f839a99e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.977+0000 7f839a99e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T15:35:01.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:01.978+0000 7f839a99e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T15:35:04.834 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T15:35:04.867 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T15:35:04.901 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:35:04.901 INFO:tasks.ceph:role: osd.4 2024-04-16T15:35:04.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:35:04.901 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T15:35:04.980 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:35:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:35:05.487 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-16T15:35:05.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-16T15:35:05.490 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T15:35:05.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T15:35:05.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T15:35:05.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:35:05.709 INFO:tasks.ceph:role: osd.5 2024-04-16T15:35:05.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:35:05.710 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T15:35:05.797 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:35:05.797 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:35:05.797 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:35:05.798 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:35:06.259 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-16T15:35:06.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-16T15:35:06.262 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T15:35:06.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T15:35:06.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T15:35:06.413 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:35:06.413 INFO:tasks.ceph:role: osd.6 2024-04-16T15:35:06.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:35:06.414 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:35:06.489 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:35:06.490 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:35:06.490 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:35:06.490 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:35:06.490 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:35:06.991 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-16T15:35:06.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-16T15:35:06.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T15:35:07.128 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T15:35:07.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T15:35:07.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T15:35:07.229 INFO:tasks.ceph:role: osd.7 2024-04-16T15:35:07.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:35:07.229 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T15:35:07.305 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-16T15:35:07.306 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T15:35:07.306 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T15:35:07.306 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T15:35:07.306 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T15:35:07.824 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-16T15:35:07.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-16T15:35:07.826 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T15:35:07.974 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T15:35:08.011 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:08.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.117+0000 7f417be1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T15:35:08.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.117+0000 7f417be1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T15:35:08.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.117+0000 7f417be1e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:35:08.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.117+0000 7f417be1e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:35:08.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.117+0000 7f417be1e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T15:35:08.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:08.118+0000 7f417be1e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T15:35:10.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T15:35:11.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.097+0000 7f0650620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.098+0000 7f0650620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.098+0000 7f0650620640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.098+0000 7f0650620640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.098+0000 7f0650620640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T15:35:11.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:11.098+0000 7f0650620640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T15:35:13.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T15:35:13.973 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:14.063 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.064+0000 7f7301c24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T15:35:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.064+0000 7f7301c24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T15:35:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.065+0000 7f7301c24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:35:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.065+0000 7f7301c24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:35:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.065+0000 7f7301c24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T15:35:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:14.065+0000 7f7301c24640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T15:35:16.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:35:16.573 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:35:16.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T15:35:16.947 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.038+0000 7ffa17a1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.039+0000 7ffa17a1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.039+0000 7ffa17a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.039+0000 7ffa17a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.039+0000 7ffa17a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T15:35:17.038 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:17.039+0000 7ffa17a1d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T15:35:19.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T15:35:19.925 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T15:35:19.926 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:19.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T15:35:19.958 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:19.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T15:35:20.033 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.033 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-16T15:35:20.103 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.104 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T15:35:20.174 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.174 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T15:35:20.243 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.243 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T15:35:20.312 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T15:35:20.380 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.380 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T15:35:20.414 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.414 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T15:35:20.487 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.487 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-16T15:35:20.558 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T15:35:20.628 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.629 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T15:35:20.702 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T15:35:20.772 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T15:35:20.842 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.842 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T15:35:20.859 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:20.859 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-16T15:35:20.917 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.918 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-16T15:35:20.934 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:20.935 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-16T15:35:20.991 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T15:35:20.991 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T15:35:20.994 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mKG+mBBAAAQJ0LqreWmB7hebYxRtTjQ== 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.a] 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5m2tQRDBAArV0sgbz3N1U1X87ohfAdMA== 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.c] 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5m0o3CExAAblaDEonQz0iBjnui/dXy+w== 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-04-16T15:35:21.035 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCdmh5mIDaHAhAAdXWmoruVSsqTzdxvVdO0NA== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCgmh5mn6LeABAAEHMqv3vl5auYrC2DSLm4Gw== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCimh5mJEdyOxAAFn/7mKIT7VhifPui/1vRFw== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQClmh5mGjtcOhAAleOff0sp2jKFMOnd51uilw== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5m4i5/CBAA6P6GwpT6mJlH02kruUJOSw== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.b] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mk10BGRAAg88e02g+XsmZn+cL7/FR1w== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[mds.d] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mlm6gIBAA0J/5wQjWvD4nyhuK+29fRA== 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-04-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCsmh5mzJ0QBxAA5Jhmy+AKlHfBpMowBlo8HQ== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCvmh5mjSnlBRAAdoDKuQ/4nqOrrN4KJNWj1A== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCymh5maOXqAxAAxaddYNHtN09Vh3fF2VjV/Q== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQC1mh5my2NgAhAAfstKIRQhvRMHC29MxkBemQ== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5maTEdJRAAjycncCgzkzPFmaorV1Xi0w== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[client.2] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mQROkKBAA/S6AkkUdOq83wpQeunO8cQ== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mD7FELBAASP0YMguYjIgHgdCAv87Pew== 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout:[client.3] 2024-04-16T15:35:21.037 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5mMp3dLxAAvM5PWJbfkrnrztPOK8I9Og== 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mKG+mBBAAAQJ0LqreWmB7hebYxRtTjQ== 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5m2tQRDBAArV0sgbz3N1U1X87ohfAdMA== 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5m0o3CExAAblaDEonQz0iBjnui/dXy+w== 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCdmh5mIDaHAhAAdXWmoruVSsqTzdxvVdO0NA== 2024-04-16T15:35:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCgmh5mn6LeABAAEHMqv3vl5auYrC2DSLm4Gw== 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCimh5mJEdyOxAAFn/7mKIT7VhifPui/1vRFw== 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQClmh5mGjtcOhAAleOff0sp2jKFMOnd51uilw== 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5m4i5/CBAA6P6GwpT6mJlH02kruUJOSw== 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mk10BGRAAg88e02g+XsmZn+cL7/FR1w== 2024-04-16T15:35:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mlm6gIBAA0J/5wQjWvD4nyhuK+29fRA== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCsmh5mzJ0QBxAA5Jhmy+AKlHfBpMowBlo8HQ== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCvmh5mjSnlBRAAdoDKuQ/4nqOrrN4KJNWj1A== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCymh5maOXqAxAAxaddYNHtN09Vh3fF2VjV/Q== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC1mh5my2NgAhAAfstKIRQhvRMHC29MxkBemQ== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5maTEdJRAAjycncCgzkzPFmaorV1Xi0w== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[client.2] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mQROkKBAA/S6AkkUdOq83wpQeunO8cQ== 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2024-04-16T15:35:21.061 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mD7FELBAASP0YMguYjIgHgdCAv87Pew== 2024-04-16T15:35:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:[client.3] 2024-04-16T15:35:21.062 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCZmh5mMp3dLxAAvM5PWJbfkrnrztPOK8I9Og== 2024-04-16T15:35:21.063 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:35:21.082 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:35:21.160 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.219 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.280 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.334 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.448 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.502 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:35:21.504 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T15:35:21.558 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.561 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.620 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T15:35:21.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.849 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T15:35:21.903 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:21.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:21.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:21.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:22.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:22.023 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:22.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:22.083 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T15:35:22.139 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T15:35:22.139 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T15:35:22.168 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:35:22.268 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T15:35:22.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T15:35:22.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:35:22.424 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T15:35:22.452 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T15:35:22.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T15:35:22.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T15:35:22.647 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:22.649 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T15:35:22.703 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T15:35:22.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T15:35:22.703 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T15:35:22.706 INFO:tasks.ceph.mon.a:Started 2024-04-16T15:35:22.706 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T15:35:22.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T15:35:22.746 INFO:tasks.ceph.mon.b:Started 2024-04-16T15:35:22.746 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T15:35:22.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T15:35:22.749 INFO:tasks.ceph.mon.c:Started 2024-04-16T15:35:22.749 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T15:35:22.749 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T15:35:22.749 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T15:35:22.752 INFO:tasks.ceph.mgr.y:Started 2024-04-16T15:35:22.752 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T15:35:22.752 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T15:35:22.754 INFO:tasks.ceph.mgr.x:Started 2024-04-16T15:35:22.754 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T15:35:22.754 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T15:35:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 Processor -- start 2024-04-16T15:35:22.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 -- start start 2024-04-16T15:35:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac40d1b70 con 0x7fbac40d2c90 2024-04-16T15:35:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac40d55b0 con 0x7fbac40d30f0 2024-04-16T15:35:22.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbacad1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbac415ef60 con 0x7fbac415eb80 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.860+0000 7fbac8ab7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41002/0 (socket says 172.21.15.80:41002) 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbac40d2c90 0x7fbac40d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60272/0 (socket says 172.21.15.80:60272) 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1251169403 learned_addr learned my addr 172.21.15.80:0/1251169403 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 msgr2=0x7fbac40d5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 msgr2=0x7fbac40d5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T15:35:22.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:22.861+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670582915 0 0) 0x7fbac40d55b0 con 0x7fbac40d30f0 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaac003520 con 0x7fbac40d30f0 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1187387747 0 0) 0x7fbaac003520 con 0x7fbac40d30f0 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 msgr2=0x7fbac40d5070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 --2- 172.21.15.80:0/1251169403 >> v2:172.21.15.80:3300/0 conn(0x7fbac415eb80 0x7fbac40d5070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 >> v1:172.21.15.80:6789/0 conn(0x7fbac40d2c90 legacy=0x7fbac40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac40cf6a0 con 0x7fbac40d30f0 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fbabc0019f0 con 0x7fbac40d30f0 2024-04-16T15:35:23.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 >> v1:172.21.15.87:6789/0 conn(0x7fbac40d30f0 legacy=0x7fbac40d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaac003a00 0x7fbaac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbaac004800 0x7fbaac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbaac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbac415ef60 con 0x7fbaac005210 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac00c150 con 0x7fbaac003a00 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbaac00c350 con 0x7fbaac004800 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbaac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaac003a00 0x7fbaac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac3fff640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbaac004800 0x7fbaac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 -- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbaac004800 msgr2=0x7fbaac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbaac004800 0x7fbaac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 -- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaac003a00 msgr2=0x7fbaac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaac003a00 0x7fbaac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.024+0000 7fbac92b8640 1 -- 172.21.15.80:0/1251169403 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac003520 con 0x7fbaac005210 2024-04-16T15:35:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.025+0000 7fbac92b8640 1 -- 172.21.15.80:0/1251169403 reap_dead start 2024-04-16T15:35:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.025+0000 7fbac92b8640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbaac00b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c4b0 tx=0x7fbaac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5aff5480f86a84 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.026+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00c0e0 con 0x7fbaac005210 2024-04-16T15:35:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.026+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc006d90 con 0x7fbaac005210 2024-04-16T15:35:23.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.026+0000 7fbac37fe640 1 -- 172.21.15.80:0/1251169403 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc02cd10 con 0x7fbaac005210 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.026+0000 7fbacad1b640 1 -- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 msgr2=0x7fbaac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbaac00b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c4b0 tx=0x7fbaac005830 comp rx=0 tx=0).stop 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 -- 172.21.15.80:0/1251169403 shutdown_connections 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1251169403 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbaac00b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 -- 172.21.15.80:0/1251169403 >> 172.21.15.80:0/1251169403 conn(0x7fbac408c000 msgr2=0x7fbac40d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 -- 172.21.15.80:0/1251169403 shutdown_connections 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.027+0000 7fbacad1b640 1 -- 172.21.15.80:0/1251169403 wait complete. 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.028+0000 7fbacad1b640 1 Processor -- start 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.028+0000 7fbacad1b640 1 -- start start 2024-04-16T15:35:23.029 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b2150 0x7fbac4159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac415a4c0 0x7fbac41ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40cff40 con 0x7fbaac005210 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbac40cfc60 con 0x7fbac415a4c0 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbac40d0220 con 0x7fbac40b2150 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41030/0 (socket says 172.21.15.80:41030) 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1304738931 learned_addr learned my addr 172.21.15.80:0/1304738931 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac92b8640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac415a4c0 0x7fbac41ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac3fff640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b2150 0x7fbac4159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b2150 msgr2=0x7fbac4159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b2150 0x7fbac4159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac415a4c0 msgr2=0x7fbac41ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac415a4c0 0x7fbac41ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 -- 172.21.15.80:0/1304738931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac415f180 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac8ab7640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbab4011630 tx=0x7fbab4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4019070 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab4015870 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.029+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac415a270 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.030+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab400f040 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.030+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac415f420 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.030+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbab401c070 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.030+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbab400f7a0 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.031+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac4069150 con 0x7fbaac005210 2024-04-16T15:35:23.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.033+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbab4015da0 con 0x7fbaac005210 2024-04-16T15:35:23.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.098+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbac40d2a70 con 0x7fbaac005210 2024-04-16T15:35:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.100+0000 7fbac17fa640 1 -- 172.21.15.80:0/1304738931 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbab400f9f0 con 0x7fbaac005210 2024-04-16T15:35:23.098 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-04-16T15:35:23.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 msgr2=0x7fbac415fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbab4011630 tx=0x7fbab4011a30 comp rx=0 tx=0).stop 2024-04-16T15:35:23.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 shutdown_connections 2024-04-16T15:35:23.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac415a4c0 0x7fbac41ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbac40b2150 0x7fbac4159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 --2- 172.21.15.80:0/1304738931 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbaac005210 0x7fbac415fc20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 >> 172.21.15.80:0/1304738931 conn(0x7fbac408c000 msgr2=0x7fbac406df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 shutdown_connections 2024-04-16T15:35:23.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:23.101+0000 7fbacad1b640 1 -- 172.21.15.80:0/1304738931 wait complete. 2024-04-16T15:35:23.110 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T15:35:23.110 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T15:35:23.111 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:23.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T15:35:23.139 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:23.139 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T15:35:23.207 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:23.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T15:35:23.275 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:23.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T15:35:23.344 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:23.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T15:35:23.373 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:23.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T15:35:23.442 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:23.442 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T15:35:23.483 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:23.484+0000 7fc49ea2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T15:35:23.494 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:23.495+0000 7fe41ae17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T15:35:23.510 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:35:23.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T15:35:23.540 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:23.541+0000 7fc49ea2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T15:35:23.546 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:23.548+0000 7fe41ae17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T15:35:23.567 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new a4807c88-87e2-4084-acbb-5a9121b644f9 0 2024-04-16T15:35:23.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.712+0000 7f41905ba640 1 Processor -- start 2024-04-16T15:35:23.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.712+0000 7f41905ba640 1 -- start start 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f41905ba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f41880cb960 0x7f41880cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f41905ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f41905ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418815ca20 con 0x7f418815c640 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f41905ba640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f41880cf180 con 0x7f41880cb960 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f41905ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f41880c7e10 con 0x7f41880c6de0 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:40964/0 (socket says 172.21.15.87:40964) 2024-04-16T15:35:23.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 -- 172.21.15.87:0/1733035185 learned_addr learned my addr 172.21.15.87:0/1733035185 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418db55640 1 --2- 172.21.15.87:0/1733035185 >> v2:172.21.15.80:3300/0 conn(0x7f41880cb960 0x7f41880cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 -- 172.21.15.87:0/1733035185 >> v2:172.21.15.80:3300/0 conn(0x7f41880cb960 msgr2=0x7f41880cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 --2- 172.21.15.87:0/1733035185 >> v2:172.21.15.80:3300/0 conn(0x7f41880cb960 0x7f41880cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 -- 172.21.15.87:0/1733035185 >> v1:172.21.15.87:6789/0 conn(0x7f418815c640 legacy=0x7f41880b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418d354640 1 -- 172.21.15.87:0/1733035185 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565381448 0 0) 0x7f418815ca20 con 0x7f418815c640 2024-04-16T15:35:23.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.713+0000 7f418eb57640 1 -- 172.21.15.87:0/1733035185 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41880c6300 con 0x7f41880c6de0 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.714+0000 7f418eb57640 1 --2- 172.21.15.87:0/1733035185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e80 tx=0x7f418002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c46c7d764ba700b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.714+0000 7f418d354640 1 -- 172.21.15.87:0/1733035185 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418002ca50 con 0x7f41880c6de0 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.714+0000 7f418d354640 1 -- 172.21.15.87:0/1733035185 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418002cbf0 con 0x7f41880c6de0 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.714+0000 7f418d354640 1 -- 172.21.15.87:0/1733035185 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800343f0 con 0x7f41880c6de0 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 -- 172.21.15.87:0/1733035185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 msgr2=0x7f41880c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 --2- 172.21.15.87:0/1733035185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4180009e80 tx=0x7f418002beb0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 -- 172.21.15.87:0/1733035185 shutdown_connections 2024-04-16T15:35:23.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 --2- 172.21.15.87:0/1733035185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f41880c6de0 0x7f41880c7250 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 --2- 172.21.15.87:0/1733035185 >> v2:172.21.15.80:3300/0 conn(0x7f41880cb960 0x7f41880cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 -- 172.21.15.87:0/1733035185 >> 172.21.15.87:0/1733035185 conn(0x7f41880d13a0 msgr2=0x7f41880d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 -- 172.21.15.87:0/1733035185 shutdown_connections 2024-04-16T15:35:23.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.715+0000 7f41905ba640 1 -- 172.21.15.87:0/1733035185 wait complete. 2024-04-16T15:35:23.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.716+0000 7f41905ba640 1 Processor -- start 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.716+0000 7f41905ba640 1 -- start start 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41880cb960 0x7f41880b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f41880c7ae0 con 0x7f41880cb960 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41880c68c0 con 0x7f41880c6de0 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f41880c80f0 con 0x7f418815c640 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418e356640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:40976/0 (socket says 172.21.15.87:40976) 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418e356640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53352/0 (socket says 172.21.15.87:53352) 2024-04-16T15:35:23.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 -- 172.21.15.87:0/151264559 learned_addr learned my addr 172.21.15.87:0/151264559 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418db55640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41880cb960 0x7f41880b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 -- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 msgr2=0x7f4188150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 -- 172.21.15.87:0/151264559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41880cb960 msgr2=0x7f41880b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41880cb960 0x7f41880b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 -- 172.21.15.87:0/151264559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418815d090 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418e356640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f418eb57640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f418002c4c0 tx=0x7f4180004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180043030 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418003e450 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4188157b70 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180009510 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.717+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4188158130 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.718+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4180046070 con 0x7f418815c640 2024-04-16T15:35:23.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.718+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4180048750 con 0x7f418815c640 2024-04-16T15:35:23.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.718+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4188069150 con 0x7f418815c640 2024-04-16T15:35:23.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.720+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f418004d070 con 0x7f418815c640 2024-04-16T15:35:23.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.793+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4807c88-87e2-4084-acbb-5a9121b644f9", "id": 0} v 0) -- 0x7f41881512c0 con 0x7f418815c640 2024-04-16T15:35:23.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.796+0000 7f417effd640 1 -- 172.21.15.87:0/151264559 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4807c88-87e2-4084-acbb-5a9121b644f9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f418815d090 con 0x7f418815c640 2024-04-16T15:35:23.795 INFO:teuthology.orchestra.run.smithi087.stdout:0 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 msgr2=0x7f41880aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f418002c4c0 tx=0x7f4180004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 shutdown_connections 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f418815c640 0x7f41880aecc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41880cb960 0x7f41880b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 --2- 172.21.15.87:0/151264559 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41880c6de0 0x7f4188150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 >> 172.21.15.87:0/151264559 conn(0x7f41880d13a0 msgr2=0x7f4188156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 shutdown_connections 2024-04-16T15:35:23.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.797+0000 7f41905ba640 1 -- 172.21.15.87:0/151264559 wait complete. 2024-04-16T15:35:23.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 44b74c98-ef92-447a-adfc-713613923d1d 1 2024-04-16T15:35:23.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 Processor -- start 2024-04-16T15:35:23.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 -- start start 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02140b3ed0 con 0x7f02140b0780 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f02140d0400 con 0x7f021406f5b0 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f021b1e8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f02140cf550 con 0x7f021415b6c0 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f0219785640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.910+0000 7f0218f84640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0213fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f02140b0780 0x7f02140d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44166/0 (socket says 172.21.15.87:44166) 2024-04-16T15:35:23.910 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0218f84640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:40992/0 (socket says 172.21.15.87:40992) 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0219785640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53364/0 (socket says 172.21.15.87:53364) 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0213fff640 1 -- 172.21.15.87:0/2283908212 learned_addr learned my addr 172.21.15.87:0/2283908212 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0218f84640 1 -- 172.21.15.87:0/2283908212 >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 msgr2=0x7f021406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0218f84640 1 --2- 172.21.15.87:0/2283908212 >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0218f84640 1 -- 172.21.15.87:0/2283908212 >> v1:172.21.15.87:6789/0 conn(0x7f02140b0780 legacy=0x7f02140d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0218f84640 1 -- 172.21.15.87:0/2283908212 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02140cf7f0 con 0x7f021415b6c0 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.911+0000 7f0219785640 1 --2- 172.21.15.87:0/2283908212 >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:23.911 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f0218f84640 1 --2- 172.21.15.87:0/2283908212 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd67245dc77010c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f02137fe640 1 -- 172.21.15.87:0/2283908212 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208035020 con 0x7f021415b6c0 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f02137fe640 1 -- 172.21.15.87:0/2283908212 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0208031810 con 0x7f021415b6c0 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f02137fe640 1 -- 172.21.15.87:0/2283908212 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208031be0 con 0x7f021415b6c0 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 -- 172.21.15.87:0/2283908212 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 msgr2=0x7f02140b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 --2- 172.21.15.87:0/2283908212 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8b0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 -- 172.21.15.87:0/2283908212 shutdown_connections 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 --2- 172.21.15.87:0/2283908212 >> v2:172.21.15.87:3300/0 conn(0x7f021406f5b0 0x7f021406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 --2- 172.21.15.87:0/2283908212 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02140b3990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 -- 172.21.15.87:0/2283908212 >> 172.21.15.87:0/2283908212 conn(0x7f02140d13a0 msgr2=0x7f02140d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.912+0000 7f021b1e8640 1 -- 172.21.15.87:0/2283908212 shutdown_connections 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.913+0000 7f021b1e8640 1 -- 172.21.15.87:0/2283908212 wait complete. 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 Processor -- start 2024-04-16T15:35:23.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 -- start start 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 0x7f021414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02140d0090 con 0x7f021406f5b0 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f02140cfdb0 con 0x7f02140b0780 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.914+0000 7f021b1e8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f02140c6260 con 0x7f021415b6c0 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0219785640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53372/0 (socket says 172.21.15.87:53372) 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0219785640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41002/0 (socket says 172.21.15.87:41002) 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 -- 172.21.15.87:0/4039269882 learned_addr learned my addr 172.21.15.87:0/4039269882 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0218f84640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 0x7f021414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 -- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 msgr2=0x7f02141f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 -- 172.21.15.87:0/4039269882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 msgr2=0x7f021414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 0x7f021414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 -- 172.21.15.87:0/4039269882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021414c790 con 0x7f02140b0780 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0218f84640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 0x7f021414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0219785640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f0213fff640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f020000c440 tx=0x7f0200001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:23.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200017070 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0200005ce0 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021414ca70 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000072f0 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021414d030 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f020001a070 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.915+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f02000127b0 con 0x7f02140b0780 2024-04-16T15:35:23.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.916+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021414d370 con 0x7f02140b0780 2024-04-16T15:35:23.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.918+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0200021070 con 0x7f02140b0780 2024-04-16T15:35:23.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.991+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44b74c98-ef92-447a-adfc-713613923d1d", "id": 1} v 0) -- 0x7f0214069150 con 0x7f02140b0780 2024-04-16T15:35:23.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.999+0000 7f02117fa640 1 -- 172.21.15.87:0/4039269882 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44b74c98-ef92-447a-adfc-713613923d1d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f02140b3ed0 con 0x7f02140b0780 2024-04-16T15:35:23.997 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.999+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 msgr2=0x7f02140b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:23.999+0000 7f021b1e8640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f020000c440 tx=0x7f0200001e70 comp rx=0 tx=0).stop 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 shutdown_connections 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f021415b6c0 0x7f02141f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02140b0780 0x7f02140b4320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 --2- 172.21.15.87:0/4039269882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f021406f5b0 0x7f021414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 >> 172.21.15.87:0/4039269882 conn(0x7f02140d13a0 msgr2=0x7f02141519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 shutdown_connections 2024-04-16T15:35:23.999 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.000+0000 7f021b1e8640 1 -- 172.21.15.87:0/4039269882 wait complete. 2024-04-16T15:35:24.009 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 8f2f152c-fd74-41c3-972b-d30f44bae609 2 2024-04-16T15:35:24.076 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.078+0000 7fe41ae17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T15:35:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.114+0000 7f9afa02c640 1 Processor -- start 2024-04-16T15:35:24.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.114+0000 7f9afa02c640 1 -- start start 2024-04-16T15:35:24.113 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.114+0000 7fc49ea2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T15:35:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9afa02c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 0x7f9af415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9afa02c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9af415f770 0x7f9af406c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9afa02c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af41592b0 con 0x7f9af406ca40 2024-04-16T15:35:24.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9afa02c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9af406e800 con 0x7f9af415f770 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9afa02c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406d230 con 0x7f9af415ee50 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af3fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9af406ca40 0x7f9af406f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44180/0 (socket says 172.21.15.87:44180) 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 0x7f9af415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9af415f770 0x7f9af406c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af3fff640 1 -- 172.21.15.87:0/647809869 learned_addr learned my addr 172.21.15.87:0/647809869 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af2ffd640 1 -- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 msgr2=0x7f9af415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af2ffd640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 0x7f9af415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af2ffd640 1 -- 172.21.15.87:0/647809869 >> v1:172.21.15.87:6789/0 conn(0x7f9af406ca40 legacy=0x7f9af406f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af2ffd640 1 -- 172.21.15.87:0/647809869 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af406eaa0 con 0x7f9af415f770 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af27fc640 1 -- 172.21.15.87:0/647809869 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883526870 0 0) 0x7f9af41592b0 con 0x7f9af406ca40 2024-04-16T15:35:24.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.115+0000 7f9af37fe640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 0x7f9af415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:24.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.116+0000 7f9af2ffd640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415f770 0x7f9af406c500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40097a0 tx=0x7f9ae402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5dba76dd82f2c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.116+0000 7f9af27fc640 1 -- 172.21.15.87:0/647809869 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4034070 con 0x7f9af415f770 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.116+0000 7f9af27fc640 1 -- 172.21.15.87:0/647809869 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4030610 con 0x7f9af415f770 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.116+0000 7f9af27fc640 1 -- 172.21.15.87:0/647809869 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40309e0 con 0x7f9af415f770 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 -- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415f770 msgr2=0x7f9af406c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415f770 0x7f9af406c500 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40097a0 tx=0x7f9ae402b960 comp rx=0 tx=0).stop 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 -- 172.21.15.87:0/647809869 shutdown_connections 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415f770 0x7f9af406c500 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 --2- 172.21.15.87:0/647809869 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af415ee50 0x7f9af415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 -- 172.21.15.87:0/647809869 >> 172.21.15.87:0/647809869 conn(0x7f9af40d0c50 msgr2=0x7f9af40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 -- 172.21.15.87:0/647809869 shutdown_connections 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.117+0000 7f9afa02c640 1 -- 172.21.15.87:0/647809869 wait complete. 2024-04-16T15:35:24.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.118+0000 7f9afa02c640 1 Processor -- start 2024-04-16T15:35:24.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.118+0000 7f9afa02c640 1 -- start start 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415ee50 0x7f9af415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 0x7f9af40c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9af415fbd0 con 0x7f9af415f770 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406f060 con 0x7f9af415ee50 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9afa02c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406ceb0 con 0x7f9af406ca40 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41018/0 (socket says 172.21.15.87:41018) 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 -- 172.21.15.87:0/2595003695 learned_addr learned my addr 172.21.15.87:0/2595003695 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af2ffd640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415ee50 0x7f9af415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af3fff640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 0x7f9af40c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 -- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415ee50 msgr2=0x7f9af415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415ee50 0x7f9af415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 -- 172.21.15.87:0/2595003695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 msgr2=0x7f9af40c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 0x7f9af40c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af37fe640 1 -- 172.21.15.87:0/2595003695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40c69e0 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.119+0000 7f9af3fff640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 0x7f9af40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9af37fe640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800ec10 tx=0x7f9ae800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8017070 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae800cc30 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8013470 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af40c6cc0 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af40c7280 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ae801a070 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.120+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9ae801c910 con 0x7f9af406ca40 2024-04-16T15:35:24.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.121+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4069150 con 0x7f9af406ca40 2024-04-16T15:35:24.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.123+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9ae801c4f0 con 0x7f9af406ca40 2024-04-16T15:35:24.130 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.131+0000 7fe41ae17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T15:35:24.170 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.171+0000 7fc49ea2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T15:35:24.173 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.175+0000 7fe41ae17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T15:35:24.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.196+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8f2f152c-fd74-41c3-972b-d30f44bae609", "id": 2} v 0) -- 0x7f9af40b0200 con 0x7f9af406ca40 2024-04-16T15:35:24.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.201+0000 7f9adbfff640 1 -- 172.21.15.87:0/2595003695 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f2f152c-fd74-41c3-972b-d30f44bae609", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9ae801c6d0 con 0x7f9af406ca40 2024-04-16T15:35:24.200 INFO:teuthology.orchestra.run.smithi087.stdout:2 2024-04-16T15:35:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 msgr2=0x7f9af414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800ec10 tx=0x7f9ae800c520 comp rx=0 tx=0).stop 2024-04-16T15:35:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 shutdown_connections 2024-04-16T15:35:24.201 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9af415f770 0x7f9af40c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9af415ee50 0x7f9af415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 --2- 172.21.15.87:0/2595003695 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9af406ca40 0x7f9af414ccd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 >> 172.21.15.87:0/2595003695 conn(0x7f9af40d0c50 msgr2=0x7f9af40af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 shutdown_connections 2024-04-16T15:35:24.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.202+0000 7f9afa02c640 1 -- 172.21.15.87:0/2595003695 wait complete. 2024-04-16T15:35:24.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 57d01d0a-ca41-4695-87e9-7b94c4709fb6 3 2024-04-16T15:35:24.218 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.219+0000 7fc49ea2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T15:35:24.227 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.229+0000 7fe41ae17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T15:35:24.269 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.271+0000 7fe41ae17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T15:35:24.275 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.276+0000 7fc49ea2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T15:35:24.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.316+0000 7f52ed38f640 1 Processor -- start 2024-04-16T15:35:24.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.316+0000 7f52ed38f640 1 -- start start 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52ed38f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52e815b5e0 0x7f52e80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52ed38f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 0x7f52e80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52ed38f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e815bec0 con 0x7f52e815b9c0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52ed38f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f52e815cad0 con 0x7f52e815b5e0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52ed38f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80d0830 con 0x7f52e80b3bc0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52dffff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f52e815b9c0 0x7f52e80ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44192/0 (socket says 172.21.15.87:44192) 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52dffff640 1 -- 172.21.15.87:0/2791191069 learned_addr learned my addr 172.21.15.87:0/2791191069 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e77fe640 1 --2- 172.21.15.87:0/2791191069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 0x7f52e80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e6ffd640 1 --2- 172.21.15.87:0/2791191069 >> v2:172.21.15.80:3300/0 conn(0x7f52e815b5e0 0x7f52e80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e67fc640 1 -- 172.21.15.87:0/2791191069 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680242535 0 0) 0x7f52e815bec0 con 0x7f52e815b9c0 2024-04-16T15:35:24.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e67fc640 1 -- 172.21.15.87:0/2791191069 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d4003520 con 0x7f52e815b9c0 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e77fe640 1 -- 172.21.15.87:0/2791191069 >> v2:172.21.15.80:3300/0 conn(0x7f52e815b5e0 msgr2=0x7f52e80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e77fe640 1 --2- 172.21.15.87:0/2791191069 >> v2:172.21.15.80:3300/0 conn(0x7f52e815b5e0 0x7f52e80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e77fe640 1 -- 172.21.15.87:0/2791191069 >> v1:172.21.15.87:6789/0 conn(0x7f52e815b9c0 legacy=0x7f52e80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.318+0000 7f52e77fe640 1 -- 172.21.15.87:0/2791191069 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e815c1a0 con 0x7f52e80b3bc0 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.319+0000 7f52e77fe640 1 --2- 172.21.15.87:0/2791191069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 0x7f52e80b4050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009d90 tx=0x7f52e002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8535f79e1f51c1db server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.319+0000 7f52e67fc640 1 -- 172.21.15.87:0/2791191069 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0039070 con 0x7f52e80b3bc0 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.319+0000 7f52e67fc640 1 -- 172.21.15.87:0/2791191069 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e002cb30 con 0x7f52e80b3bc0 2024-04-16T15:35:24.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.319+0000 7f52e67fc640 1 -- 172.21.15.87:0/2791191069 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0034440 con 0x7f52e80b3bc0 2024-04-16T15:35:24.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 -- 172.21.15.87:0/2791191069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 msgr2=0x7f52e80b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 --2- 172.21.15.87:0/2791191069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 0x7f52e80b4050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009d90 tx=0x7f52e002bd80 comp rx=0 tx=0).stop 2024-04-16T15:35:24.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 -- 172.21.15.87:0/2791191069 shutdown_connections 2024-04-16T15:35:24.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 --2- 172.21.15.87:0/2791191069 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e80b3bc0 0x7f52e80b4050 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 --2- 172.21.15.87:0/2791191069 >> v2:172.21.15.80:3300/0 conn(0x7f52e815b5e0 0x7f52e80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 -- 172.21.15.87:0/2791191069 >> 172.21.15.87:0/2791191069 conn(0x7f52e80d0c50 msgr2=0x7f52e80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 -- 172.21.15.87:0/2791191069 shutdown_connections 2024-04-16T15:35:24.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.320+0000 7f52ed38f640 1 -- 172.21.15.87:0/2791191069 wait complete. 2024-04-16T15:35:24.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.321+0000 7f52ed38f640 1 Processor -- start 2024-04-16T15:35:24.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.321+0000 7f52ed38f640 1 -- start start 2024-04-16T15:35:24.322 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.322+0000 7fc49ea2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T15:35:24.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 0x7f52e80acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52e815b9c0 0x7f52e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80b48f0 con 0x7f52e815b9c0 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52e815c760 con 0x7f52e80b3bc0 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52ed38f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80b5250 con 0x7f52e815b5e0 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52dffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 0x7f52e80acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53394/0 (socket says 172.21.15.87:53394) 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52dffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 0x7f52e80acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41042/0 (socket says 172.21.15.87:41042) 2024-04-16T15:35:24.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 -- 172.21.15.87:0/3721220353 learned_addr learned my addr 172.21.15.87:0/3721220353 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e77fe640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52e815b9c0 0x7f52e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 -- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 msgr2=0x7f52e80acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 0x7f52e80acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 -- 172.21.15.87:0/3721220353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52e815b9c0 msgr2=0x7f52e806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52e815b9c0 0x7f52e806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 -- 172.21.15.87:0/3721220353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80ad8a0 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.322+0000 7f52e6ffd640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e9e0 tx=0x7f52d800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8017070 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d800c9d0 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e80adb80 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d800cdc0 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e80ae140 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52d801a070 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.323+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f52d8006660 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.324+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8069150 con 0x7f52e80b3bc0 2024-04-16T15:35:24.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.326+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f52d8006020 con 0x7f52e80b3bc0 2024-04-16T15:35:24.385 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.387+0000 7fe41ae17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T15:35:24.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.399+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "57d01d0a-ca41-4695-87e9-7b94c4709fb6", "id": 3} v 0) -- 0x7f52e8067910 con 0x7f52e80b3bc0 2024-04-16T15:35:24.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.404+0000 7f52df7fe640 1 -- 172.21.15.87:0/3721220353 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57d01d0a-ca41-4695-87e9-7b94c4709fb6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f52d8005990 con 0x7f52e80b3bc0 2024-04-16T15:35:24.404 INFO:teuthology.orchestra.run.smithi087.stdout:3 2024-04-16T15:35:24.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 msgr2=0x7f52e814f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52d800e9e0 tx=0x7f52d800eea0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 shutdown_connections 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52e815b9c0 0x7f52e806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52e815b5e0 0x7f52e80acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 --2- 172.21.15.87:0/3721220353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52e80b3bc0 0x7f52e814f500 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 >> 172.21.15.87:0/3721220353 conn(0x7f52e80d0c50 msgr2=0x7f52e815ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 shutdown_connections 2024-04-16T15:35:24.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.405+0000 7f52ed38f640 1 -- 172.21.15.87:0/3721220353 wait complete. 2024-04-16T15:35:24.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 764f41d4-e1b1-4c9c-84d5-9f002b27341c 4 2024-04-16T15:35:24.444 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.445+0000 7fc49ea2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T15:35:24.454 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.456+0000 7fe41ae17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T15:35:24.499 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.501+0000 7fe41ae17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T15:35:24.518 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.519+0000 7fc49ea2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T15:35:24.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.548+0000 7f1481d9d640 1 Processor -- start 2024-04-16T15:35:24.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.548+0000 7f1481d9d640 1 -- start start 2024-04-16T15:35:24.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1481d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1481d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f147c0d0120 0x7f147c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1481d9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147c0cdd10 con 0x7f147c09afb0 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1481d9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0cdff0 con 0x7f147c0d0120 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1481d9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f147c0ce2d0 con 0x7f147c15fee0 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41048/0 (socket says 172.21.15.87:41048) 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f147b7fe640 1 -- 172.21.15.87:0/1730959249 learned_addr learned my addr 172.21.15.87:0/1730959249 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.549+0000 7f1473fff640 1 --2- 172.21.15.87:0/1730959249 >> v2:172.21.15.80:3300/0 conn(0x7f147c0d0120 0x7f147c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147b7fe640 1 -- 172.21.15.87:0/1730959249 >> v2:172.21.15.80:3300/0 conn(0x7f147c0d0120 msgr2=0x7f147c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147b7fe640 1 --2- 172.21.15.87:0/1730959249 >> v2:172.21.15.80:3300/0 conn(0x7f147c0d0120 0x7f147c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147b7fe640 1 -- 172.21.15.87:0/1730959249 >> v1:172.21.15.80:6789/0 conn(0x7f147c09afb0 legacy=0x7f147c0d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147b7fe640 1 -- 172.21.15.87:0/1730959249 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c09bc00 con 0x7f147c15fee0 2024-04-16T15:35:24.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147b7fe640 1 --2- 172.21.15.87:0/1730959249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f146c009870 tx=0x7f146c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7acc1a09f05636b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.550+0000 7f147affd640 1 -- 172.21.15.87:0/1730959249 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c034070 con 0x7f147c15fee0 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f147affd640 1 -- 172.21.15.87:0/1730959249 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c030840 con 0x7f147c15fee0 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f147affd640 1 -- 172.21.15.87:0/1730959249 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c030c10 con 0x7f147c15fee0 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 -- 172.21.15.87:0/1730959249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 msgr2=0x7f147c09b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 --2- 172.21.15.87:0/1730959249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f146c009870 tx=0x7f146c02b980 comp rx=0 tx=0).stop 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 -- 172.21.15.87:0/1730959249 shutdown_connections 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 --2- 172.21.15.87:0/1730959249 >> v2:172.21.15.80:3300/0 conn(0x7f147c0d0120 0x7f147c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 --2- 172.21.15.87:0/1730959249 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c09b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 -- 172.21.15.87:0/1730959249 >> 172.21.15.87:0/1730959249 conn(0x7f147c0b4040 msgr2=0x7f147c0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 -- 172.21.15.87:0/1730959249 shutdown_connections 2024-04-16T15:35:24.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.551+0000 7f1481d9d640 1 -- 172.21.15.87:0/1730959249 wait complete. 2024-04-16T15:35:24.552 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.553+0000 7fe41ae17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.552+0000 7f1481d9d640 1 Processor -- start 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.552+0000 7f1481d9d640 1 -- start start 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f147c09afb0 0x7f147c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f147c0d0120 0x7f147c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0d0ce0 con 0x7f147c09afb0 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0c7710 con 0x7f147c0d0120 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1481d9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f147c0d0e60 con 0x7f147c15fee0 2024-04-16T15:35:24.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41064/0 (socket says 172.21.15.87:41064) 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 -- 172.21.15.87:0/3153887347 learned_addr learned my addr 172.21.15.87:0/3153887347 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f1473fff640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f147c0d0120 0x7f147c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147b7fe640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f147c09afb0 0x7f147c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 -- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f147c0d0120 msgr2=0x7f147c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f147c0d0120 0x7f147c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 -- 172.21.15.87:0/3153887347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f147c09afb0 msgr2=0x7f147c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f147c09afb0 0x7f147c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.553+0000 7f147bfff640 1 -- 172.21.15.87:0/3153887347 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c151010 con 0x7f147c15fee0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f147bfff640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f147400c7d0 tx=0x7f147400cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474003b70 con 0x7f147c15fee0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1474003d30 con 0x7f147c15fee0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c0ca510 con 0x7f147c15fee0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400aa90 con 0x7f147c15fee0 2024-04-16T15:35:24.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c0caad0 con 0x7f147c15fee0 2024-04-16T15:35:24.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f147400ac30 con 0x7f147c15fee0 2024-04-16T15:35:24.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.554+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1474012b60 con 0x7f147c15fee0 2024-04-16T15:35:24.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.555+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c069150 con 0x7f147c15fee0 2024-04-16T15:35:24.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.557+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1474012db0 con 0x7f147c15fee0 2024-04-16T15:35:24.567 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.569+0000 7fc49ea2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T15:35:24.598 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.599+0000 7fe41ae17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T15:35:24.622 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.623+0000 7fc49ea2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T15:35:24.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.630+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd new", "uuid": "764f41d4-e1b1-4c9c-84d5-9f002b27341c", "id": 4} v 0) -- 0x7f147c0708a0 con 0x7f147c15fee0 2024-04-16T15:35:24.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.635+0000 7f1478ff9640 1 -- 172.21.15.87:0/3153887347 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "764f41d4-e1b1-4c9c-84d5-9f002b27341c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1474012650 con 0x7f147c15fee0 2024-04-16T15:35:24.634 INFO:teuthology.orchestra.run.smithi087.stdout:4 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 msgr2=0x7f147c15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f147400c7d0 tx=0x7f147400cc90 comp rx=0 tx=0).stop 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 shutdown_connections 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f147c15fee0 0x7f147c15ecb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f147c0d0120 0x7f147c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 --2- 172.21.15.87:0/3153887347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f147c09afb0 0x7f147c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 >> 172.21.15.87:0/3153887347 conn(0x7f147c0b4040 msgr2=0x7f147c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 shutdown_connections 2024-04-16T15:35:24.635 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.636+0000 7f1481d9d640 1 -- 172.21.15.87:0/3153887347 wait complete. 2024-04-16T15:35:24.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 0a487996-d362-45af-83e0-40c900f63f91 5 2024-04-16T15:35:24.672 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:24.674+0000 7fc49ea2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T15:35:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.749+0000 7f72d659d640 1 Processor -- start 2024-04-16T15:35:24.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.749+0000 7f72d659d640 1 -- start start 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.750+0000 7f72d659d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.750+0000 7f72d659d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.750+0000 7f72d659d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d00b3ed0 con 0x7f72d006f5b0 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.750+0000 7f72d659d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f72d00d0400 con 0x7f72d00b0780 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.750+0000 7f72d659d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00cf550 con 0x7f72d015b6c0 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41076/0 (socket says 172.21.15.87:41076) 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72d4b3a640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f72d006f5b0 0x7f72d00c6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44198/0 (socket says 172.21.15.87:44198) 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 -- 172.21.15.87:0/2092880930 learned_addr learned my addr 172.21.15.87:0/2092880930 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cf7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53416/0 (socket says 172.21.15.87:53416) 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 -- 172.21.15.87:0/2092880930 >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 msgr2=0x7f72d00d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:24.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 --2- 172.21.15.87:0/2092880930 >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 -- 172.21.15.87:0/2092880930 >> v1:172.21.15.87:6789/0 conn(0x7f72d006f5b0 legacy=0x7f72d00c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cffff640 1 -- 172.21.15.87:0/2092880930 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00cf7f0 con 0x7f72d015b6c0 2024-04-16T15:35:24.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.751+0000 7f72cf7fe640 1 --2- 172.21.15.87:0/2092880930 >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72cffff640 1 --2- 172.21.15.87:0/2092880930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d4585f589a6bfbc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72ceffd640 1 -- 172.21.15.87:0/2092880930 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0034070 con 0x7f72d015b6c0 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72ceffd640 1 -- 172.21.15.87:0/2092880930 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c0030840 con 0x7f72d015b6c0 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72ceffd640 1 -- 172.21.15.87:0/2092880930 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0030c10 con 0x7f72d015b6c0 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 -- 172.21.15.87:0/2092880930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 msgr2=0x7f72d00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 --2- 172.21.15.87:0/2092880930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002b980 comp rx=0 tx=0).stop 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 -- 172.21.15.87:0/2092880930 shutdown_connections 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 --2- 172.21.15.87:0/2092880930 >> v2:172.21.15.87:3300/0 conn(0x7f72d00b0780 0x7f72d00d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 --2- 172.21.15.87:0/2092880930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00b3990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.752+0000 7f72d659d640 1 -- 172.21.15.87:0/2092880930 >> 172.21.15.87:0/2092880930 conn(0x7f72d00d13a0 msgr2=0x7f72d00d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.753+0000 7f72d659d640 1 -- 172.21.15.87:0/2092880930 shutdown_connections 2024-04-16T15:35:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.753+0000 7f72d659d640 1 -- 172.21.15.87:0/2092880930 wait complete. 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.754+0000 7f72d659d640 1 Processor -- start 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.754+0000 7f72d659d640 1 -- start start 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 0x7f72d00b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00d0090 con 0x7f72d00b0780 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00cfdb0 con 0x7f72d006f5b0 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00d0dd0 con 0x7f72d015b6c0 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53420/0 (socket says 172.21.15.87:53420) 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 -- 172.21.15.87:0/299044673 learned_addr learned my addr 172.21.15.87:0/299044673 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d4b3a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cf7fe640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 0x7f72d00b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 -- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 msgr2=0x7f72d00ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 -- 172.21.15.87:0/299044673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 msgr2=0x7f72d00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 0x7f72d00b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 -- 172.21.15.87:0/299044673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d0151910 con 0x7f72d006f5b0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d4b3a640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cf7fe640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 0x7f72d00b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72cffff640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0034040 con 0x7f72d006f5b0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c002f5a0 con 0x7f72d006f5b0 2024-04-16T15:35:24.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c002f970 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.755+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d0151bf0 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.756+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d01521b0 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.756+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72c004c060 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.756+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f72c0045970 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.757+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d0069150 con 0x7f72d006f5b0 2024-04-16T15:35:24.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.759+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f72c0064e50 con 0x7f72d006f5b0 2024-04-16T15:35:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.831+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0a487996-d362-45af-83e0-40c900f63f91", "id": 5} v 0) -- 0x7f72d00b3ad0 con 0x7f72d006f5b0 2024-04-16T15:35:24.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.836+0000 7f72ccff9640 1 -- 172.21.15.87:0/299044673 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a487996-d362-45af-83e0-40c900f63f91", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f72c0053030 con 0x7f72d006f5b0 2024-04-16T15:35:24.835 INFO:teuthology.orchestra.run.smithi087.stdout:5 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 msgr2=0x7f72d01512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c00046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 shutdown_connections 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f72d015b6c0 0x7f72d00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72d00b0780 0x7f72d00b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 --2- 172.21.15.87:0/299044673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d006f5b0 0x7f72d01512a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 >> 172.21.15.87:0/299044673 conn(0x7f72d00d13a0 msgr2=0x7f72d00b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 shutdown_connections 2024-04-16T15:35:24.837 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.837+0000 7f72d659d640 1 -- 172.21.15.87:0/299044673 wait complete. 2024-04-16T15:35:24.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 3b3bf0fd-3800-4f62-9a67-de26c81819a2 6 2024-04-16T15:35:24.970 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:24.972+0000 7fe41ae17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T15:35:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.993+0000 7f2e2e1a8640 1 Processor -- start 2024-04-16T15:35:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 -- start start 2024-04-16T15:35:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e28161f20 0x7f2e280cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e280b74e0 0x7f2e280cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e280cfd90 con 0x7f2e280d0ff0 2024-04-16T15:35:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2e280d0050 con 0x7f2e280b74e0 2024-04-16T15:35:24.995 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e2e1a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2e280d0330 con 0x7f2e28161f20 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e277fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e28161f20 0x7f2e280cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.994+0000 7f2e277fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2e28161f20 0x7f2e280cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53430/0 (socket says 172.21.15.87:53430) 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e277fe640 1 -- 172.21.15.87:0/1071009500 learned_addr learned my addr 172.21.15.87:0/1071009500 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e26ffd640 1 --2- 172.21.15.87:0/1071009500 >> v2:172.21.15.80:3300/0 conn(0x7f2e280b74e0 0x7f2e280cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e277fe640 1 -- 172.21.15.87:0/1071009500 >> v2:172.21.15.80:3300/0 conn(0x7f2e280b74e0 msgr2=0x7f2e280cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e277fe640 1 --2- 172.21.15.87:0/1071009500 >> v2:172.21.15.80:3300/0 conn(0x7f2e280b74e0 0x7f2e280cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e277fe640 1 -- 172.21.15.87:0/1071009500 >> v1:172.21.15.80:6789/0 conn(0x7f2e280d0ff0 legacy=0x7f2e280d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.995+0000 7f2e277fe640 1 -- 172.21.15.87:0/1071009500 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e280d0610 con 0x7f2e28161f20 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e277fe640 1 --2- 172.21.15.87:0/1071009500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e28161f20 0x7f2e280cf230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e2808cee0 tx=0x7f2e1802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8752e50c895a0d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e267fc640 1 -- 172.21.15.87:0/1071009500 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18034070 con 0x7f2e28161f20 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e267fc640 1 -- 172.21.15.87:0/1071009500 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18030860 con 0x7f2e28161f20 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e267fc640 1 -- 172.21.15.87:0/1071009500 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18030c30 con 0x7f2e28161f20 2024-04-16T15:35:24.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1071009500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e28161f20 msgr2=0x7f2e280cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1071009500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e28161f20 0x7f2e280cf230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2e2808cee0 tx=0x7f2e1802b9a0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1071009500 shutdown_connections 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1071009500 >> v2:172.21.15.80:3300/0 conn(0x7f2e280b74e0 0x7f2e280cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1071009500 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e28161f20 0x7f2e280cf230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1071009500 >> 172.21.15.87:0/1071009500 conn(0x7f2e2808c000 msgr2=0x7f2e280d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1071009500 shutdown_connections 2024-04-16T15:35:24.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.996+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1071009500 wait complete. 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.997+0000 7f2e2e1a8640 1 Processor -- start 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 -- start start 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 0x7f2e2815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e28161f20 0x7f2e2815e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e280d1460 con 0x7f2e28161f20 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e280b5730 con 0x7f2e280d0ff0 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.998+0000 7f2e2e1a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2e280d15e0 con 0x7f2e280b74e0 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e277fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 0x7f2e2815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e277fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.87:41094/0 (socket says 172.21.15.87:41094) 2024-04-16T15:35:25.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e277fe640 1 -- 172.21.15.87:0/1777725601 learned_addr learned my addr 172.21.15.87:0/1777725601 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e27fff640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e28161f20 0x7f2e2815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 -- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 msgr2=0x7f2e28153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 -- 172.21.15.87:0/1777725601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e28161f20 msgr2=0x7f2e2815e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e28161f20 0x7f2e2815e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 -- 172.21.15.87:0/1777725601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e281575a0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e277fe640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e26ffd640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 0x7f2e2815e460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00d5f0 tx=0x7f2e1c00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0125f0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c019070 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e280c9100 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0129d0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e280c96c0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e1c012b70 con 0x7f2e280d0ff0 2024-04-16T15:35:25.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:24.999+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2e1c014ab0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.000+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e28068a40 con 0x7f2e280d0ff0 2024-04-16T15:35:25.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.004+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2e281575a0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.074 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.076+0000 7fc49ea2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T15:35:25.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.077+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b3bf0fd-3800-4f62-9a67-de26c81819a2", "id": 6} v 0) -- 0x7f2e280d1d10 con 0x7f2e280d0ff0 2024-04-16T15:35:25.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.083+0000 7f2e0ffff640 1 -- 172.21.15.87:0/1777725601 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b3bf0fd-3800-4f62-9a67-de26c81819a2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2e1c014dd0 con 0x7f2e280d0ff0 2024-04-16T15:35:25.082 INFO:teuthology.orchestra.run.smithi087.stdout:6 2024-04-16T15:35:25.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 msgr2=0x7f2e2815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 0x7f2e2815e460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00d5f0 tx=0x7f2e1c00dab0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 shutdown_connections 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2e28161f20 0x7f2e2815e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e280d0ff0 0x7f2e2815e460 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 --2- 172.21.15.87:0/1777725601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e280b74e0 0x7f2e28153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.084+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 >> 172.21.15.87:0/1777725601 conn(0x7f2e2808c000 msgr2=0x7f2e280b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.085+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 shutdown_connections 2024-04-16T15:35:25.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.085+0000 7f2e2e1a8640 1 -- 172.21.15.87:0/1777725601 wait complete. 2024-04-16T15:35:25.094 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35 7 2024-04-16T15:35:25.105 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.106+0000 7fe41ae17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T15:35:25.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.197+0000 7f0286146640 1 Processor -- start 2024-04-16T15:35:25.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.197+0000 7f0286146640 1 -- start start 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0286146640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02800d0120 0x7f028009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0286146640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 0x7f02800c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0286146640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02800cdd10 con 0x7f028015fee0 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0286146640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f028009bdd0 con 0x7f028009afb0 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0286146640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f028009b420 con 0x7f02800d0120 2024-04-16T15:35:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02800d0120 0x7f028009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02800d0120 0x7f028009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53452/0 (socket says 172.21.15.87:53452) 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 -- 172.21.15.87:0/931097359 learned_addr learned my addr 172.21.15.87:0/931097359 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f027ffff640 1 --2- 172.21.15.87:0/931097359 >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 0x7f02800c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 -- 172.21.15.87:0/931097359 >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 msgr2=0x7f02800c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 --2- 172.21.15.87:0/931097359 >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 0x7f02800c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.198+0000 7f0276ffd640 1 -- 172.21.15.87:0/931097359 >> v1:172.21.15.80:6789/0 conn(0x7f028015fee0 legacy=0x7f028009b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f0276ffd640 1 -- 172.21.15.87:0/931097359 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02800cdff0 con 0x7f02800d0120 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f027ffff640 1 --2- 172.21.15.87:0/931097359 >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 0x7f02800c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f0276ffd640 1 --2- 172.21.15.87:0/931097359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02800d0120 0x7f028009aa70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02800a05d0 tx=0x7f026802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a015e531fa9f4634 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f027effd640 1 -- 172.21.15.87:0/931097359 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268034070 con 0x7f02800d0120 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f027effd640 1 -- 172.21.15.87:0/931097359 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0268030860 con 0x7f02800d0120 2024-04-16T15:35:25.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.199+0000 7f027effd640 1 -- 172.21.15.87:0/931097359 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268030c30 con 0x7f02800d0120 2024-04-16T15:35:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 -- 172.21.15.87:0/931097359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02800d0120 msgr2=0x7f028009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 --2- 172.21.15.87:0/931097359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02800d0120 0x7f028009aa70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02800a05d0 tx=0x7f026802b9a0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 -- 172.21.15.87:0/931097359 shutdown_connections 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 --2- 172.21.15.87:0/931097359 >> v2:172.21.15.80:3300/0 conn(0x7f028009afb0 0x7f02800c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 --2- 172.21.15.87:0/931097359 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02800d0120 0x7f028009aa70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 -- 172.21.15.87:0/931097359 >> 172.21.15.87:0/931097359 conn(0x7f02800b4040 msgr2=0x7f02800b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 -- 172.21.15.87:0/931097359 shutdown_connections 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.200+0000 7f0286146640 1 -- 172.21.15.87:0/931097359 wait complete. 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.201+0000 7f0286146640 1 Processor -- start 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 -- start start 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 0x7f0280070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f028015fee0 0x7f02800afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f02800c6bb0 con 0x7f02800d0120 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f02800c6a30 con 0x7f028009afb0 2024-04-16T15:35:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0286146640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f02800c6d30 con 0x7f028015fee0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f027f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f027f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53458/0 (socket says 172.21.15.87:53458) 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f027f7fe640 1 -- 172.21.15.87:0/877263378 learned_addr learned my addr 172.21.15.87:0/877263378 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f0276ffd640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 0x7f0280070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.202+0000 7f027ffff640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f028015fee0 0x7f02800afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 -- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f028015fee0 msgr2=0x7f02800afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f028015fee0 0x7f02800afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 -- 172.21.15.87:0/877263378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 msgr2=0x7f0280070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 0x7f0280070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 -- 172.21.15.87:0/877263378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02801f64c0 con 0x7f028009afb0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f0276ffd640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 0x7f0280070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027f7fe640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f027000c3f0 tx=0x7f027000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02700052d0 con 0x7f028009afb0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0270005490 con 0x7f028009afb0 2024-04-16T15:35:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270007260 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801f6a80 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.203+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0280152fe0 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.204+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0270007400 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.204+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0270011bf0 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.204+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0280069150 con 0x7f028009afb0 2024-04-16T15:35:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.206+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f02700035f0 con 0x7f028009afb0 2024-04-16T15:35:25.219 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.220+0000 7fc49ea2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T15:35:25.223 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.225+0000 7fe41ae17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T15:35:25.268 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.270+0000 7fe41ae17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T15:35:25.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.279+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35", "id": 7} v 0) -- 0x7f02800b83e0 con 0x7f028009afb0 2024-04-16T15:35:25.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.287+0000 7f027cff9640 1 -- 172.21.15.87:0/877263378 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f0270003a00 con 0x7f028009afb0 2024-04-16T15:35:25.286 INFO:teuthology.orchestra.run.smithi087.stdout:7 2024-04-16T15:35:25.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 msgr2=0x7f02800af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f027000c3f0 tx=0x7f027000c8b0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 shutdown_connections 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f028015fee0 0x7f02800afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02800d0120 0x7f0280070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 --2- 172.21.15.87:0/877263378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f028009afb0 0x7f02800af280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 >> 172.21.15.87:0/877263378 conn(0x7f02800b4040 msgr2=0x7f02800cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 shutdown_connections 2024-04-16T15:35:25.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:35:25.288+0000 7f0286146640 1 -- 172.21.15.87:0/877263378 wait complete. 2024-04-16T15:35:25.297 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T15:35:25.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T15:35:25.300 INFO:tasks.ceph.osd.0:Started 2024-04-16T15:35:25.300 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T15:35:25.300 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T15:35:25.302 INFO:tasks.ceph.osd.1:Started 2024-04-16T15:35:25.302 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T15:35:25.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T15:35:25.304 INFO:tasks.ceph.osd.2:Started 2024-04-16T15:35:25.304 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T15:35:25.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T15:35:25.306 INFO:tasks.ceph.osd.3:Started 2024-04-16T15:35:25.306 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T15:35:25.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T15:35:25.309 INFO:tasks.ceph.osd.4:Started 2024-04-16T15:35:25.309 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T15:35:25.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T15:35:25.311 INFO:tasks.ceph.osd.5:Started 2024-04-16T15:35:25.311 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T15:35:25.311 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T15:35:25.313 INFO:tasks.ceph.osd.6:Started 2024-04-16T15:35:25.313 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T15:35:25.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T15:35:25.318 INFO:tasks.ceph.osd.7:Started 2024-04-16T15:35:25.318 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:25.335 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.336+0000 7fc49ea2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T15:35:25.387 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.388+0000 7fc49ea2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T15:35:25.420 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.422+0000 7fe41ae17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:35:25.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.441+0000 7f01225a8640 1 Processor -- start 2024-04-16T15:35:25.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.441+0000 7f01225a8640 1 -- start start 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f01225a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f011c15ecf0 0x7f011c0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f01225a8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011c0af990 0x7f011c0d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f01225a8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c06b9a0 con 0x7f011c0b07f0 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f01225a8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f011c0b31a0 con 0x7f011c0af990 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f01225a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f011c0d1310 con 0x7f011c15ecf0 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f0120b45640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011c0af990 0x7f011c0d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f0120b45640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f011c0af990 0x7f011c0d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50186/0 (socket says 172.21.15.80:50186) 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f0120b45640 1 -- 172.21.15.80:0/2462650695 learned_addr learned my addr 172.21.15.80:0/2462650695 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.442+0000 7f011bfff640 1 --2- 172.21.15.80:0/2462650695 >> v2:172.21.15.87:3300/0 conn(0x7f011c15ecf0 0x7f011c0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f0120b45640 1 -- 172.21.15.80:0/2462650695 >> v2:172.21.15.87:3300/0 conn(0x7f011c15ecf0 msgr2=0x7f011c0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:25.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f011affd640 1 -- 172.21.15.80:0/2462650695 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788841007 0 0) 0x7f011c06b9a0 con 0x7f011c0b07f0 2024-04-16T15:35:25.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f0120b45640 1 --2- 172.21.15.80:0/2462650695 >> v2:172.21.15.87:3300/0 conn(0x7f011c15ecf0 0x7f011c0d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f0120b45640 1 -- 172.21.15.80:0/2462650695 >> v1:172.21.15.87:6789/0 conn(0x7f011c0b07f0 legacy=0x7f011c0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f0120b45640 1 -- 172.21.15.80:0/2462650695 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c06bc80 con 0x7f011c0af990 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.443+0000 7f0120b45640 1 --2- 172.21.15.80:0/2462650695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c0d0dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f011c071b00 tx=0x7f011402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbe44434bf0c2bf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f011affd640 1 -- 172.21.15.80:0/2462650695 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011402ca80 con 0x7f011c0af990 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f011affd640 1 -- 172.21.15.80:0/2462650695 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011402cc20 con 0x7f011c0af990 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f011affd640 1 -- 172.21.15.80:0/2462650695 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01140343f0 con 0x7f011c0af990 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 -- 172.21.15.80:0/2462650695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 msgr2=0x7f011c0d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 --2- 172.21.15.80:0/2462650695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c0d0dd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f011c071b00 tx=0x7f011402bee0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 -- 172.21.15.80:0/2462650695 shutdown_connections 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 --2- 172.21.15.80:0/2462650695 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c0d0dd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 --2- 172.21.15.80:0/2462650695 >> v2:172.21.15.87:3300/0 conn(0x7f011c15ecf0 0x7f011c0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 -- 172.21.15.80:0/2462650695 >> 172.21.15.80:0/2462650695 conn(0x7f011c09aa70 msgr2=0x7f011c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 -- 172.21.15.80:0/2462650695 shutdown_connections 2024-04-16T15:35:25.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.444+0000 7f01225a8640 1 -- 172.21.15.80:0/2462650695 wait complete. 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.445+0000 7f01225a8640 1 Processor -- start 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 -- start start 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 0x7f011c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 0x7f011c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f011c06c520 con 0x7f011c0af990 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f011c06c240 con 0x7f011c15ecf0 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.446+0000 7f01225a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f011c0b1550 con 0x7f011c0b07f0 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50196/0 (socket says 172.21.15.80:50196) 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011bfff640 1 -- 172.21.15.80:0/677886662 learned_addr learned my addr 172.21.15.80:0/677886662 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 0x7f011c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011b7fe640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 0x7f011c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 -- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 msgr2=0x7f011c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 0x7f011c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 -- 172.21.15.80:0/677886662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 msgr2=0x7f011c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 -- 172.21.15.80:0/677886662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c15b6b0 con 0x7f011c15ecf0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011b7fe640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 0x7f011c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f011bfff640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0120b45640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 0x7f011c15c450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0114032000 tx=0x7f0114004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114043070 con 0x7f011c15ecf0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0114003990 con 0x7f011c15ecf0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114009510 con 0x7f011c15ecf0 2024-04-16T15:35:25.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c0ccc70 con 0x7f011c15ecf0 2024-04-16T15:35:25.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.447+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c15b970 con 0x7f011c15ecf0 2024-04-16T15:35:25.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.448+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0114004030 con 0x7f011c15ecf0 2024-04-16T15:35:25.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.448+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f011402ca90 con 0x7f011c15ecf0 2024-04-16T15:35:25.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.448+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011c069150 con 0x7f011c15ecf0 2024-04-16T15:35:25.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.451+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f011404d020 con 0x7f011c15ecf0 2024-04-16T15:35:25.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.510+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f011c0d10f0 con 0x7f011c15ecf0 2024-04-16T15:35:25.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.511+0000 7f0118ff9640 1 -- 172.21.15.80:0/677886662 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f011c15b6b0 con 0x7f011c15ecf0 2024-04-16T15:35:25.509 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:25.509 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":10,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:25.281053+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:25.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 msgr2=0x7f011c15c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:25.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 0x7f011c15c450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0114032000 tx=0x7f0114004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:25.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 shutdown_connections 2024-04-16T15:35:25.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f011c15ecf0 0x7f011c15c450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f011c0b07f0 0x7f011c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 --2- 172.21.15.80:0/677886662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f011c0af990 0x7f011c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:25.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 >> 172.21.15.80:0/677886662 conn(0x7f011c09aa70 msgr2=0x7f011c0d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:25.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 shutdown_connections 2024-04-16T15:35:25.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:25.512+0000 7f01225a8640 1 -- 172.21.15.80:0/677886662 wait complete. 2024-04-16T15:35:25.516 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.517+0000 7fc49ea2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:35:25.520 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.522+0000 7fe41ae17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T15:35:25.521 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T15:35:25.521 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T15:35:25.611 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.612+0000 7fc49ea2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T15:35:25.676 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.677+0000 7fe41ae17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:35:25.719 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.721+0000 7fe41ae17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T15:35:25.766 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.768+0000 7fc49ea2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T15:35:25.808 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.810+0000 7fc49ea2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T15:35:25.872 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:25.873+0000 7fe41ae17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T15:35:25.912 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-04-16T15:35:25.913+0000 7f010160d640 -1 Falling back to public interface 2024-04-16T15:35:25.916 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-04-16T15:35:25.917+0000 7f0b8ca22640 -1 Falling back to public interface 2024-04-16T15:35:25.918 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-16T15:35:25.920+0000 7f54e0c1b640 -1 Falling back to public interface 2024-04-16T15:35:25.927 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-16T15:35:25.928+0000 7f06a990f640 -1 Falling back to public interface 2024-04-16T15:35:25.927 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-16T15:35:25.929+0000 7f8aa1013640 -1 Falling back to public interface 2024-04-16T15:35:25.930 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-16T15:35:25.932+0000 7f1aa1519640 -1 Falling back to public interface 2024-04-16T15:35:25.937 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-04-16T15:35:25.938+0000 7f761fe8b640 -1 Falling back to public interface 2024-04-16T15:35:25.950 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-04-16T15:35:25.951+0000 7f23398b3640 -1 Falling back to public interface 2024-04-16T15:35:25.970 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:25.971+0000 7fc49ea2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T15:35:26.327 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:26.419 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.421+0000 7fc20127b640 1 Processor -- start 2024-04-16T15:35:26.420 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.421+0000 7fc20127b640 1 -- start start 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc20127b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1fc0b16f0 0x7fc1fc070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc20127b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1fc0d0c00 con 0x7fc1fc0d0720 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc20127b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1fc0d0ee0 con 0x7fc1fc09b130 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc20127b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc1fc0d11c0 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1fc0b16f0 0x7fc1fc070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc1fc0b16f0 0x7fc1fc070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50210/0 (socket says 172.21.15.80:50210) 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 -- 172.21.15.80:0/517609116 learned_addr learned my addr 172.21.15.80:0/517609116 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 -- 172.21.15.80:0/517609116 >> v1:172.21.15.87:6789/0 conn(0x7fc1fc09b130 legacy=0x7fc1fc15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 -- 172.21.15.80:0/517609116 >> v1:172.21.15.80:6789/0 conn(0x7fc1fc0d0720 legacy=0x7fc1fc09aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:26.421 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1f9ffb640 1 -- 172.21.15.80:0/517609116 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398075628 0 0) 0x7fc1fc0d0c00 con 0x7fc1fc0d0720 2024-04-16T15:35:26.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.422+0000 7fc1faffd640 1 -- 172.21.15.80:0/517609116 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc0d14a0 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.423+0000 7fc1faffd640 1 --2- 172.21.15.80:0/517609116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0b16f0 0x7fc1fc070c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009870 tx=0x7fc1ec02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9a514c9a374fec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.423+0000 7fc1f9ffb640 1 -- 172.21.15.80:0/517609116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec02f840 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.423+0000 7fc1f9ffb640 1 -- 172.21.15.80:0/517609116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ec02f9e0 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.423+0000 7fc1f9ffb640 1 -- 172.21.15.80:0/517609116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec02fdb0 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 -- 172.21.15.80:0/517609116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0b16f0 msgr2=0x7fc1fc070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:26.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 --2- 172.21.15.80:0/517609116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0b16f0 0x7fc1fc070c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009870 tx=0x7fc1ec02ba20 comp rx=0 tx=0).stop 2024-04-16T15:35:26.425 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 -- 172.21.15.80:0/517609116 shutdown_connections 2024-04-16T15:35:26.426 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 --2- 172.21.15.80:0/517609116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0b16f0 0x7fc1fc070c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.426 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 -- 172.21.15.80:0/517609116 >> 172.21.15.80:0/517609116 conn(0x7fc1fc0b3fd0 msgr2=0x7fc1fc0b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:26.426 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 -- 172.21.15.80:0/517609116 shutdown_connections 2024-04-16T15:35:26.426 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.424+0000 7fc20127b640 1 -- 172.21.15.80:0/517609116 wait complete. 2024-04-16T15:35:26.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.425+0000 7fc20127b640 1 Processor -- start 2024-04-16T15:35:26.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.425+0000 7fc20127b640 1 -- start start 2024-04-16T15:35:26.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 0x7fc1fc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:26.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1fc0b16f0 0x7fc1fc160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:26.428 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b1c50 con 0x7fc1fc0d0720 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc0b1ad0 con 0x7fc1fc09b130 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc20127b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc1fc071140 con 0x7fc1fc0b16f0 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc1fb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50226/0 (socket says 172.21.15.80:50226) 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc1fb7fe640 1 -- 172.21.15.80:0/2909959924 learned_addr learned my addr 172.21.15.80:0/2909959924 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.426+0000 7fc1faffd640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 0x7fc1fc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fa7fc640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1fc0b16f0 0x7fc1fc160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 -- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1fc0b16f0 msgr2=0x7fc1fc160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1fc0b16f0 0x7fc1fc160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 -- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 msgr2=0x7fc1fc159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 0x7fc1fc159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 -- 172.21.15.80:0/2909959924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc1f8240 con 0x7fc1fc0d0720 2024-04-16T15:35:26.429 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1faffd640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 0x7fc1fc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1fb7fe640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c7a0 tx=0x7fc1f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4003b70 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f4003d30 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400aa90 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1fc1f8520 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1fc159870 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1f400ac30 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.427+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc1f4012c80 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.428+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1fc075500 con 0x7fc1fc0d0720 2024-04-16T15:35:26.430 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.430+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc1f40125b0 con 0x7fc1fc0d0720 2024-04-16T15:35:26.490 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.492+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1fc0b8360 con 0x7fc1fc0d0720 2024-04-16T15:35:26.491 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.493+0000 7fc1f37fe640 1 -- 172.21.15.80:0/2909959924 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc1f4012790 con 0x7fc1fc0d0720 2024-04-16T15:35:26.491 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-16T15:35:26.491 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":10,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:25.281053+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:26.492 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 msgr2=0x7fc1fc160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:26.492 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c7a0 tx=0x7fc1f400cc60 comp rx=0 tx=0).stop 2024-04-16T15:35:26.492 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 shutdown_connections 2024-04-16T15:35:26.492 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1fc0d0720 0x7fc1fc160980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.492 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1fc0b16f0 0x7fc1fc160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.493 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 --2- 172.21.15.80:0/2909959924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1fc09b130 0x7fc1fc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:26.493 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 >> 172.21.15.80:0/2909959924 conn(0x7fc1fc0b3fd0 msgr2=0x7fc1fc0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:26.493 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 shutdown_connections 2024-04-16T15:35:26.493 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:26.494+0000 7fc20127b640 1 -- 172.21.15.80:0/2909959924 wait complete. 2024-04-16T15:35:26.501 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T15:35:26.700 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:26.702+0000 7fe41ae17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T15:35:26.977 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:26.979+0000 7fe41ae17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T15:35:27.031 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:27.032+0000 7fe41ae17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T15:35:27.088 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:27.089+0000 7fc49ea2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T15:35:27.147 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:27.149+0000 7fe41ae17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T15:35:27.370 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:27.372+0000 7fc49ea2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T15:35:27.422 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:27.423+0000 7fc49ea2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T15:35:27.538 INFO:tasks.ceph.mgr.x.smithi087.stderr:2024-04-16T15:35:27.540+0000 7fc49ea2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T15:35:28.161 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:28.162+0000 7fe3bb6e9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T15:35:28.161 INFO:tasks.ceph.mgr.y.smithi080.stderr:2024-04-16T15:35:28.163+0000 7fe3bb6e9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T15:35:29.405 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-16T15:35:29.407+0000 7f54e0c1b640 -1 osd.1 0 log_to_monitors true 2024-04-16T15:35:29.405 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-04-16T15:35:29.407+0000 7f010160d640 -1 osd.4 0 log_to_monitors true 2024-04-16T15:35:29.413 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-04-16T15:35:29.414+0000 7f0b8ca22640 -1 osd.5 0 log_to_monitors true 2024-04-16T15:35:29.437 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-04-16T15:35:29.438+0000 7f761fe8b640 -1 osd.7 0 log_to_monitors true 2024-04-16T15:35:29.459 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-04-16T15:35:29.460+0000 7f23398b3640 -1 osd.6 0 log_to_monitors true 2024-04-16T15:35:29.463 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-16T15:35:29.465+0000 7f06a990f640 -1 osd.2 0 log_to_monitors true 2024-04-16T15:35:29.465 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-16T15:35:29.467+0000 7f1aa1519640 -1 osd.0 0 log_to_monitors true 2024-04-16T15:35:29.474 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-16T15:35:29.476+0000 7f8aa1013640 -1 osd.3 0 log_to_monitors true 2024-04-16T15:35:33.183 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-04-16T15:35:33.185+0000 7f0b8841a640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T15:35:33.202 INFO:tasks.ceph.osd.5.smithi087.stderr:2024-04-16T15:35:33.204+0000 7f0b8023a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.309 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:33.313 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-16T15:35:33.312+0000 7f54dc5ec640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T15:35:33.315 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-16T15:35:33.317+0000 7f06a58a5640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T15:35:33.320 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-04-16T15:35:33.322+0000 7f233605d640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T15:35:33.324 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-04-16T15:35:33.325+0000 7f761be21640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T15:35:33.328 INFO:tasks.ceph.osd.1.smithi080.stderr:2024-04-16T15:35:33.330+0000 7f54d440c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.334 INFO:tasks.ceph.osd.2.smithi080.stderr:2024-04-16T15:35:33.336+0000 7f069d6c5640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.335 INFO:tasks.ceph.osd.6.smithi087.stderr:2024-04-16T15:35:33.337+0000 7f232d669640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.335 INFO:tasks.ceph.osd.7.smithi087.stderr:2024-04-16T15:35:33.337+0000 7f7613c41640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.336 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-04-16T15:35:33.337+0000 7f00fced4640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T15:35:33.339 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-16T15:35:33.341+0000 7f8a9c8e5640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T15:35:33.349 INFO:tasks.ceph.osd.3.smithi080.stderr:2024-04-16T15:35:33.351+0000 7f8a94705640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.350 INFO:tasks.ceph.osd.4.smithi087.stderr:2024-04-16T15:35:33.352+0000 7f00f4cf4640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.352 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-16T15:35:33.354+0000 7f1a9d4af640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T15:35:33.374 INFO:tasks.ceph.osd.0.smithi080.stderr:2024-04-16T15:35:33.376+0000 7f1a952cf640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T15:35:33.414 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.415+0000 7f71c8300640 1 Processor -- start 2024-04-16T15:35:33.414 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.415+0000 7f71c8300640 1 -- start start 2024-04-16T15:35:33.415 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c8300640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 0x7f71c0071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:33.415 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c8300640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c00ce8b0 con 0x7f71c0145f40 2024-04-16T15:35:33.415 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c8300640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c00ceb90 con 0x7f71c0145290 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c8300640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00ce660 con 0x7f71c01459f0 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c589b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f71c0145f40 0x7f71c015cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:55900/0 (socket says 172.21.15.80:55900) 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.416+0000 7f71c589b640 1 -- 172.21.15.80:0/1525807124 learned_addr learned my addr 172.21.15.80:0/1525807124 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c689d640 1 --2- 172.21.15.80:0/1525807124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 0x7f71c0071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661717019 0 0) 0x7f71c00ce8b0 con 0x7f71c0145f40 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ac003520 con 0x7f71c0145f40 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785157720 0 0) 0x7f71c00ceb90 con 0x7f71c0145290 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c00ce8b0 con 0x7f71c0145290 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c689d640 1 -- 172.21.15.80:0/1525807124 >> v1:172.21.15.87:6789/0 conn(0x7f71c0145290 legacy=0x7f71c00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c689d640 1 -- 172.21.15.80:0/1525807124 >> v1:172.21.15.80:6789/0 conn(0x7f71c0145f40 legacy=0x7f71c015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.416 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.417+0000 7f71c689d640 1 -- 172.21.15.80:0/1525807124 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c00cee70 con 0x7f71c01459f0 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c689d640 1 --2- 172.21.15.80:0/1525807124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 0x7f71c0071da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009dc0 tx=0x7f71b802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca69333657d49cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8039070 con 0x7f71c01459f0 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b802cc40 con 0x7f71c01459f0 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c509a640 1 -- 172.21.15.80:0/1525807124 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8034440 con 0x7f71c01459f0 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 -- 172.21.15.80:0/1525807124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 msgr2=0x7f71c0071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 --2- 172.21.15.80:0/1525807124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 0x7f71c0071da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009dc0 tx=0x7f71b802be90 comp rx=0 tx=0).stop 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 -- 172.21.15.80:0/1525807124 shutdown_connections 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 --2- 172.21.15.80:0/1525807124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c01459f0 0x7f71c0071da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 -- 172.21.15.80:0/1525807124 >> 172.21.15.80:0/1525807124 conn(0x7f71c0067ee0 msgr2=0x7f71c006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 -- 172.21.15.80:0/1525807124 shutdown_connections 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.418+0000 7f71c8300640 1 -- 172.21.15.80:0/1525807124 wait complete. 2024-04-16T15:35:33.418 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.419+0000 7f71c8300640 1 Processor -- start 2024-04-16T15:35:33.419 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 -- start start 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 0x7f71c0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 0x7f71c00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00d0060 con 0x7f71c0145290 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00cf4c0 con 0x7f71c01459f0 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c8300640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00d01e0 con 0x7f71c0145f40 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c609c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c609c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50344/0 (socket says 172.21.15.80:50344) 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c609c640 1 -- 172.21.15.80:0/2680617424 learned_addr learned my addr 172.21.15.80:0/2680617424 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c589b640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 0x7f71c0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.420+0000 7f71c689d640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 0x7f71c00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 -- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 msgr2=0x7f71c00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.422 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 0x7f71c00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 -- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 msgr2=0x7f71c0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 0x7f71c0154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 -- 172.21.15.80:0/2680617424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c01380c0 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c589b640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 0x7f71c0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c689d640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 0x7f71c00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c609c640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c500 tx=0x7f71bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0052d0 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc005490 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c0154eb0 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc012870 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.421+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c013aaf0 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.422+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c0075500 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.422+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f71bc012a10 con 0x7f71c0145290 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.423+0000 7f71b6ffd640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 0x7f71a406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.423+0000 7f71c589b640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 0x7f71a406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:33.423 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.423+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f71bc08aa10 con 0x7f71c0145290 2024-04-16T15:35:33.424 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.423+0000 7f71c589b640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 0x7f71a406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f71c01377d0 tx=0x7f71b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:33.426 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.428+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71bc059cc0 con 0x7f71c0145290 2024-04-16T15:35:33.602 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.603+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71c00aff10 con 0x7f71c0145290 2024-04-16T15:35:33.602 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.604+0000 7f71b6ffd640 1 -- 172.21.15.80:0/2680617424 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f71bc0595c0 con 0x7f71c0145290 2024-04-16T15:35:33.603 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-16T15:35:33.603 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":12,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:31.163971+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 msgr2=0x7f71a406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 0x7f71a406ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f71c01377d0 tx=0x7f71b0009040 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 msgr2=0x7f71c0137b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c500 tx=0x7f71bc00c9c0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 shutdown_connections 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71a406c860 0x7f71a406ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71c0145f40 0x7f71c00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71c01459f0 0x7f71c0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 --2- 172.21.15.80:0/2680617424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71c0145290 0x7f71c0137b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 >> 172.21.15.80:0/2680617424 conn(0x7f71c0067ee0 msgr2=0x7f71c00aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 shutdown_connections 2024-04-16T15:35:33.605 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:33.606+0000 7f71c8300640 1 -- 172.21.15.80:0/2680617424 wait complete. 2024-04-16T15:35:33.614 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T15:35:40.421 DEBUG:teuthology.orchestra.run.smithi080:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:40.522 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.523+0000 7f6d28874640 1 Processor -- start 2024-04-16T15:35:40.523 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.523+0000 7f6d28874640 1 -- start start 2024-04-16T15:35:40.525 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d28874640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d240cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.525 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d28874640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d240b5bf0 0x7f6d2406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.525 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d28874640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d240d04d0 con 0x7f6d240b56a0 2024-04-16T15:35:40.525 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d28874640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6d240d09d0 con 0x7f6d240b5bf0 2024-04-16T15:35:40.525 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d28874640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d24067f10 con 0x7f6d240cfbb0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d240b5bf0 0x7f6d2406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d240b5bf0 0x7f6d2406f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37204/0 (socket says 172.21.15.80:37204) 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1881208285 learned_addr learned my addr 172.21.15.80:0/1881208285 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d2259c640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d240cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1881208285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 msgr2=0x7f6d240cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d240cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1881208285 >> v1:172.21.15.87:6789/0 conn(0x7f6d240b56a0 legacy=0x7f6d2406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.524+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1881208285 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d240cf610 con 0x7f6d240b5bf0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.525+0000 7f6d19d9b640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d2406f560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009870 tx=0x7f6d0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7941d171bd97b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.525+0000 7f6d21d9b640 1 -- 172.21.15.80:0/1881208285 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c035020 con 0x7f6d240b5bf0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.525+0000 7f6d21d9b640 1 -- 172.21.15.80:0/1881208285 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c031640 con 0x7f6d240b5bf0 2024-04-16T15:35:40.526 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.525+0000 7f6d21d9b640 1 -- 172.21.15.80:0/1881208285 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c02d040 con 0x7f6d240b5bf0 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 -- 172.21.15.80:0/1881208285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 msgr2=0x7f6d2406f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d2406f560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009870 tx=0x7f6d0c02b8f0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 -- 172.21.15.80:0/1881208285 shutdown_connections 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d2406f560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 --2- 172.21.15.80:0/1881208285 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d240cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 -- 172.21.15.80:0/1881208285 >> 172.21.15.80:0/1881208285 conn(0x7f6d240cd660 msgr2=0x7f6d240cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 -- 172.21.15.80:0/1881208285 shutdown_connections 2024-04-16T15:35:40.527 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.526+0000 7f6d28874640 1 -- 172.21.15.80:0/1881208285 wait complete. 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 Processor -- start 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 -- start start 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d240b56a0 0x7f6d240b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d2414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24067c30 con 0x7f6d240b5bf0 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24067950 con 0x7f6d240b56a0 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d28874640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d240b4f90 con 0x7f6d240cfbb0 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d19d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d19d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37214/0 (socket says 172.21.15.80:37214) 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1435941415 learned_addr learned my addr 172.21.15.80:0/1435941415 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.528+0000 7f6d2259c640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d240b56a0 0x7f6d240b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.531 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d22d9d640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d2414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 msgr2=0x7f6d2414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d2414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d240b56a0 msgr2=0x7f6d240b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d240b56a0 0x7f6d240b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 -- 172.21.15.80:0/1435941415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d240b2150 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d19d9b640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c02b930 tx=0x7f6d0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c040070 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c03e070 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d240c6140 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c035040 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.529+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d24159620 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.530+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d24075500 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.531+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d0c038020 con 0x7f6d240b5bf0 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.531+0000 7f6d1b7fe640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 0x7f6d0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.532 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.531+0000 7f6d2259c640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 0x7f6d0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.533 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.531+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6d0c0ad040 con 0x7f6d240b5bf0 2024-04-16T15:35:40.533 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.532+0000 7f6d2259c640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 0x7f6d0406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.535 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.536+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d0c07b200 con 0x7f6d240b5bf0 2024-04-16T15:35:40.711 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.711+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d240b0140 con 0x7f6d240b5bf0 2024-04-16T15:35:40.712 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.712+0000 7f6d1b7fe640 1 -- 172.21.15.80:0/1435941415 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7f6d0c07f500 con 0x7f6d240b5bf0 2024-04-16T15:35:40.712 INFO:teuthology.misc.health.smithi080.stdout: 2024-04-16T15:35:40.712 INFO:teuthology.misc.health.smithi080.stdout:{"epoch":16,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:37.194419+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 msgr2=0x7f6d0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 0x7f6d0406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 msgr2=0x7f6d240b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c02b930 tx=0x7f6d0c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 shutdown_connections 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d0406c8f0 0x7f6d0406edb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d240cfbb0 0x7f6d2414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d240b5bf0 0x7f6d240b0af0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 --2- 172.21.15.80:0/1435941415 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d240b56a0 0x7f6d240b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.714 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 >> 172.21.15.80:0/1435941415 conn(0x7f6d240cd660 msgr2=0x7f6d24158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:40.715 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 shutdown_connections 2024-04-16T15:35:40.715 INFO:teuthology.misc.health.smithi080.stderr:2024-04-16T15:35:40.714+0000 7f6d28874640 1 -- 172.21.15.80:0/1435941415 wait complete. 2024-04-16T15:35:40.723 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T15:35:40.723 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T15:35:40.724 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T15:35:40.724 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T15:35:40.726 INFO:tasks.ceph.mds.a:Started 2024-04-16T15:35:40.726 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T15:35:40.727 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T15:35:40.728 INFO:tasks.ceph.mds.c:Started 2024-04-16T15:35:40.728 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T15:35:40.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T15:35:40.731 INFO:tasks.ceph.mds.b:Started 2024-04-16T15:35:40.731 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T15:35:40.731 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T15:35:40.733 INFO:tasks.ceph.mds.d:Started 2024-04-16T15:35:40.733 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T15:35:40.734 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:40.805 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-16T15:35:40.806 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-16T15:35:40.821 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-04-16T15:35:40.821 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-04-16T15:35:40.822 INFO:tasks.ceph.mds.d.smithi087.stderr:2024-04-16T15:35:40.823+0000 7f6701c45640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2024-04-16T15:35:40.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.843+0000 7f833ce88640 1 Processor -- start 2024-04-16T15:35:40.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.843+0000 7f833ce88640 1 -- start start 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.843+0000 7f833ce88640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f833815c810 0x7f83380d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.843+0000 7f833ce88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.843+0000 7f833ce88640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f83381603e0 0x7f8338160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833ce88640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8338160d70 con 0x7f833815c810 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833ce88640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f83380cd140 con 0x7f83381603e0 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833ce88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f83380cd420 con 0x7f83380ce1e0 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f833815c810 0x7f83380d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f833815c810 0x7f83380d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37248/0 (socket says 172.21.15.80:37248) 2024-04-16T15:35:40.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 -- 172.21.15.80:0/3520566460 learned_addr learned my addr 172.21.15.80:0/3520566460 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f832ffff640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f8336d9d640 1 --2- 172.21.15.80:0/3520566460 >> v2:172.21.15.87:3300/0 conn(0x7f83381603e0 0x7f8338160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 -- 172.21.15.80:0/3520566460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 msgr2=0x7f83380d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 -- 172.21.15.80:0/3520566460 >> v2:172.21.15.87:3300/0 conn(0x7f83381603e0 msgr2=0x7f8338160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 --2- 172.21.15.80:0/3520566460 >> v2:172.21.15.87:3300/0 conn(0x7f83381603e0 0x7f8338160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.844+0000 7f833659c640 1 -- 172.21.15.80:0/3520566460 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380cd700 con 0x7f833815c810 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833659c640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833815c810 0x7f83380d0a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83380728a0 tx=0x7f832802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab96797199bdbf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f8335d9b640 1 -- 172.21.15.80:0/3520566460 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328035020 con 0x7f833815c810 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f8335d9b640 1 -- 172.21.15.80:0/3520566460 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328031870 con 0x7f833815c810 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f8335d9b640 1 -- 172.21.15.80:0/3520566460 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328031c40 con 0x7f833815c810 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 -- 172.21.15.80:0/3520566460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833815c810 msgr2=0x7f83380d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833815c810 0x7f83380d0a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83380728a0 tx=0x7f832802b910 comp rx=0 tx=0).stop 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 -- 172.21.15.80:0/3520566460 shutdown_connections 2024-04-16T15:35:40.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 --2- 172.21.15.80:0/3520566460 >> v2:172.21.15.87:3300/0 conn(0x7f83381603e0 0x7f8338160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 --2- 172.21.15.80:0/3520566460 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f833815c810 0x7f83380d0a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 -- 172.21.15.80:0/3520566460 >> 172.21.15.80:0/3520566460 conn(0x7f83380d2500 msgr2=0x7f83380d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 -- 172.21.15.80:0/3520566460 shutdown_connections 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.845+0000 7f833ce88640 1 -- 172.21.15.80:0/3520566460 wait complete. 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 Processor -- start 2024-04-16T15:35:40.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 -- start start 2024-04-16T15:35:40.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f833815c810 0x7f83380c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f83381611a0 con 0x7f83381603e0 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83380cdcc0 con 0x7f833815c810 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.847+0000 7f833ce88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f833815cbf0 con 0x7f83380ce1e0 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37258/0 (socket says 172.21.15.80:37258) 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 -- 172.21.15.80:0/60323480 learned_addr learned my addr 172.21.15.80:0/60323480 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f832ffff640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f833815c810 0x7f83380c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f833659c640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 -- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 msgr2=0x7f83380cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 -- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f833815c810 msgr2=0x7f83380c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:40.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f833815c810 0x7f83380c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 -- 172.21.15.80:0/60323480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380c8bc0 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f8336d9d640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8330007e60 tx=0x7f833000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330014420 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330019070 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833815ce90 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330014820 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.848+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833806dff0 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.849+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8338069150 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.849+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83300149c0 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.850+0000 7f832effd640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.850+0000 7f833659c640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.850+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f833008be70 con 0x7f83381603e0 2024-04-16T15:35:40.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.850+0000 7f833659c640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8328036000 tx=0x7f832803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:40.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:40.854+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8330059fa0 con 0x7f83381603e0 2024-04-16T15:35:41.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.030+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8338070f90 con 0x7f83381603e0 2024-04-16T15:35:41.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.031+0000 7f832effd640 1 -- 172.21.15.80:0/60323480 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7f833005e2a0 con 0x7f83381603e0 2024-04-16T15:35:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:41.031 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:37.194419+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 msgr2=0x7f831806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8328036000 tx=0x7f832803c040 comp rx=0 tx=0).stop 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 msgr2=0x7f83380c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8330007e60 tx=0x7f833000e4b0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 shutdown_connections 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83381603e0 0x7f83380c7c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f833815c810 0x7f83380c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 --2- 172.21.15.80:0/60323480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83380ce1e0 0x7f83380cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 >> 172.21.15.80:0/60323480 conn(0x7f83380d2500 msgr2=0x7f83380b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:41.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 shutdown_connections 2024-04-16T15:35:41.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.033+0000 7f833ce88640 1 -- 172.21.15.80:0/60323480 wait complete. 2024-04-16T15:35:41.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:35:41.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:35:41.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.150+0000 7f5e1b940640 1 Processor -- start 2024-04-16T15:35:41.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e1b940640 1 -- start start 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e1b940640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5e140cba80 0x7f5e140b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e1b940640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e1406c5c0 con 0x7f5e1415eaa0 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e1b940640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e1406ba40 con 0x7f5e140d0dd0 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e1b940640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5e1406bd20 con 0x7f5e140cba80 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e196dc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5e1415eaa0 0x7f5e140d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37118/0 (socket says 172.21.15.80:37118) 2024-04-16T15:35:41.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e196dc640 1 -- 172.21.15.80:0/2639159231 learned_addr learned my addr 172.21.15.80:0/2639159231 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.151+0000 7f5e18edb640 1 --2- 172.21.15.80:0/2639159231 >> v2:172.21.15.80:3300/0 conn(0x7f5e140cba80 0x7f5e140b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.152+0000 7f5e13fff640 1 -- 172.21.15.80:0/2639159231 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699899050 0 0) 0x7f5e1406c5c0 con 0x7f5e1415eaa0 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.152+0000 7f5e13fff640 1 -- 172.21.15.80:0/2639159231 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dfc003520 con 0x7f5e1415eaa0 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.152+0000 7f5e18edb640 1 -- 172.21.15.80:0/2639159231 >> v1:172.21.15.87:6789/0 conn(0x7f5e140d0dd0 legacy=0x7f5e140b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.152+0000 7f5e18edb640 1 -- 172.21.15.80:0/2639159231 >> v1:172.21.15.80:6789/0 conn(0x7f5e1415eaa0 legacy=0x7f5e140d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.152+0000 7f5e18edb640 1 -- 172.21.15.80:0/2639159231 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1406c000 con 0x7f5e140cba80 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e18edb640 1 --2- 172.21.15.80:0/2639159231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140cba80 0x7f5e140b3ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097a0 tx=0x7f5e0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cc8f2a42669b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e13fff640 1 -- 172.21.15.80:0/2639159231 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08035020 con 0x7f5e140cba80 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e13fff640 1 -- 172.21.15.80:0/2639159231 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e08031830 con 0x7f5e140cba80 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e13fff640 1 -- 172.21.15.80:0/2639159231 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08031c00 con 0x7f5e140cba80 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e1b940640 1 -- 172.21.15.80:0/2639159231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140cba80 msgr2=0x7f5e140b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e1b940640 1 --2- 172.21.15.80:0/2639159231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140cba80 0x7f5e140b3ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097a0 tx=0x7f5e0802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e1b940640 1 -- 172.21.15.80:0/2639159231 shutdown_connections 2024-04-16T15:35:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e1b940640 1 --2- 172.21.15.80:0/2639159231 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140cba80 0x7f5e140b3ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.153+0000 7f5e1b940640 1 -- 172.21.15.80:0/2639159231 >> 172.21.15.80:0/2639159231 conn(0x7f5e140b2fa0 msgr2=0x7f5e140b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.154+0000 7f5e1b940640 1 -- 172.21.15.80:0/2639159231 shutdown_connections 2024-04-16T15:35:41.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.154+0000 7f5e1b940640 1 -- 172.21.15.80:0/2639159231 wait complete. 2024-04-16T15:35:41.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 Processor -- start 2024-04-16T15:35:41.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 -- start start 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e140cba80 0x7f5e14155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e1415eaa0 0x7f5e1415ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5e140cd5a0 con 0x7f5e140d0dd0 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1415ee80 con 0x7f5e1415eaa0 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.155+0000 7f5e1b940640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f5e140cd720 con 0x7f5e140cba80 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37282/0 (socket says 172.21.15.80:37282) 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 -- 172.21.15.80:0/1615106531 learned_addr learned my addr 172.21.15.80:0/1615106531 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e196dc640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e140cba80 0x7f5e14155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e19edd640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e1415eaa0 0x7f5e1415ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 -- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e140cba80 msgr2=0x7f5e14155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e140cba80 0x7f5e14155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 -- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e1415eaa0 msgr2=0x7f5e1415ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e1415eaa0 0x7f5e1415ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 -- 172.21.15.80:0/1615106531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1415b6e0 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e18edb640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e080098c0 tx=0x7f5e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08041070 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0803b920 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e141f5600 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08035040 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.156+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1415bc60 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.158+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e14069150 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.158+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e08038020 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.158+0000 7f5e11ffb640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.158+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f5e080ad0a0 con 0x7f5e140d0dd0 2024-04-16T15:35:41.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.158+0000 7f5e196dc640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.159+0000 7f5e196dc640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 0x7f5e0006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005c00 tx=0x7f5e04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.163+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e08031800 con 0x7f5e140d0dd0 2024-04-16T15:35:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.335+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5e140b2a50 con 0x7f5e140d0dd0 2024-04-16T15:35:41.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.336+0000 7f5e11ffb640 1 -- 172.21.15.80:0/1615106531 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f5e0807b1d0 con 0x7f5e140d0dd0 2024-04-16T15:35:41.335 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 msgr2=0x7f5e0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 0x7f5e0006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e04005c00 tx=0x7f5e04009040 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 msgr2=0x7f5e141f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e080098c0 tx=0x7f5e080046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 shutdown_connections 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e1415eaa0 0x7f5e1415ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e140d0dd0 0x7f5e141f50c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5e0006c8f0 0x7f5e0006edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 --2- 172.21.15.80:0/1615106531 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5e140cba80 0x7f5e14155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 >> 172.21.15.80:0/1615106531 conn(0x7f5e140b2fa0 msgr2=0x7f5e140ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:41.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.337+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 shutdown_connections 2024-04-16T15:35:41.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.338+0000 7f5e1b940640 1 -- 172.21.15.80:0/1615106531 wait complete. 2024-04-16T15:35:41.348 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:35:41.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.450+0000 7fc93b416640 1 Processor -- start 2024-04-16T15:35:41.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.450+0000 7fc93b416640 1 -- start start 2024-04-16T15:35:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc93b416640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc93b416640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9340d1010 0x7fc9340cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc93b416640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340b4010 con 0x7fc93415eaa0 2024-04-16T15:35:41.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc93b416640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340b3800 con 0x7fc9340d1010 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc93b416640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc93406c8f0 con 0x7fc9340ca770 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc9389b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9340d1010 0x7fc9340cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc9389b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc9340d1010 0x7fc9340cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37294/0 (socket says 172.21.15.80:37294) 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc9389b1640 1 -- 172.21.15.80:0/2929256539 learned_addr learned my addr 172.21.15.80:0/2929256539 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.451+0000 7fc9391b2640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9389b1640 1 -- 172.21.15.80:0/2929256539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 msgr2=0x7fc93406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9389b1640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9389b1640 1 -- 172.21.15.80:0/2929256539 >> v1:172.21.15.87:6789/0 conn(0x7fc93415eaa0 legacy=0x7fc9340ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9389b1640 1 -- 172.21.15.80:0/2929256539 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340cf100 con 0x7fc9340d1010 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9391b2640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:41.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc9389b1640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9340d1010 0x7fc9340cab50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc924009870 tx=0x7fc92402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1322c1385120ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.452+0000 7fc92bfff640 1 -- 172.21.15.80:0/2929256539 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924034070 con 0x7fc9340d1010 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc92bfff640 1 -- 172.21.15.80:0/2929256539 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924030840 con 0x7fc9340d1010 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc92bfff640 1 -- 172.21.15.80:0/2929256539 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924030c10 con 0x7fc9340d1010 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 -- 172.21.15.80:0/2929256539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9340d1010 msgr2=0x7fc9340cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9340d1010 0x7fc9340cab50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc924009870 tx=0x7fc92402b980 comp rx=0 tx=0).stop 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 -- 172.21.15.80:0/2929256539 shutdown_connections 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9340d1010 0x7fc9340cab50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 --2- 172.21.15.80:0/2929256539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 -- 172.21.15.80:0/2929256539 >> 172.21.15.80:0/2929256539 conn(0x7fc93409aa70 msgr2=0x7fc9340b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 -- 172.21.15.80:0/2929256539 shutdown_connections 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.453+0000 7fc93b416640 1 -- 172.21.15.80:0/2929256539 wait complete. 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.454+0000 7fc93b416640 1 Processor -- start 2024-04-16T15:35:41.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.454+0000 7fc93b416640 1 -- start start 2024-04-16T15:35:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9340d1010 0x7fc9340b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b3d30 con 0x7fc93415eaa0 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b3a50 con 0x7fc9340d1010 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc93b416640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340cf3a0 con 0x7fc9340ca770 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37298/0 (socket says 172.21.15.80:37298) 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 -- 172.21.15.80:0/830968142 learned_addr learned my addr 172.21.15.80:0/830968142 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9391b2640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9389b1640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9340d1010 0x7fc9340b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 -- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 msgr2=0x7fc93415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 -- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9340d1010 msgr2=0x7fc9340b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9340d1010 0x7fc9340b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.455+0000 7fc9399b3640 1 -- 172.21.15.80:0/830968142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340b5b20 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc9399b3640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c760 tx=0x7fc92c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003b70 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c003d10 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00aa90 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93415f490 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.456+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93415fa50 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.457+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc934068a40 con 0x7fc93415eaa0 2024-04-16T15:35:41.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.457+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc92c00ac30 con 0x7fc93415eaa0 2024-04-16T15:35:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.458+0000 7fc929ffb640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 0x7fc91806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.458+0000 7fc9391b2640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 0x7fc91806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.458+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc92c08b530 con 0x7fc93415eaa0 2024-04-16T15:35:41.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.458+0000 7fc9391b2640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 0x7fc91806ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc930006fd0 tx=0x7fc930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:41.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.462+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc92c059660 con 0x7fc93415eaa0 2024-04-16T15:35:41.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.677+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc93414f800 con 0x7fc93415eaa0 2024-04-16T15:35:41.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.678+0000 7fc929ffb640 1 -- 172.21.15.80:0/830968142 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fc92c05d960 con 0x7fc93415eaa0 2024-04-16T15:35:41.677 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:41.677 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-16T15:35:41.678 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 2 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 msgr2=0x7fc91806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 0x7fc91806ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc930006fd0 tx=0x7fc930008040 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 msgr2=0x7fc93414f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c760 tx=0x7fc92c00cc20 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 shutdown_connections 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc93415eaa0 0x7fc93414f2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc9340d1010 0x7fc9340b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc91806c920 0x7fc91806ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 --2- 172.21.15.80:0/830968142 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc9340ca770 0x7fc93415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 >> 172.21.15.80:0/830968142 conn(0x7fc93409aa70 msgr2=0x7fc93406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:41.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 shutdown_connections 2024-04-16T15:35:41.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:41.680+0000 7fc93b416640 1 -- 172.21.15.80:0/830968142 wait complete. 2024-04-16T15:35:43.691 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:35:43.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.805+0000 7f3ad8bd4640 1 Processor -- start 2024-04-16T15:35:43.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.805+0000 7f3ad8bd4640 1 -- start start 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad8bd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 0x7f3ad40d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad8bd4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad40cf360 0x7f3ad40cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad8bd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad40cfd30 con 0x7f3ad415e780 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad8bd4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad40ba670 con 0x7f3ad40cf360 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad8bd4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad40b7ce0 con 0x7f3ad40b7700 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad40cf360 0x7f3ad40cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3ad40cf360 0x7f3ad40cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37306/0 (socket says 172.21.15.80:37306) 2024-04-16T15:35:43.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 -- 172.21.15.80:0/1553710936 learned_addr learned my addr 172.21.15.80:0/1553710936 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad1d9b640 1 --2- 172.21.15.80:0/1553710936 >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 0x7f3ad40d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 -- 172.21.15.80:0/1553710936 >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 msgr2=0x7f3ad40d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 --2- 172.21.15.80:0/1553710936 >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 0x7f3ad40d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 -- 172.21.15.80:0/1553710936 >> v1:172.21.15.87:6789/0 conn(0x7f3ad415e780 legacy=0x7f3ad40b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad2d9d640 1 -- 172.21.15.80:0/1553710936 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad40b7fc0 con 0x7f3ad40cf360 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.806+0000 7f3ad1d9b640 1 --2- 172.21.15.80:0/1553710936 >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 0x7f3ad40d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.807+0000 7f3ad2d9d640 1 --2- 172.21.15.80:0/1553710936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40cf360 0x7f3ad40cf7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40b6240 tx=0x7f3ac402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed610fefc939ef5b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.807+0000 7f3ad159a640 1 -- 172.21.15.80:0/1553710936 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac402cb20 con 0x7f3ad40cf360 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.807+0000 7f3ad159a640 1 -- 172.21.15.80:0/1553710936 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac402ccc0 con 0x7f3ad40cf360 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.807+0000 7f3ad159a640 1 -- 172.21.15.80:0/1553710936 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4034610 con 0x7f3ad40cf360 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/1553710936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40cf360 msgr2=0x7f3ad40cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/1553710936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40cf360 0x7f3ad40cf7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40b6240 tx=0x7f3ac402bf80 comp rx=0 tx=0).stop 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/1553710936 shutdown_connections 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/1553710936 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40cf360 0x7f3ad40cf7f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:43.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/1553710936 >> v2:172.21.15.87:3300/0 conn(0x7f3ad40b7700 0x7f3ad40d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/1553710936 >> 172.21.15.80:0/1553710936 conn(0x7f3ad40734f0 msgr2=0x7f3ad4073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/1553710936 shutdown_connections 2024-04-16T15:35:43.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.808+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/1553710936 wait complete. 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.809+0000 7f3ad8bd4640 1 Processor -- start 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.809+0000 7f3ad8bd4640 1 -- start start 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ad40cf360 0x7f3ad40ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad415e780 0x7f3ad41f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad40b8860 con 0x7f3ad40b7700 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad40b8580 con 0x7f3ad415e780 2024-04-16T15:35:43.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad8bd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad415eb60 con 0x7f3ad40cf360 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37312/0 (socket says 172.21.15.80:37312) 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 -- 172.21.15.80:0/225463014 learned_addr learned my addr 172.21.15.80:0/225463014 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad2d9d640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad415e780 0x7f3ad41f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad1d9b640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ad40cf360 0x7f3ad40ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 -- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ad40cf360 msgr2=0x7f3ad40ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ad40cf360 0x7f3ad40ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 -- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad415e780 msgr2=0x7f3ad41f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad415e780 0x7f3ad41f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 -- 172.21.15.80:0/225463014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad40cd680 con 0x7f3ad40b7700 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.810+0000 7f3ad259c640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b3f0 tx=0x7f3acc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.811+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc015020 con 0x7f3ad40b7700 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.811+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3acc011830 con 0x7f3ad40b7700 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.811+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc011c20 con 0x7f3ad40b7700 2024-04-16T15:35:43.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.811+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad40cd960 con 0x7f3ad40b7700 2024-04-16T15:35:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.811+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad40c8660 con 0x7f3ad40b7700 2024-04-16T15:35:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.812+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad40c8860 con 0x7f3ad40b7700 2024-04-16T15:35:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.812+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3acc018020 con 0x7f3ad40b7700 2024-04-16T15:35:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.813+0000 7f3ac2ffd640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 0x7f3ab406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:43.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.813+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3acc08b370 con 0x7f3ad40b7700 2024-04-16T15:35:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.813+0000 7f3ad1d9b640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 0x7f3ab406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:43.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.813+0000 7f3ad1d9b640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 0x7f3ab406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4159ee0 tx=0x7f3ac8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:43.816 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:43.817+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ad40c8860 con 0x7f3ad40b7700 2024-04-16T15:35:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.028+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ad4068a40 con 0x7f3ad40b7700 2024-04-16T15:35:44.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.029+0000 7f3ac2ffd640 1 -- 172.21.15.80:0/225463014 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f3acc01f030 con 0x7f3ad40b7700 2024-04-16T15:35:44.028 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:44.029 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-16T15:35:44.029 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 3 2024-04-16T15:35:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 msgr2=0x7f3ab406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 0x7f3ab406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4159ee0 tx=0x7f3ac8008040 comp rx=0 tx=0).stop 2024-04-16T15:35:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 msgr2=0x7f3ad41f14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b3f0 tx=0x7f3acc00b8b0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 shutdown_connections 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ad415e780 0x7f3ad41f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ab406c8f0 0x7f3ab406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3ad40cf360 0x7f3ad40ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 --2- 172.21.15.80:0/225463014 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3ad40b7700 0x7f3ad41f14d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 >> 172.21.15.80:0/225463014 conn(0x7f3ad40734f0 msgr2=0x7f3ad40d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 shutdown_connections 2024-04-16T15:35:44.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.031+0000 7f3ad8bd4640 1 -- 172.21.15.80:0/225463014 wait complete. 2024-04-16T15:35:44.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.145+0000 7f398975f640 1 Processor -- start 2024-04-16T15:35:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.145+0000 7f398975f640 1 -- start start 2024-04-16T15:35:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f398975f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398415e780 0x7f39840b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f398975f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39840b7ce0 con 0x7f39840d26d0 2024-04-16T15:35:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f398975f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39840b7fc0 con 0x7f39840cf360 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f398975f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f39840ba670 con 0x7f398415e780 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f3982ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f398415e780 0x7f39840b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f39827fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f39840d26d0 0x7f39840b9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:37124/0 (socket says 172.21.15.80:37124) 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f39827fc640 1 -- 172.21.15.80:0/3677453982 learned_addr learned my addr 172.21.15.80:0/3677453982 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f3982ffd640 1 -- 172.21.15.80:0/3677453982 >> v1:172.21.15.87:6789/0 conn(0x7f39840cf360 legacy=0x7f39840cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f3982ffd640 1 -- 172.21.15.80:0/3677453982 >> v1:172.21.15.80:6789/0 conn(0x7f39840d26d0 legacy=0x7f39840b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.146+0000 7f3982ffd640 1 -- 172.21.15.80:0/3677453982 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39840b82a0 con 0x7f398415e780 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.147+0000 7f3982ffd640 1 --2- 172.21.15.80:0/3677453982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398415e780 0x7f39840b7700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605de21965d7d151 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.147+0000 7f3981ffb640 1 -- 172.21.15.80:0/3677453982 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974034070 con 0x7f398415e780 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.147+0000 7f3981ffb640 1 -- 172.21.15.80:0/3677453982 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3974030610 con 0x7f398415e780 2024-04-16T15:35:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.147+0000 7f3981ffb640 1 -- 172.21.15.80:0/3677453982 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740309e0 con 0x7f398415e780 2024-04-16T15:35:44.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 -- 172.21.15.80:0/3677453982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398415e780 msgr2=0x7f39840b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 --2- 172.21.15.80:0/3677453982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398415e780 0x7f39840b7700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402b960 comp rx=0 tx=0).stop 2024-04-16T15:35:44.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 -- 172.21.15.80:0/3677453982 shutdown_connections 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 --2- 172.21.15.80:0/3677453982 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f398415e780 0x7f39840b7700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 -- 172.21.15.80:0/3677453982 >> 172.21.15.80:0/3677453982 conn(0x7f39840734f0 msgr2=0x7f3984073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 -- 172.21.15.80:0/3677453982 shutdown_connections 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.148+0000 7f398975f640 1 -- 172.21.15.80:0/3677453982 wait complete. 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.149+0000 7f398975f640 1 Processor -- start 2024-04-16T15:35:44.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.149+0000 7f398975f640 1 -- start start 2024-04-16T15:35:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 0x7f39840cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f398415e780 0x7f3984161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f398415eb60 con 0x7f39840cf360 2024-04-16T15:35:44.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39840b8860 con 0x7f398415e780 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f398975f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f39840b8d80 con 0x7f39840d26d0 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37332/0 (socket says 172.21.15.80:37332) 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 -- 172.21.15.80:0/4089016390 learned_addr learned my addr 172.21.15.80:0/4089016390 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f39837fe640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f398415e780 0x7f3984161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f39827fc640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 0x7f39840cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 -- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 msgr2=0x7f39840cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 0x7f39840cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 -- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f398415e780 msgr2=0x7f3984161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f398415e780 0x7f3984161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 -- 172.21.15.80:0/4089016390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3984152e90 con 0x7f39840cf360 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f39827fc640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 0x7f39840cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.150+0000 7f3982ffd640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39740098c0 tx=0x7f39740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.151+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974034040 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.151+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397403acc0 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.151+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398415fa50 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.151+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974044630 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.151+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398415ffd0 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.152+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3984068a40 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.152+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f397404b060 con 0x7f39840cf360 2024-04-16T15:35:44.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.152+0000 7f396b7fe640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 0x7f397006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.153+0000 7f39827fc640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 0x7f397006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.153+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f39740ad6a0 con 0x7f39840cf360 2024-04-16T15:35:44.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.153+0000 7f39827fc640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 0x7f397006ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39840cd000 tx=0x7f3978009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.157+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f397403f070 con 0x7f39840cf360 2024-04-16T15:35:44.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.333+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3984073b70 con 0x7f39840cf360 2024-04-16T15:35:44.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.334+0000 7f396b7fe640 1 -- 172.21.15.80:0/4089016390 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7f3974037e40 con 0x7f39840cf360 2024-04-16T15:35:44.333 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:44.333 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:37.194419+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:44.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 msgr2=0x7f397006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 0x7f397006ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39840cd000 tx=0x7f3978009040 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 msgr2=0x7f3984152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39740098c0 tx=0x7f39740046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 shutdown_connections 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f398415e780 0x7f3984161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f397006c920 0x7f397006ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39840d26d0 0x7f39840cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 --2- 172.21.15.80:0/4089016390 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39840cf360 0x7f3984152950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 >> 172.21.15.80:0/4089016390 conn(0x7f39840734f0 msgr2=0x7f39840d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 shutdown_connections 2024-04-16T15:35:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.336+0000 7f398975f640 1 -- 172.21.15.80:0/4089016390 wait complete. 2024-04-16T15:35:44.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:35:44.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:35:44.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.453+0000 7faa9a9f0640 1 Processor -- start 2024-04-16T15:35:44.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.453+0000 7faa9a9f0640 1 -- start start 2024-04-16T15:35:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94145ea0 0x7faa941601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa9415ccf0 0x7faa94071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa94072310 0x7faa9406de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7faa94072760 con 0x7faa9415ccf0 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7faa94161120 con 0x7faa94072310 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa9a9f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7faa94160b60 con 0x7faa94145ea0 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa8bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa9415ccf0 0x7faa94071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa8bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7faa9415ccf0 0x7faa94071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37342/0 (socket says 172.21.15.80:37342) 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa8bfff640 1 -- 172.21.15.80:0/3951232314 learned_addr learned my addr 172.21.15.80:0/3951232314 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa98f8d640 1 --2- 172.21.15.80:0/3951232314 >> v2:172.21.15.87:3300/0 conn(0x7faa94072310 0x7faa9406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.454+0000 7faa93fff640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94145ea0 0x7faa941601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 -- 172.21.15.80:0/3951232314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94145ea0 msgr2=0x7faa941601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94145ea0 0x7faa941601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 -- 172.21.15.80:0/3951232314 >> v2:172.21.15.87:3300/0 conn(0x7faa94072310 msgr2=0x7faa9406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 --2- 172.21.15.80:0/3951232314 >> v2:172.21.15.87:3300/0 conn(0x7faa94072310 0x7faa9406de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 -- 172.21.15.80:0/3951232314 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa94160e40 con 0x7faa9415ccf0 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa8bfff640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94071dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa9406c850 tx=0x7faa7c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c678265cdc7eab server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa937fe640 1 -- 172.21.15.80:0/3951232314 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c02e070 con 0x7faa9415ccf0 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa937fe640 1 -- 172.21.15.80:0/3951232314 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c037070 con 0x7faa9415ccf0 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.455+0000 7faa937fe640 1 -- 172.21.15.80:0/3951232314 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c031a00 con 0x7faa9415ccf0 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 -- 172.21.15.80:0/3951232314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 msgr2=0x7faa94071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94071dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa9406c850 tx=0x7faa7c02b880 comp rx=0 tx=0).stop 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 -- 172.21.15.80:0/3951232314 shutdown_connections 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/3951232314 >> v2:172.21.15.87:3300/0 conn(0x7faa94072310 0x7faa9406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94071dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/3951232314 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94145ea0 0x7faa941601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 -- 172.21.15.80:0/3951232314 >> 172.21.15.80:0/3951232314 conn(0x7faa94067d90 msgr2=0x7faa9406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 -- 172.21.15.80:0/3951232314 shutdown_connections 2024-04-16T15:35:44.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.456+0000 7faa9a9f0640 1 -- 172.21.15.80:0/3951232314 wait complete. 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.457+0000 7faa9a9f0640 1 Processor -- start 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.457+0000 7faa9a9f0640 1 -- start start 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94072310 0x7faa94144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 0x7faa940adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faa94160730 con 0x7faa9415ccf0 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faa94146280 con 0x7faa94145ea0 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa9a9f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7faa941608b0 con 0x7faa94072310 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37356/0 (socket says 172.21.15.80:37356) 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 -- 172.21.15.80:0/370234368 learned_addr learned my addr 172.21.15.80:0/370234368 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa93fff640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94072310 0x7faa94144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa8bfff640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 0x7faa940adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 -- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94072310 msgr2=0x7faa94144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94072310 0x7faa94144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 -- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 msgr2=0x7faa940adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 0x7faa940adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 -- 172.21.15.80:0/370234368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940ae990 con 0x7faa9415ccf0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa8bfff640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 0x7faa940adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.458+0000 7faa98f8d640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00eed0 tx=0x7faa8c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.459+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c018020 con 0x7faa9415ccf0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.459+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c00bd20 con 0x7faa9415ccf0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.459+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa940aec70 con 0x7faa9415ccf0 2024-04-16T15:35:44.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.459+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c014640 con 0x7faa9415ccf0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.459+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa940af230 con 0x7faa9415ccf0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.460+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa94068a40 con 0x7faa9415ccf0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.460+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa8c01b020 con 0x7faa9415ccf0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.461+0000 7faa917fa640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 0x7faa7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.461+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7faa8c08be90 con 0x7faa9415ccf0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.461+0000 7faa93fff640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 0x7faa7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.461+0000 7faa93fff640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 0x7faa7406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa940adf00 tx=0x7faa84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.465+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa8c022030 con 0x7faa9415ccf0 2024-04-16T15:35:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.639+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa940af6c0 con 0x7faa9415ccf0 2024-04-16T15:35:44.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.640+0000 7faa917fa640 1 -- 172.21.15.80:0/370234368 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7faa8c05a610 con 0x7faa9415ccf0 2024-04-16T15:35:44.639 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 msgr2=0x7faa7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 0x7faa7406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa940adf00 tx=0x7faa84008040 comp rx=0 tx=0).stop 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 msgr2=0x7faa94139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00eed0 tx=0x7faa8c00b480 comp rx=0 tx=0).stop 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 shutdown_connections 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faa9415ccf0 0x7faa94139970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa94145ea0 0x7faa940adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faa7406c920 0x7faa7406ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 --2- 172.21.15.80:0/370234368 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faa94072310 0x7faa94144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 >> 172.21.15.80:0/370234368 conn(0x7faa94067d90 msgr2=0x7faa940b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 shutdown_connections 2024-04-16T15:35:44.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.642+0000 7faa9a9f0640 1 -- 172.21.15.80:0/370234368 wait complete. 2024-04-16T15:35:44.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T15:35:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.755+0000 7fba6f6d9640 1 Processor -- start 2024-04-16T15:35:44.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6f6d9640 1 -- start start 2024-04-16T15:35:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6f6d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba6806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6f6d9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba68070410 con 0x7fba680732f0 2024-04-16T15:35:44.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6f6d9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6806e550 con 0x7fba680b47e0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6f6d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fba6806e830 con 0x7fba6815ea20 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.756+0000 7fba6dc76640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fba680732f0 0x7fba6806fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36722/0 (socket says 172.21.15.80:36722) 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6dc76640 1 -- 172.21.15.80:0/4047799881 learned_addr learned my addr 172.21.15.80:0/4047799881 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6d475640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba6806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868302741 0 0) 0x7fba68070410 con 0x7fba680732f0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba54003520 con 0x7fba680732f0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1861726318 0 0) 0x7fba54003520 con 0x7fba680732f0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 msgr2=0x7fba6806c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba6806c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 >> v1:172.21.15.87:6789/0 conn(0x7fba680b47e0 legacy=0x7fba6806f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6806eb10 con 0x7fba680732f0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fba60001670 con 0x7fba680732f0 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 >> v1:172.21.15.80:6789/0 conn(0x7fba680732f0 legacy=0x7fba6806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba540039e0 0x7fba54003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba54004390 0x7fba54004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba540050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba6806e830 con 0x7fba54004390 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba5400b9c0 con 0x7fba540039e0 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fba5400bbc0 con 0x7fba6815ea20 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba54004390 0x7fba54004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6d475640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba540039e0 0x7fba54003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6dc76640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba540050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 -- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 msgr2=0x7fba540050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba6815ea20 0x7fba540050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 -- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba540039e0 msgr2=0x7fba54003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba540039e0 0x7fba54003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.757+0000 7fba6cc74640 1 -- 172.21.15.80:0/4047799881 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba54003520 con 0x7fba54004390 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.758+0000 7fba6cc74640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba54004390 0x7fba54004860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba58001860 tx=0x7fba54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7946638493475671 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.758+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58038070 con 0x7fba54004390 2024-04-16T15:35:44.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.758+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba58033410 con 0x7fba54004390 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.758+0000 7fba5ffff640 1 -- 172.21.15.80:0/4047799881 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58001430 con 0x7fba54004390 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 -- 172.21.15.80:0/4047799881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba54004390 msgr2=0x7fba54004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/4047799881 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba54004390 0x7fba54004860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba58001860 tx=0x7fba54005830 comp rx=0 tx=0).stop 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6dc76640 1 -- 172.21.15.80:0/4047799881 reap_dead start 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 -- 172.21.15.80:0/4047799881 shutdown_connections 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 -- 172.21.15.80:0/4047799881 >> 172.21.15.80:0/4047799881 conn(0x7fba680727d0 msgr2=0x7fba68072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 -- 172.21.15.80:0/4047799881 shutdown_connections 2024-04-16T15:35:44.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.759+0000 7fba6f6d9640 1 -- 172.21.15.80:0/4047799881 wait complete. 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.760+0000 7fba6f6d9640 1 Processor -- start 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.760+0000 7fba6f6d9640 1 -- start start 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba54004390 0x7fba68147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba681f7810 0x7fba681f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fba68067b20 con 0x7fba681526f0 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba6806f0d0 con 0x7fba681f7810 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6f6d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fba68067ca0 con 0x7fba54004390 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58650/0 (socket says 172.21.15.80:58650) 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 -- 172.21.15.80:0/1446118755 learned_addr learned my addr 172.21.15.80:0/1446118755 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6d475640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba54004390 0x7fba68147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6cc74640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba681f7810 0x7fba681f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 -- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba54004390 msgr2=0x7fba68147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba54004390 0x7fba68147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 -- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba681f7810 msgr2=0x7fba681f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba681f7810 0x7fba681f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 -- 172.21.15.80:0/1446118755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6815bc70 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba6dc76640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba680b6f90 tx=0x7fba60007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6001a070 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.761+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6000f8b0 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.762+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba68157700 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.762+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6000fca0 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.762+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba68151c10 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.763+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba68069150 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.763+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba6001d070 con 0x7fba681526f0 2024-04-16T15:35:44.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.764+0000 7fba5dffb640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 0x7fba4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.764+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fba6008ad00 con 0x7fba681526f0 2024-04-16T15:35:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.764+0000 7fba6d475640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 0x7fba4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:44.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.764+0000 7fba6d475640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 0x7fba4c06edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba64014450 tx=0x7fba6400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:44.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.768+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba6815bc70 con 0x7fba681526f0 2024-04-16T15:35:44.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.949+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fba680b2590 con 0x7fba681526f0 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.949+0000 7fba5dffb640 1 -- 172.21.15.80:0/1446118755 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fba60058ef0 con 0x7fba681526f0 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:35:44.949 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 msgr2=0x7fba4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 0x7fba4c06edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba64014450 tx=0x7fba6400b040 comp rx=0 tx=0).stop 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 msgr2=0x7fba68152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba680b6f90 tx=0x7fba60007720 comp rx=0 tx=0).stop 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 shutdown_connections 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fba681526f0 0x7fba68152ba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba681f7810 0x7fba681f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fba4c06c8f0 0x7fba4c06edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 --2- 172.21.15.80:0/1446118755 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fba54004390 0x7fba68147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 >> 172.21.15.80:0/1446118755 conn(0x7fba680727d0 msgr2=0x7fba6806c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 shutdown_connections 2024-04-16T15:35:44.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:44.951+0000 7fba6f6d9640 1 -- 172.21.15.80:0/1446118755 wait complete. 2024-04-16T15:35:44.962 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T15:35:44.962 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T15:35:45.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.070+0000 7fa6d1947640 1 Processor -- start 2024-04-16T15:35:45.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.070+0000 7fa6d1947640 1 -- start start 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6d1947640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6cc06e220 0x7fa6cc06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6d1947640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 0x7fa6cc15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6d1947640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6cc0d2f30 con 0x7fa6cc162a50 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6d1947640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa6cc1636f0 con 0x7fa6cc06e220 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6d1947640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa6cc15f130 con 0x7fa6cc15e740 2024-04-16T15:35:45.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6cc06e220 0x7fa6cc06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa6cc06e220 0x7fa6cc06dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58666/0 (socket says 172.21.15.80:58666) 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 -- 172.21.15.80:0/1227687277 learned_addr learned my addr 172.21.15.80:0/1227687277 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 -- 172.21.15.80:0/1227687277 >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 msgr2=0x7fa6cc15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6cb7fe640 1 --2- 172.21.15.80:0/1227687277 >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 0x7fa6cc15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1227687277 >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 0x7fa6cc15ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 -- 172.21.15.80:0/1227687277 >> v1:172.21.15.87:6789/0 conn(0x7fa6cc162a50 legacy=0x7fa6cc162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6c3fff640 1 -- 172.21.15.80:0/1227687277 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc0d3210 con 0x7fa6cc06e220 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.071+0000 7fa6cb7fe640 1 --2- 172.21.15.80:0/1227687277 >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 0x7fa6cc15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.072+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1227687277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc06dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0cef40 tx=0x7fa6b402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832694742720979a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.072+0000 7fa6ca7fc640 1 -- 172.21.15.80:0/1227687277 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4038070 con 0x7fa6cc06e220 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.072+0000 7fa6ca7fc640 1 -- 172.21.15.80:0/1227687277 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4004230 con 0x7fa6cc06e220 2024-04-16T15:35:45.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.072+0000 7fa6ca7fc640 1 -- 172.21.15.80:0/1227687277 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b402f050 con 0x7fa6cc06e220 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 -- 172.21.15.80:0/1227687277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 msgr2=0x7fa6cc06dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1227687277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc06dc20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0cef40 tx=0x7fa6b402b7e0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 -- 172.21.15.80:0/1227687277 shutdown_connections 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1227687277 >> v2:172.21.15.87:3300/0 conn(0x7fa6cc15e740 0x7fa6cc15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1227687277 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc06dc20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 -- 172.21.15.80:0/1227687277 >> 172.21.15.80:0/1227687277 conn(0x7fa6cc08c000 msgr2=0x7fa6cc0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 -- 172.21.15.80:0/1227687277 shutdown_connections 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.073+0000 7fa6d1947640 1 -- 172.21.15.80:0/1227687277 wait complete. 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.074+0000 7fa6d1947640 1 Processor -- start 2024-04-16T15:35:45.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.074+0000 7fa6d1947640 1 -- start start 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 0x7fa6cc0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 0x7fa6cc0b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0cf7e0 con 0x7fa6cc06e220 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0d37d0 con 0x7fa6cc15e740 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc0cf960 con 0x7fa6cc162a50 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58682/0 (socket says 172.21.15.80:58682) 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 -- 172.21.15.80:0/1386600530 learned_addr learned my addr 172.21.15.80:0/1386600530 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 0x7fa6cc0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6cb7fe640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 0x7fa6cc0b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 -- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 msgr2=0x7fa6cc0b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 0x7fa6cc0b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 -- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 msgr2=0x7fa6cc0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:45.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 0x7fa6cc0b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 -- 172.21.15.80:0/1386600530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc1f4890 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 0x7fa6cc0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6cb7fe640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 0x7fa6cc0b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6caffd640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b3f0 tx=0x7fa6bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc015020 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6bc011830 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc1f4b50 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc011c20 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.075+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc1f5110 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.076+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc068a40 con 0x7fa6cc06e220 2024-04-16T15:35:45.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.077+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6bc018020 con 0x7fa6cc06e220 2024-04-16T15:35:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.077+0000 7fa6c8ff9640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 0x7fa6ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.077+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa6bc08b370 con 0x7fa6cc06e220 2024-04-16T15:35:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.077+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 0x7fa6ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:45.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.078+0000 7fa6c3fff640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 0x7fa6ac06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4035000 tx=0x7fa6b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:45.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.082+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6bc01f030 con 0x7fa6cc06e220 2024-04-16T15:35:45.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.260+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa6cc15dee0 con 0x7fa6cc06e220 2024-04-16T15:35:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.875+0000 7fa6c8ff9640 1 -- 172.21.15.80:0/1386600530 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fa6bc0172c0 con 0x7fa6cc06e220 2024-04-16T15:35:45.875 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-16T15:35:45.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 msgr2=0x7fa6ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 0x7fa6ac06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4035000 tx=0x7fa6b4008030 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 msgr2=0x7fa6cc0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b3f0 tx=0x7fa6bc00b8b0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 shutdown_connections 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa6ac06c8f0 0x7fa6ac06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa6cc162a50 0x7fa6cc0b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6cc15e740 0x7fa6cc0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 --2- 172.21.15.80:0/1386600530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa6cc06e220 0x7fa6cc0b1d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 >> 172.21.15.80:0/1386600530 conn(0x7fa6cc08c000 msgr2=0x7fa6cc0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 shutdown_connections 2024-04-16T15:35:45.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:45.878+0000 7fa6d1947640 1 -- 172.21.15.80:0/1386600530 wait complete. 2024-04-16T15:35:45.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-16T15:35:46.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.010+0000 7fb3843f4640 1 Processor -- start 2024-04-16T15:35:46.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.010+0000 7fb3843f4640 1 -- start start 2024-04-16T15:35:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb3843f4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb37c0b39a0 0x7fb37c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb3843f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c1610b0 con 0x7fb37c09ba70 2024-04-16T15:35:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb3843f4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c0b2010 con 0x7fb37c15fe70 2024-04-16T15:35:46.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb3843f4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb37c0b22f0 con 0x7fb37c0b39a0 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb382991640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb37c09ba70 0x7fb37c0b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36734/0 (socket says 172.21.15.80:36734) 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb382991640 1 -- 172.21.15.80:0/3304210070 learned_addr learned my addr 172.21.15.80:0/3304210070 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb38198f640 1 --2- 172.21.15.80:0/3304210070 >> v2:172.21.15.87:3300/0 conn(0x7fb37c0b39a0 0x7fb37c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891679399 0 0) 0x7fb37c1610b0 con 0x7fb37c09ba70 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.011+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb368003520 con 0x7fb37c09ba70 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044438396 0 0) 0x7fb368003520 con 0x7fb37c09ba70 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 >> v2:172.21.15.87:3300/0 conn(0x7fb37c0b39a0 msgr2=0x7fb37c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 --2- 172.21.15.80:0/3304210070 >> v2:172.21.15.87:3300/0 conn(0x7fb37c0b39a0 0x7fb37c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 >> v1:172.21.15.87:6789/0 conn(0x7fb37c15fe70 legacy=0x7fb37c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c160d80 con 0x7fb37c09ba70 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fb3740019f0 con 0x7fb37c09ba70 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 >> v1:172.21.15.80:6789/0 conn(0x7fb37c09ba70 legacy=0x7fb37c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3680039b0 0x7fb368003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 0x7fb368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3680051c0 0x7fb36800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0b22f0 con 0x7fb368004800 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb36800c060 con 0x7fb3680051c0 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb36800c260 con 0x7fb3680039b0 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 0x7fb368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb382991640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3680051c0 0x7fb36800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb382190640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3680039b0 0x7fb368003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 -- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3680039b0 msgr2=0x7fb368003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb3680039b0 0x7fb368003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 -- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3680051c0 msgr2=0x7fb36800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3680051c0 0x7fb36800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb38198f640 1 -- 172.21.15.80:0/3304210070 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb368003520 con 0x7fb368004800 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.012+0000 7fb382991640 1 -- 172.21.15.80:0/3304210070 reap_dead start 2024-04-16T15:35:46.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb38198f640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 0x7fb368004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009ac0 tx=0x7fb368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5c93fc907eb6f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c039070 con 0x7fb368004800 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c02c6b0 con 0x7fb368004800 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb38118e640 1 -- 172.21.15.80:0/3304210070 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c009690 con 0x7fb368004800 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb3843f4640 1 -- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 msgr2=0x7fb368004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.013+0000 7fb3843f4640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 0x7fb368004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009ac0 tx=0x7fb368005830 comp rx=0 tx=0).stop 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.014+0000 7fb3843f4640 1 -- 172.21.15.80:0/3304210070 shutdown_connections 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.014+0000 7fb3843f4640 1 --2- 172.21.15.80:0/3304210070 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb368004800 0x7fb368004c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.014+0000 7fb3843f4640 1 -- 172.21.15.80:0/3304210070 >> 172.21.15.80:0/3304210070 conn(0x7fb37c0d2550 msgr2=0x7fb37c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.014+0000 7fb3843f4640 1 -- 172.21.15.80:0/3304210070 shutdown_connections 2024-04-16T15:35:46.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.014+0000 7fb3843f4640 1 -- 172.21.15.80:0/3304210070 wait complete. 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 Processor -- start 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 -- start start 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb368004800 0x7fb37c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb37c0b5170 0x7fb37c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0cd070 con 0x7fb37c0b68a0 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.015+0000 7fb3843f4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0ccef0 con 0x7fb37c0b5170 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb3843f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c0cd1f0 con 0x7fb368004800 2024-04-16T15:35:46.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58712/0 (socket says 172.21.15.80:58712) 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 -- 172.21.15.80:0/495563535 learned_addr learned my addr 172.21.15.80:0/495563535 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382190640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb368004800 0x7fb37c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 -- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb368004800 msgr2=0x7fb37c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb38198f640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb37c0b5170 0x7fb37c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb368004800 0x7fb37c15ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 -- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb37c0b5170 msgr2=0x7fb37c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb37c0b5170 0x7fb37c0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 -- 172.21.15.80:0/495563535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0b56a0 con 0x7fb37c0b68a0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb382991640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0cccc0 tx=0x7fb374007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37400abc0 con 0x7fb37c0b68a0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374018070 con 0x7fb37c0b68a0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3740133f0 con 0x7fb37c0b68a0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c0b5980 con 0x7fb37c0b68a0 2024-04-16T15:35:46.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.016+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c0b5f40 con 0x7fb37c0b68a0 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.017+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c068a40 con 0x7fb37c0b68a0 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.018+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb374013590 con 0x7fb37c0b68a0 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.018+0000 7fb372ffd640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 0x7fb36006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.018+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fb37408bf90 con 0x7fb37c0b68a0 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.018+0000 7fb382190640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 0x7fb36006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:46.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.018+0000 7fb382190640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 0x7fb36006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb378000c00 tx=0x7fb378009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:46.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.023+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb37405a510 con 0x7fb37c0b68a0 2024-04-16T15:35:46.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.200+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb37c0b84d0 con 0x7fb37c0b68a0 2024-04-16T15:35:46.651 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:35:46.654 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:35:46.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.877+0000 7fb372ffd640 1 -- 172.21.15.80:0/495563535 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fb374059e10 con 0x7fb37c0b68a0 2024-04-16T15:35:46.877 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-16T15:35:46.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 msgr2=0x7fb36006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 0x7fb36006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb378000c00 tx=0x7fb378009040 comp rx=0 tx=0).stop 2024-04-16T15:35:46.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 msgr2=0x7fb37c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0cccc0 tx=0x7fb374007a90 comp rx=0 tx=0).stop 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 shutdown_connections 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb37c0b68a0 0x7fb37c0cbd30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb37c0b5170 0x7fb37c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb36006c8f0 0x7fb36006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 --2- 172.21.15.80:0/495563535 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb368004800 0x7fb37c15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 >> 172.21.15.80:0/495563535 conn(0x7fb37c0d2550 msgr2=0x7fb37c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 shutdown_connections 2024-04-16T15:35:46.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:46.880+0000 7fb3843f4640 1 -- 172.21.15.80:0/495563535 wait complete. 2024-04-16T15:35:46.901 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T15:35:47.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.008+0000 7f34be2d9640 1 Processor -- start 2024-04-16T15:35:47.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.008+0000 7f34be2d9640 1 -- start start 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34be2d9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34b80b3190 0x7f34b80d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34be2d9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b80ccba0 con 0x7f34b809b180 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34be2d9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b80d3210 con 0x7f34b80b2c00 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34be2d9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f34b80b2fe0 con 0x7f34b80b3190 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34b809b180 0x7f34b80d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36750/0 (socket says 172.21.15.80:36750) 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b77fe640 1 -- 172.21.15.80:0/2892296601 learned_addr learned my addr 172.21.15.80:0/2892296601 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:47.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316733194 0 0) 0x7f34b80ccba0 con 0x7f34b809b180 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34a0003520 con 0x7f34b809b180 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34bc876640 1 --2- 172.21.15.80:0/2892296601 >> v2:172.21.15.87:3300/0 conn(0x7f34b80b3190 0x7f34b80d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 901130619 0 0) 0x7f34a0003520 con 0x7f34b809b180 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 >> v2:172.21.15.87:3300/0 conn(0x7f34b80b3190 msgr2=0x7f34b80d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 --2- 172.21.15.80:0/2892296601 >> v2:172.21.15.87:3300/0 conn(0x7f34b80b3190 0x7f34b80d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 >> v1:172.21.15.87:6789/0 conn(0x7f34b80b2c00 legacy=0x7f34b809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b806d660 con 0x7f34b809b180 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f34ac001670 con 0x7f34b809b180 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 >> v1:172.21.15.80:6789/0 conn(0x7f34b809b180 legacy=0x7f34b80d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34a00039b0 0x7f34a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.009+0000 7f34b6ffd640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34a00051c0 0x7f34a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34a000c130 con 0x7f34a0004800 2024-04-16T15:35:47.013 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34a000c2e0 con 0x7f34a00051c0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34a000c4e0 con 0x7f34a00039b0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b7fff640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34a00039b0 0x7f34a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34bc876640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34a00051c0 0x7f34a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 -- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34a00039b0 msgr2=0x7f34a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34a00039b0 0x7f34a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 -- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34a00051c0 msgr2=0x7f34a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34a00051c0 0x7f34a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34bc876640 1 -- 172.21.15.80:0/2892296601 reap_dead start 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.010+0000 7f34b77fe640 1 -- 172.21.15.80:0/2892296601 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a0003520 con 0x7f34a0004800 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34b77fe640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34a0004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c210 tx=0x7f34a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7080cdfe6ee17de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac007d30 con 0x7f34a0004800 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac030070 con 0x7f34a0004800 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34b6ffd640 1 -- 172.21.15.80:0/2892296601 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac005d70 con 0x7f34a0004800 2024-04-16T15:35:47.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 -- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 msgr2=0x7f34a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34a0004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00c210 tx=0x7f34a0005830 comp rx=0 tx=0).stop 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 -- 172.21.15.80:0/2892296601 shutdown_connections 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 --2- 172.21.15.80:0/2892296601 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34a0004c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 -- 172.21.15.80:0/2892296601 >> 172.21.15.80:0/2892296601 conn(0x7f34b80d2550 msgr2=0x7f34b80d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 -- 172.21.15.80:0/2892296601 shutdown_connections 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.011+0000 7f34be2d9640 1 -- 172.21.15.80:0/2892296601 wait complete. 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.012+0000 7f34be2d9640 1 Processor -- start 2024-04-16T15:35:47.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 -- start start 2024-04-16T15:35:47.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 0x7f34b80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 0x7f34b80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34b806dcb0 con 0x7f34a0004800 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80d1f70 con 0x7f34b80cc6b0 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34be2d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34b80d20f0 con 0x7f34b8151b60 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34b7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58722/0 (socket says 172.21.15.80:58722) 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.013+0000 7f34b7fff640 1 -- 172.21.15.80:0/1751033467 learned_addr learned my addr 172.21.15.80:0/1751033467 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b77fe640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 0x7f34b80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34bc876640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 0x7f34b80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 -- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 msgr2=0x7f34b80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 0x7f34b80cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 -- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 msgr2=0x7f34b80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 0x7f34b80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 -- 172.21.15.80:0/1751033467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b81f79f0 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b77fe640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 0x7f34b80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34bc876640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 0x7f34b80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b7fff640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34a800f620 tx=0x7f34a800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a80052e0 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a8018070 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b81f7cd0 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8003810 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.014+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81f8290 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.015+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b8068a40 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.016+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34a80039b0 con 0x7f34a0004800 2024-04-16T15:35:47.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.016+0000 7f34b4ff9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 0x7f34a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:47.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.016+0000 7f34b77fe640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 0x7f34a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:47.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.016+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f34a808b870 con 0x7f34a0004800 2024-04-16T15:35:47.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.016+0000 7f34b77fe640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 0x7f34a406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34ac034000 tx=0x7f34ac009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:47.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.021+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34a8059d90 con 0x7f34a0004800 2024-04-16T15:35:47.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.234+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f34b80b84d0 con 0x7f34a0004800 2024-04-16T15:35:47.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.896+0000 7f34b4ff9640 1 -- 172.21.15.80:0/1751033467 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f34a8059690 con 0x7f34a0004800 2024-04-16T15:35:47.898 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T15:35:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.904+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 msgr2=0x7f34a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.904+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 0x7f34a406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f34ac034000 tx=0x7f34ac009030 comp rx=0 tx=0).stop 2024-04-16T15:35:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.904+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 msgr2=0x7f34b8150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:47.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.904+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34a800f620 tx=0x7f34a800fae0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 shutdown_connections 2024-04-16T15:35:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b80cc6b0 0x7f34b80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34a406c8f0 0x7f34a406edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b8151b60 0x7f34b80cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 --2- 172.21.15.80:0/1751033467 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34a0004800 0x7f34b8150dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.906+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 >> 172.21.15.80:0/1751033467 conn(0x7f34b80d2550 msgr2=0x7f34b806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.907+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 shutdown_connections 2024-04-16T15:35:47.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:47.907+0000 7f34be2d9640 1 -- 172.21.15.80:0/1751033467 wait complete. 2024-04-16T15:35:47.929 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-16T15:35:47.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-16T15:35:48.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.042+0000 7f9c9a0f2640 1 Processor -- start 2024-04-16T15:35:48.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.042+0000 7f9c9a0f2640 1 -- start start 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c9a0f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 0x7f9c940cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c9a0f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9c9415cc70 0x7f9c9406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c9a0f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9406d2d0 con 0x7f9c94160260 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c9a0f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9c940ced50 con 0x7f9c9415cc70 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c9a0f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9415d3e0 con 0x7f9c9406c9b0 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c92ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9c9415cc70 0x7f9c9406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c93fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9c94160260 0x7f9c941606c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36760/0 (socket says 172.21.15.80:36760) 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c93fff640 1 -- 172.21.15.80:0/2542399461 learned_addr learned my addr 172.21.15.80:0/2542399461 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c92ffd640 1 -- 172.21.15.80:0/2542399461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 msgr2=0x7f9c940cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c937fe640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 0x7f9c940cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c927fc640 1 -- 172.21.15.80:0/2542399461 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706310710 0 0) 0x7f9c9406d2d0 con 0x7f9c94160260 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c92ffd640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 0x7f9c940cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c92ffd640 1 -- 172.21.15.80:0/2542399461 >> v1:172.21.15.80:6789/0 conn(0x7f9c94160260 legacy=0x7f9c941606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c92ffd640 1 -- 172.21.15.80:0/2542399461 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9415d6c0 con 0x7f9c9415cc70 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.043+0000 7f9c937fe640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 0x7f9c940cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.044+0000 7f9c92ffd640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c9406cd90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90f21d17cb16a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.044+0000 7f9c927fc640 1 -- 172.21.15.80:0/2542399461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88039070 con 0x7f9c9415cc70 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.044+0000 7f9c927fc640 1 -- 172.21.15.80:0/2542399461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8802cc50 con 0x7f9c9415cc70 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.044+0000 7f9c927fc640 1 -- 172.21.15.80:0/2542399461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88034440 con 0x7f9c9415cc70 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/2542399461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 msgr2=0x7f9c9406cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c9406cd90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802bea0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/2542399461 shutdown_connections 2024-04-16T15:35:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c9406cd90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/2542399461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c9406c9b0 0x7f9c940cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/2542399461 >> 172.21.15.80:0/2542399461 conn(0x7f9c940ce570 msgr2=0x7f9c94072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/2542399461 shutdown_connections 2024-04-16T15:35:48.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.045+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/2542399461 wait complete. 2024-04-16T15:35:48.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.046+0000 7f9c9a0f2640 1 Processor -- start 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.046+0000 7f9c9a0f2640 1 -- start start 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c9406c9b0 0x7f9c94150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 0x7f9c94155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c94160dd0 con 0x7f9c9415cc70 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9415d0f0 con 0x7f9c9406c9b0 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9c94160f50 con 0x7f9c94160260 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58746/0 (socket says 172.21.15.80:58746) 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 -- 172.21.15.80:0/1166736420 learned_addr learned my addr 172.21.15.80:0/1166736420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c93fff640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 0x7f9c94155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c937fe640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c9406c9b0 0x7f9c94150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 -- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 msgr2=0x7f9c94155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 0x7f9c94155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 -- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c9406c9b0 msgr2=0x7f9c94150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c9406c9b0 0x7f9c94150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 -- 172.21.15.80:0/1166736420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c941e6ef0 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c93fff640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 0x7f9c94155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c92ffd640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c88037040 tx=0x7f9c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88039050 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c88045070 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.047+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c941e71d0 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.048+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8803e850 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.048+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c94158bf0 con 0x7f9c9415cc70 2024-04-16T15:35:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.049+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c94068a40 con 0x7f9c9415cc70 2024-04-16T15:35:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.049+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c8802cb10 con 0x7f9c9415cc70 2024-04-16T15:35:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.049+0000 7f9c7bfff640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 0x7f9c8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.049+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9c880ae670 con 0x7f9c9415cc70 2024-04-16T15:35:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.049+0000 7f9c937fe640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 0x7f9c8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.050+0000 7f9c937fe640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 0x7f9c8006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c940cceb0 tx=0x7f9c84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.054+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c8807cb30 con 0x7f9c9415cc70 2024-04-16T15:35:48.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.238+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9c9406d180 con 0x7f9c9415cc70 2024-04-16T15:35:48.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.901+0000 7f9c7bfff640 1 -- 172.21.15.80:0/1166736420 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f9c8807c430 con 0x7f9c9415cc70 2024-04-16T15:35:48.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.904+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 msgr2=0x7f9c8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.904+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 0x7f9c8006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c940cceb0 tx=0x7f9c84008040 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 msgr2=0x7f9c941559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c88037040 tx=0x7f9c88004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 shutdown_connections 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9c8006c8f0 0x7f9c8006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c94160260 0x7f9c94155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c9415cc70 0x7f9c941559d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 --2- 172.21.15.80:0/1166736420 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c9406c9b0 0x7f9c94150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 >> 172.21.15.80:0/1166736420 conn(0x7f9c940ce570 msgr2=0x7f9c941606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 shutdown_connections 2024-04-16T15:35:48.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:48.905+0000 7f9c9a0f2640 1 -- 172.21.15.80:0/1166736420 wait complete. 2024-04-16T15:35:48.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T15:35:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.035+0000 7f93f1e4a640 1 Processor -- start 2024-04-16T15:35:49.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.035+0000 7f93f1e4a640 1 -- start start 2024-04-16T15:35:49.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93f1e4a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93ec1623f0 0x7f93ec070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93f1e4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0710d0 0x7f93ec0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93f1e4a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0d16a0 con 0x7f93ec15ea80 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93f1e4a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0d1980 con 0x7f93ec1623f0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93f1e4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0700b0 con 0x7f93ec0710d0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93ec1623f0 0x7f93ec070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f93ec1623f0 0x7f93ec070b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58750/0 (socket says 172.21.15.80:58750) 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 -- 172.21.15.80:0/4157360188 learned_addr learned my addr 172.21.15.80:0/4157360188 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eaffd640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0710d0 0x7f93ec0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 -- 172.21.15.80:0/4157360188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0710d0 msgr2=0x7f93ec0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0710d0 0x7f93ec0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 -- 172.21.15.80:0/4157360188 >> v1:172.21.15.80:6789/0 conn(0x7f93ec15ea80 legacy=0x7f93ec1627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93eb7fe640 1 -- 172.21.15.80:0/4157360188 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec070390 con 0x7f93ec1623f0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.036+0000 7f93ea7fc640 1 -- 172.21.15.80:0/4157360188 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141672636 0 0) 0x7f93ec0d16a0 con 0x7f93ec15ea80 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.037+0000 7f93eb7fe640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec1623f0 0x7f93ec070b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009e50 tx=0x7f93dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe02932cbe1268b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:49.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.037+0000 7f93ea7fc640 1 -- 172.21.15.80:0/4157360188 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc02ca70 con 0x7f93ec1623f0 2024-04-16T15:35:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.037+0000 7f93ea7fc640 1 -- 172.21.15.80:0/4157360188 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc02cc10 con 0x7f93ec1623f0 2024-04-16T15:35:49.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.037+0000 7f93ea7fc640 1 -- 172.21.15.80:0/4157360188 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0343f0 con 0x7f93ec1623f0 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 -- 172.21.15.80:0/4157360188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec1623f0 msgr2=0x7f93ec070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec1623f0 0x7f93ec070b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009e50 tx=0x7f93dc02bed0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 -- 172.21.15.80:0/4157360188 shutdown_connections 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec0710d0 0x7f93ec0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/4157360188 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec1623f0 0x7f93ec070b90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 -- 172.21.15.80:0/4157360188 >> 172.21.15.80:0/4157360188 conn(0x7f93ec0b3fa0 msgr2=0x7f93ec0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 -- 172.21.15.80:0/4157360188 shutdown_connections 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.038+0000 7f93f1e4a640 1 -- 172.21.15.80:0/4157360188 wait complete. 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.039+0000 7f93f1e4a640 1 Processor -- start 2024-04-16T15:35:49.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.039+0000 7f93f1e4a640 1 -- start start 2024-04-16T15:35:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec15ea80 0x7f93ec0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec1623f0 0x7f93ec161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0b1ba0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0b1a20 con 0x7f93ec15ea80 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93f1e4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec162ee0 con 0x7f93ec1623f0 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58762/0 (socket says 172.21.15.80:58762) 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 -- 172.21.15.80:0/573979525 learned_addr learned my addr 172.21.15.80:0/573979525 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93eaffd640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec1623f0 0x7f93ec161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93eb7fe640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec15ea80 0x7f93ec0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 -- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec1623f0 msgr2=0x7f93ec161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec1623f0 0x7f93ec161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 -- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec15ea80 msgr2=0x7f93ec0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.040+0000 7f93ebfff640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec15ea80 0x7f93ec0c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:49.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93ebfff640 1 -- 172.21.15.80:0/573979525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0c76e0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93ebfff640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c440 tx=0x7f93e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4017070 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e40035f0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec0c79c0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40039e0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.041+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec0c7f80 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.042+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec069560 con 0x7f93ec0c8a70 2024-04-16T15:35:49.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.042+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93e401a070 con 0x7f93ec0c8a70 2024-04-16T15:35:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.043+0000 7f93d3fff640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 0x7f93d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.043+0000 7f93eb7fe640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 0x7f93d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.043+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f93e408afb0 con 0x7f93ec0c8a70 2024-04-16T15:35:49.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.043+0000 7f93eb7fe640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 0x7f93d806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93dc035000 tx=0x7f93dc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:49.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.047+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93ec069560 con 0x7f93ec0c8a70 2024-04-16T15:35:49.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:49.224+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f93ec068a40 con 0x7f93ec0c8a70 2024-04-16T15:35:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.916+0000 7f93d3fff640 1 -- 172.21.15.80:0/573979525 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f93e4058c60 con 0x7f93ec0c8a70 2024-04-16T15:35:50.916 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' created 2024-04-16T15:35:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 msgr2=0x7f93d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 0x7f93d806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93dc035000 tx=0x7f93dc030000 comp rx=0 tx=0).stop 2024-04-16T15:35:50.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 msgr2=0x7f93ec1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c440 tx=0x7f93e400c900 comp rx=0 tx=0).stop 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 shutdown_connections 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f93ec0c8a70 0x7f93ec1565d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f93d806c8f0 0x7f93d806edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f93ec1623f0 0x7f93ec161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 --2- 172.21.15.80:0/573979525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93ec15ea80 0x7f93ec0c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 >> 172.21.15.80:0/573979525 conn(0x7f93ec0b3fa0 msgr2=0x7f93ec0b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 shutdown_connections 2024-04-16T15:35:50.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:50.920+0000 7f93f1e4a640 1 -- 172.21.15.80:0/573979525 wait complete. 2024-04-16T15:35:50.938 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-16T15:35:51.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.050+0000 7fead6f04640 1 Processor -- start 2024-04-16T15:35:51.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.050+0000 7fead6f04640 1 -- start start 2024-04-16T15:35:51.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead6f04640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead6f04640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fead00cf270 0x7fead00cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead6f04640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead015ffe0 con 0x7fead015fc00 2024-04-16T15:35:51.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead6f04640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fead00d1a60 con 0x7fead00cf270 2024-04-16T15:35:51.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead6f04640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fead00d31e0 con 0x7fead00d10c0 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fead00cf270 0x7fead00cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fead00cf270 0x7fead00cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58774/0 (socket says 172.21.15.80:58774) 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 -- 172.21.15.80:0/1671197603 learned_addr learned my addr 172.21.15.80:0/1671197603 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7feacffff640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 -- 172.21.15.80:0/1671197603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 msgr2=0x7fead00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 -- 172.21.15.80:0/1671197603 >> v1:172.21.15.87:6789/0 conn(0x7fead015fc00 legacy=0x7fead00d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.051+0000 7fead54a1640 1 -- 172.21.15.80:0/1671197603 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead00d3670 con 0x7fead00cf270 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.052+0000 7fead54a1640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00cf700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feac8009e50 tx=0x7feac802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18421d74d82fbd5b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.052+0000 7feacf7fe640 1 -- 172.21.15.80:0/1671197603 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac802cb00 con 0x7fead00cf270 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.052+0000 7feacf7fe640 1 -- 172.21.15.80:0/1671197603 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac802cca0 con 0x7fead00cf270 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.052+0000 7feacf7fe640 1 -- 172.21.15.80:0/1671197603 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8034610 con 0x7fead00cf270 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 -- 172.21.15.80:0/1671197603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 msgr2=0x7fead00cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00cf700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feac8009e50 tx=0x7feac802bf60 comp rx=0 tx=0).stop 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 -- 172.21.15.80:0/1671197603 shutdown_connections 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00cf700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 --2- 172.21.15.80:0/1671197603 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 -- 172.21.15.80:0/1671197603 >> 172.21.15.80:0/1671197603 conn(0x7fead008c000 msgr2=0x7fead00d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 -- 172.21.15.80:0/1671197603 shutdown_connections 2024-04-16T15:35:51.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.053+0000 7fead6f04640 1 -- 172.21.15.80:0/1671197603 wait complete. 2024-04-16T15:35:51.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.054+0000 7fead6f04640 1 Processor -- start 2024-04-16T15:35:51.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.054+0000 7fead6f04640 1 -- start start 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead015fc00 0x7fead015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fead00d28b0 con 0x7fead00cf270 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fead00d2330 con 0x7fead015fc00 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead6f04640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fead00d2b90 con 0x7fead00d10c0 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58786/0 (socket says 172.21.15.80:58786) 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 -- 172.21.15.80:0/1477270580 learned_addr learned my addr 172.21.15.80:0/1477270580 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead54a1640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead015fc00 0x7fead015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7feacffff640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 -- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 msgr2=0x7fead00cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 -- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead015fc00 msgr2=0x7fead015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead015fc00 0x7fead015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.055+0000 7fead4ca0640 1 -- 172.21.15.80:0/1477270580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead00c82f0 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7fead4ca0640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feac000c3c0 tx=0x7feac000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00052d0 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac0005490 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac0007260 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead00cc950 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.056+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead00c8870 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.057+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead0068a40 con 0x7fead00cf270 2024-04-16T15:35:51.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.057+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feac0007400 con 0x7fead00cf270 2024-04-16T15:35:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.058+0000 7feacd7fa640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 0x7feabc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.058+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7feac008b2c0 con 0x7fead00cf270 2024-04-16T15:35:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.058+0000 7feacffff640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 0x7feabc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:51.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.058+0000 7feacffff640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 0x7feabc06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fead00c9f40 tx=0x7feac4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:51.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.062+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fead015ffe0 con 0x7fead00cf270 2024-04-16T15:35:51.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.237+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fead00d1d10 con 0x7fead00cf270 2024-04-16T15:35:51.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.921+0000 7feacd7fa640 1 -- 172.21.15.80:0/1477270580 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7feac0058d80 con 0x7fead00cf270 2024-04-16T15:35:51.921 INFO:teuthology.orchestra.run.smithi080.stderr:set pool 4 allow_ec_overwrites to true 2024-04-16T15:35:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 msgr2=0x7feabc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 0x7feabc06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fead00c9f40 tx=0x7feac4008040 comp rx=0 tx=0).stop 2024-04-16T15:35:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 msgr2=0x7fead00b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:51.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feac000c3c0 tx=0x7feac000c880 comp rx=0 tx=0).stop 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 shutdown_connections 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fead015fc00 0x7fead015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feabc06c8f0 0x7feabc06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fead00d10c0 0x7fead00cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 --2- 172.21.15.80:0/1477270580 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fead00cf270 0x7fead00b4f40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:51.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.925+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 >> 172.21.15.80:0/1477270580 conn(0x7fead008c000 msgr2=0x7fead006dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:51.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.926+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 shutdown_connections 2024-04-16T15:35:51.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:51.926+0000 7fead6f04640 1 -- 172.21.15.80:0/1477270580 wait complete. 2024-04-16T15:35:51.951 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-16T15:35:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.058+0000 7f4609a47640 1 Processor -- start 2024-04-16T15:35:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.058+0000 7f4609a47640 1 -- start start 2024-04-16T15:35:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f460415e7a0 0x7f46040cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46040b3870 0x7f46040d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46040d1bc0 0x7f4604162300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f46040d2030 con 0x7f46040d1bc0 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f460415eb80 con 0x7f460415e7a0 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4609a47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f46040d32a0 con 0x7f46040b3870 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46040d1bc0 0x7f4604162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f46040d1bc0 0x7f4604162300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58788/0 (socket says 172.21.15.80:58788) 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 -- 172.21.15.80:0/2195649013 learned_addr learned my addr 172.21.15.80:0/2195649013 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f45fa7fc640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46040b3870 0x7f46040d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f4602ffd640 1 --2- 172.21.15.80:0/2195649013 >> v2:172.21.15.87:3300/0 conn(0x7f460415e7a0 0x7f46040cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 -- 172.21.15.80:0/2195649013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46040b3870 msgr2=0x7f46040d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:52.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46040b3870 0x7f46040d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 -- 172.21.15.80:0/2195649013 >> v2:172.21.15.87:3300/0 conn(0x7f460415e7a0 msgr2=0x7f46040cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 --2- 172.21.15.80:0/2195649013 >> v2:172.21.15.87:3300/0 conn(0x7f460415e7a0 0x7f46040cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.059+0000 7f46037fe640 1 -- 172.21.15.80:0/2195649013 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46040d3580 con 0x7f46040d1bc0 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f46037fe640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f4604162300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46040b67f0 tx=0x7f45fc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c511c6431581f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f46027fc640 1 -- 172.21.15.80:0/2195649013 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc02ca70 con 0x7f46040d1bc0 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f46027fc640 1 -- 172.21.15.80:0/2195649013 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc02cc10 con 0x7f46040d1bc0 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f46027fc640 1 -- 172.21.15.80:0/2195649013 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0343f0 con 0x7f46040d1bc0 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 -- 172.21.15.80:0/2195649013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 msgr2=0x7f4604162300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:52.062 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f4604162300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46040b67f0 tx=0x7f45fc02bed0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 -- 172.21.15.80:0/2195649013 shutdown_connections 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f4604162300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 --2- 172.21.15.80:0/2195649013 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f46040b3870 0x7f46040d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.060+0000 7f4609a47640 1 --2- 172.21.15.80:0/2195649013 >> v2:172.21.15.87:3300/0 conn(0x7f460415e7a0 0x7f46040cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.061+0000 7f4609a47640 1 -- 172.21.15.80:0/2195649013 >> 172.21.15.80:0/2195649013 conn(0x7f46040734f0 msgr2=0x7f4604073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.061+0000 7f4609a47640 1 -- 172.21.15.80:0/2195649013 shutdown_connections 2024-04-16T15:35:52.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.061+0000 7f4609a47640 1 -- 172.21.15.80:0/2195649013 wait complete. 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.062+0000 7f4609a47640 1 Processor -- start 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.062+0000 7f4609a47640 1 -- start start 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.062+0000 7f4609a47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 0x7f46041f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.062+0000 7f4609a47640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.062+0000 7f4609a47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f460415e7a0 0x7f46040cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4609a47640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f46040d3e20 con 0x7f46040d1bc0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4609a47640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f46040d3b40 con 0x7f46040b3870 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4609a47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f46040b7720 con 0x7f460415e7a0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58800/0 (socket says 172.21.15.80:58800) 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 -- 172.21.15.80:0/1204720873 learned_addr learned my addr 172.21.15.80:0/1204720873 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f46037fe640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f460415e7a0 0x7f46040cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4602ffd640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 0x7f46041f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 -- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f460415e7a0 msgr2=0x7f46040cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f460415e7a0 0x7f46040cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 -- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 msgr2=0x7f46041f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 0x7f46041f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 -- 172.21.15.80:0/1204720873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46040cdba0 con 0x7f46040d1bc0 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4602ffd640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 0x7f46041f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:52.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f45fa7fc640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d830 tx=0x7f45ec00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec018020 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0096a0 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46040cde80 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec009a70 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.063+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46041f3d60 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.064+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4604068a40 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.065+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45ec01b020 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.065+0000 7f4600ff9640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 0x7f45e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.065+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f45ec08c1a0 con 0x7f46040d1bc0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.065+0000 7f4602ffd640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 0x7f45e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:52.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.066+0000 7f4602ffd640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 0x7f45e406edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006fd0 tx=0x7f45f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:52.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.070+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45ec022030 con 0x7f46040d1bc0 2024-04-16T15:35:52.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.283+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f460406bba0 con 0x7f46040d1bc0 2024-04-16T15:35:52.818 INFO:tasks.ceph.mds.b.smithi087.stderr:2024-04-16T15:35:52.819+0000 7ff7be99e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:35:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.923+0000 7f4600ff9640 1 -- 172.21.15.80:0/1204720873 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f45ec009e20 con 0x7f46040d1bc0 2024-04-16T15:35:52.922 INFO:teuthology.orchestra.run.smithi080.stderr:added data pool 4 to fsmap 2024-04-16T15:35:52.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 msgr2=0x7f45e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 0x7f45e406edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006fd0 tx=0x7f45f4008040 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 msgr2=0x7f46040cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00d830 tx=0x7f45ec00dcf0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 shutdown_connections 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f45e406c8f0 0x7f45e406edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f460415e7a0 0x7f46040cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46040d1bc0 0x7f46040cd1e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 --2- 172.21.15.80:0/1204720873 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46040b3870 0x7f46041f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 >> 172.21.15.80:0/1204720873 conn(0x7f46040734f0 msgr2=0x7f4604160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 shutdown_connections 2024-04-16T15:35:52.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:52.925+0000 7f4609a47640 1 -- 172.21.15.80:0/1204720873 wait complete. 2024-04-16T15:35:52.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:35:53.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.041+0000 7f34b84f2640 1 Processor -- start 2024-04-16T15:35:53.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.041+0000 7f34b84f2640 1 -- start start 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b84f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b00b7700 0x7f34b00d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b84f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34b00cf360 0x7f34b00cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b84f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b00b7ce0 con 0x7f34b015e780 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b84f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f34b00ba670 con 0x7f34b00cf360 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b84f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34b00b7fc0 con 0x7f34b00b7700 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b628e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f34b015e780 0x7f34b00b9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36782/0 (socket says 172.21.15.80:36782) 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b628e640 1 -- 172.21.15.80:0/336417864 learned_addr learned my addr 172.21.15.80:0/336417864 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b6a8f640 1 --2- 172.21.15.80:0/336417864 >> v2:172.21.15.80:3300/0 conn(0x7f34b00cf360 0x7f34b00cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b528c640 1 -- 172.21.15.80:0/336417864 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552386946 0 0) 0x7f34b00b7ce0 con 0x7f34b015e780 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b5a8d640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b00b7700 0x7f34b00d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.042+0000 7f34b528c640 1 -- 172.21.15.80:0/336417864 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349c003520 con 0x7f34b015e780 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b6a8f640 1 -- 172.21.15.80:0/336417864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b00b7700 msgr2=0x7f34b00d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b6a8f640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b00b7700 0x7f34b00d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b6a8f640 1 -- 172.21.15.80:0/336417864 >> v1:172.21.15.80:6789/0 conn(0x7f34b015e780 legacy=0x7f34b00b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b6a8f640 1 -- 172.21.15.80:0/336417864 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b00b82a0 con 0x7f34b00cf360 2024-04-16T15:35:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b6a8f640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00cf7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecaf0be3fdb73ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b528c640 1 -- 172.21.15.80:0/336417864 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8039070 con 0x7f34b00cf360 2024-04-16T15:35:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b528c640 1 -- 172.21.15.80:0/336417864 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a802cce0 con 0x7f34b00cf360 2024-04-16T15:35:53.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.043+0000 7f34b528c640 1 -- 172.21.15.80:0/336417864 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8034660 con 0x7f34b00cf360 2024-04-16T15:35:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 -- 172.21.15.80:0/336417864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 msgr2=0x7f34b00cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00cf7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802bf30 comp rx=0 tx=0).stop 2024-04-16T15:35:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 -- 172.21.15.80:0/336417864 shutdown_connections 2024-04-16T15:35:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00cf7c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 --2- 172.21.15.80:0/336417864 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b00b7700 0x7f34b00d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 -- 172.21.15.80:0/336417864 >> 172.21.15.80:0/336417864 conn(0x7f34b00734f0 msgr2=0x7f34b0073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 -- 172.21.15.80:0/336417864 shutdown_connections 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.044+0000 7f34b84f2640 1 -- 172.21.15.80:0/336417864 wait complete. 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.045+0000 7f34b84f2640 1 Processor -- start 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.045+0000 7f34b84f2640 1 -- start start 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 0x7f34b0154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b015e780 0x7f34b015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34b00cfd00 con 0x7f34b00cf360 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34b00b8860 con 0x7f34b00b7700 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b84f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34b015eb60 con 0x7f34b015e780 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58808/0 (socket says 172.21.15.80:58808) 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 -- 172.21.15.80:0/3914389026 learned_addr learned my addr 172.21.15.80:0/3914389026 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:53.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b6a8f640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b015e780 0x7f34b015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b628e640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 0x7f34b0154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 -- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b015e780 msgr2=0x7f34b015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b015e780 0x7f34b015b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 -- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 msgr2=0x7f34b0154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 0x7f34b0154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 -- 172.21.15.80:0/3914389026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b00c8c30 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b628e640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 0x7f34b0154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.046+0000 7f34b5a8d640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34a000d800 tx=0x7f34a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000b6c0 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a0019070 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b00c8f10 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ba80 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b00c94d0 con 0x7f34b00cf360 2024-04-16T15:35:53.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.047+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b0068a40 con 0x7f34b00cf360 2024-04-16T15:35:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.048+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34a000bc20 con 0x7f34b00cf360 2024-04-16T15:35:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.048+0000 7f34a6ffd640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 0x7f349406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.049+0000 7f34b628e640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 0x7f349406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.049+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f34a008c230 con 0x7f34b00cf360 2024-04-16T15:35:53.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.049+0000 7f34b628e640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 0x7f349406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34ac007fd0 tx=0x7f34ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.053+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34a005a3b0 con 0x7f34b00cf360 2024-04-16T15:35:53.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.266+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34b01612e0 con 0x7f34b00cf360 2024-04-16T15:35:53.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.266+0000 7f34a6ffd640 1 -- 172.21.15.80:0/3914389026 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f34a0059cb0 con 0x7f34b00cf360 2024-04-16T15:35:53.266 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:53.266 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:35:52.285985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:35:53.266 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 msgr2=0x7f349406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 0x7f349406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34ac007fd0 tx=0x7f34ac009040 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 msgr2=0x7f34b00c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34a000d800 tx=0x7f34a000dcc0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 shutdown_connections 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f349406c920 0x7f349406ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34b015e780 0x7f34b015b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34b00cf360 0x7f34b00c99f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 --2- 172.21.15.80:0/3914389026 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34b00b7700 0x7f34b0154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 >> 172.21.15.80:0/3914389026 conn(0x7f34b00734f0 msgr2=0x7f34b015c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 shutdown_connections 2024-04-16T15:35:53.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.268+0000 7f34b84f2640 1 -- 172.21.15.80:0/3914389026 wait complete. 2024-04-16T15:35:53.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:53.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.383+0000 7f68ac6d9640 1 Processor -- start 2024-04-16T15:35:53.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.383+0000 7f68ac6d9640 1 -- start start 2024-04-16T15:35:53.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68ac6d9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68a40b4d80 0x7f68a40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68ac6d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 0x7f68a406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68ac6d9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40b3960 con 0x7f68a415ecc0 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68ac6d9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f68a409be20 con 0x7f68a40b4d80 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68ac6d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f68a40b3c00 con 0x7f68a40b2750 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68a9c74640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f68a40b4d80 0x7f68a40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68aa475640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f68a415ecc0 0x7f68a40b1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36786/0 (socket says 172.21.15.80:36786) 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68aa475640 1 -- 172.21.15.80:0/4199991511 learned_addr learned my addr 172.21.15.80:0/4199991511 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68aac76640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 0x7f68a406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68a9c74640 1 -- 172.21.15.80:0/4199991511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 msgr2=0x7f68a406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68a9c74640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 0x7f68a406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68a9c74640 1 -- 172.21.15.80:0/4199991511 >> v1:172.21.15.80:6789/0 conn(0x7f68a415ecc0 legacy=0x7f68a40b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.384+0000 7f68a9473640 1 -- 172.21.15.80:0/4199991511 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510473709 0 0) 0x7f68a40b3960 con 0x7f68a415ecc0 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68a9c74640 1 -- 172.21.15.80:0/4199991511 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a409b620 con 0x7f68a40b4d80 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68aac76640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 0x7f68a406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:53.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68a9c74640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40b2210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68940097a0 tx=0x7f689402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa661c5c220b5b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68a9473640 1 -- 172.21.15.80:0/4199991511 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894034070 con 0x7f68a40b4d80 2024-04-16T15:35:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68a9473640 1 -- 172.21.15.80:0/4199991511 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6894030610 con 0x7f68a40b4d80 2024-04-16T15:35:53.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.385+0000 7f68a9473640 1 -- 172.21.15.80:0/4199991511 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68940309e0 con 0x7f68a40b4d80 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4199991511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 msgr2=0x7f68a40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40b2210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68940097a0 tx=0x7f689402b960 comp rx=0 tx=0).stop 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4199991511 shutdown_connections 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a40b2750 0x7f68a406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4199991511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40b2210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4199991511 >> 172.21.15.80:0/4199991511 conn(0x7f68a40b4030 msgr2=0x7f68a40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4199991511 shutdown_connections 2024-04-16T15:35:53.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.386+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4199991511 wait complete. 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.387+0000 7f68ac6d9640 1 Processor -- start 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.387+0000 7f68ac6d9640 1 -- start start 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a40b2750 0x7f68a40c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 0x7f68a41509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40d1450 con 0x7f68a40b4d80 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f68a415f0a0 con 0x7f68a40b2750 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68ac6d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f68a40d15d0 con 0x7f68a415ecc0 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58840/0 (socket says 172.21.15.80:58840) 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 -- 172.21.15.80:0/4001058724 learned_addr learned my addr 172.21.15.80:0/4001058724 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68aac76640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 0x7f68a41509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68aa475640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a40b2750 0x7f68a40c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 -- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 msgr2=0x7f68a41509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 0x7f68a41509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 -- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a40b2750 msgr2=0x7f68a40c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a40b2750 0x7f68a40c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 -- 172.21.15.80:0/4001058724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40c64d0 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68aac76640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 0x7f68a41509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.388+0000 7f68a9c74640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6894009890 tx=0x7f68940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.389+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894034040 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.389+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6894039a10 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.389+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a40c67b0 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.389+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894039de0 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.389+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a40c6d70 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.390+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a4068a40 con 0x7f68a40b4d80 2024-04-16T15:35:53.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.390+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6894037070 con 0x7f68a40b4d80 2024-04-16T15:35:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.390+0000 7f689affd640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 0x7f688806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.391+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f68940adf60 con 0x7f68a40b4d80 2024-04-16T15:35:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.391+0000 7f68aa475640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 0x7f688806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.391+0000 7f68aa475640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 0x7f688806ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f60 tx=0x7f68a0007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.395+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f689407c050 con 0x7f68a40b4d80 2024-04-16T15:35:53.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.575+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68a415dd70 con 0x7f68a40b4d80 2024-04-16T15:35:53.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.576+0000 7f689affd640 1 -- 172.21.15.80:0/4001058724 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18467 (secure 0 0 0) 0x7f689407b950 con 0x7f68a40b4d80 2024-04-16T15:35:53.576 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:53.576 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:52.285790+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:53.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 msgr2=0x7f688806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 0x7f688806ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f60 tx=0x7f68a0007c00 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 msgr2=0x7f68a40c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6894009890 tx=0x7f68940046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 shutdown_connections 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f688806c920 0x7f688806ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f68a415ecc0 0x7f68a41509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68a40b4d80 0x7f68a40c8800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 --2- 172.21.15.80:0/4001058724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68a40b2750 0x7f68a40c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 >> 172.21.15.80:0/4001058724 conn(0x7f68a40b4030 msgr2=0x7f68a415d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 shutdown_connections 2024-04-16T15:35:53.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.579+0000 7f68ac6d9640 1 -- 172.21.15.80:0/4001058724 wait complete. 2024-04-16T15:35:53.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.693+0000 7fcc169ba640 1 Processor -- start 2024-04-16T15:35:53.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.693+0000 7fcc169ba640 1 -- start start 2024-04-16T15:35:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc169ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 0x7fcc100b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc169ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc169ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc100b3960 con 0x7fcc100b4d80 2024-04-16T15:35:53.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc169ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1009be20 con 0x7fcc1015ecc0 2024-04-16T15:35:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc169ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fcc100b3c00 con 0x7fcc100b2750 2024-04-16T15:35:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc14f57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc14f57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:34450/0 (socket says 172.21.15.80:34450) 2024-04-16T15:35:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc0ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 0x7fcc100b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.694 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc14f57640 1 -- 172.21.15.80:0/3316343330 learned_addr learned my addr 172.21.15.80:0/3316343330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc14f57640 1 -- 172.21.15.80:0/3316343330 >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 msgr2=0x7fcc100b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:53.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.694+0000 7fcc14f57640 1 --2- 172.21.15.80:0/3316343330 >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 0x7fcc100b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc14f57640 1 -- 172.21.15.80:0/3316343330 >> v1:172.21.15.87:6789/0 conn(0x7fcc100b4d80 legacy=0x7fcc100b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc14f57640 1 -- 172.21.15.80:0/3316343330 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1009b620 con 0x7fcc100b2750 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc0ffff640 1 --2- 172.21.15.80:0/3316343330 >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 0x7fcc100b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc14f57640 1 --2- 172.21.15.80:0/3316343330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009e50 tx=0x7fcc0802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7912cc779e15195 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc0f7fe640 1 -- 172.21.15.80:0/3316343330 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0802cb90 con 0x7fcc100b2750 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc0f7fe640 1 -- 172.21.15.80:0/3316343330 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0802cd30 con 0x7fcc100b2750 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.695+0000 7fcc0f7fe640 1 -- 172.21.15.80:0/3316343330 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08034610 con 0x7fcc100b2750 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 -- 172.21.15.80:0/3316343330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 msgr2=0x7fcc1006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 --2- 172.21.15.80:0/3316343330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009e50 tx=0x7fcc0802bff0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 -- 172.21.15.80:0/3316343330 shutdown_connections 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 --2- 172.21.15.80:0/3316343330 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc100b2750 0x7fcc1006d070 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 --2- 172.21.15.80:0/3316343330 >> v2:172.21.15.87:3300/0 conn(0x7fcc1015ecc0 0x7fcc100b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 -- 172.21.15.80:0/3316343330 >> 172.21.15.80:0/3316343330 conn(0x7fcc100b4030 msgr2=0x7fcc100b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 -- 172.21.15.80:0/3316343330 shutdown_connections 2024-04-16T15:35:53.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.696+0000 7fcc169ba640 1 -- 172.21.15.80:0/3316343330 wait complete. 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.697+0000 7fcc169ba640 1 Processor -- start 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.697+0000 7fcc169ba640 1 -- start start 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc100b4d80 0x7fcc100c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc1015ecc0 0x7fcc10071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcc100d1450 con 0x7fcc100b2750 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1015f0a0 con 0x7fcc100b4d80 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc169ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fcc100d15d0 con 0x7fcc1015ecc0 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58846/0 (socket says 172.21.15.80:58846) 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 -- 172.21.15.80:0/133875986 learned_addr learned my addr 172.21.15.80:0/133875986 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc07fff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc100b4d80 0x7fcc100c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc14f57640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc1015ecc0 0x7fcc10071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.699 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 -- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc1015ecc0 msgr2=0x7fcc10071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc1015ecc0 0x7fcc10071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 -- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc100b4d80 msgr2=0x7fcc100c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc100b4d80 0x7fcc100c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.698+0000 7fcc0ffff640 1 -- 172.21.15.80:0/133875986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100c86f0 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc0ffff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000e990 tx=0x7fcc0000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00017070 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0000c9e0 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc100c68c0 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0000cdb0 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.699+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc100c6e80 con 0x7fcc100b2750 2024-04-16T15:35:53.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.700+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc10068a40 con 0x7fcc100b2750 2024-04-16T15:35:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.700+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc0001a070 con 0x7fcc100b2750 2024-04-16T15:35:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.700+0000 7fcc0d7fa640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 0x7fcbf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.701+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc0008bce0 con 0x7fcc100b2750 2024-04-16T15:35:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.701+0000 7fcc07fff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 0x7fcbf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:53.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.701+0000 7fcc07fff640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 0x7fcbf006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc101ebd60 tx=0x7fcbf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:53.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.706+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc00059e60 con 0x7fcc100b2750 2024-04-16T15:35:53.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.885+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc10069150 con 0x7fcc100b2750 2024-04-16T15:35:53.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.886+0000 7fcc0d7fa640 1 -- 172.21.15.80:0/133875986 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18467 (secure 0 0 0) 0x7fcc00059760 con 0x7fcc100b2750 2024-04-16T15:35:53.886 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:53.886 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":24,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:52.285790+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 msgr2=0x7fcbf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 0x7fcbf006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc101ebd60 tx=0x7fcbf8009040 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 msgr2=0x7fcc100c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000e990 tx=0x7fcc0000ee50 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 shutdown_connections 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcbf006c8f0 0x7fcbf006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcc1015ecc0 0x7fcc10071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc100b4d80 0x7fcc100c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 --2- 172.21.15.80:0/133875986 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcc100b2750 0x7fcc100c81b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 >> 172.21.15.80:0/133875986 conn(0x7fcc100b4030 msgr2=0x7fcc100b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:53.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 shutdown_connections 2024-04-16T15:35:53.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:53.888+0000 7fcc169ba640 1 -- 172.21.15.80:0/133875986 wait complete. 2024-04-16T15:35:53.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:35:54.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.032+0000 7f6ce7022640 1 Processor -- start 2024-04-16T15:35:54.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.032+0000 7f6ce7022640 1 -- start start 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce7022640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ce015c8e0 0x7f6ce009b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce7022640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce7022640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce00af300 con 0x7f6ce009b9c0 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce7022640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce00af570 con 0x7f6ce015c8e0 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce7022640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce00af850 con 0x7f6ce00d0e30 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce4dbe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6ce015c8e0 0x7f6ce009b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6cdffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6ce009b9c0 0x7f6ce00d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36794/0 (socket says 172.21.15.80:36794) 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6cdffff640 1 -- 172.21.15.80:0/569984335 learned_addr learned my addr 172.21.15.80:0/569984335 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.033+0000 7f6ce55bf640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/569984335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 msgr2=0x7f6ce00b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce4dbe640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/569984335 >> v1:172.21.15.80:6789/0 conn(0x7f6ce009b9c0 legacy=0x7f6ce00d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/569984335 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce00afb30 con 0x7f6ce015c8e0 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6cdf7fe640 1 -- 172.21.15.80:0/569984335 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515833726 0 0) 0x7f6ce00af300 con 0x7f6ce009b9c0 2024-04-16T15:35:54.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce55bf640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6ce4dbe640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce015c8e0 0x7f6ce009b480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097a0 tx=0x7f6cd002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ba073d239169f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6cdf7fe640 1 -- 172.21.15.80:0/569984335 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00315a0 con 0x7f6ce015c8e0 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.034+0000 7f6cdf7fe640 1 -- 172.21.15.80:0/569984335 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0037070 con 0x7f6ce015c8e0 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6cdf7fe640 1 -- 172.21.15.80:0/569984335 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0031960 con 0x7f6ce015c8e0 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 -- 172.21.15.80:0/569984335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce015c8e0 msgr2=0x7f6ce009b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce015c8e0 0x7f6ce009b480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00097a0 tx=0x7f6cd002b840 comp rx=0 tx=0).stop 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 -- 172.21.15.80:0/569984335 shutdown_connections 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 --2- 172.21.15.80:0/569984335 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce015c8e0 0x7f6ce009b480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 -- 172.21.15.80:0/569984335 >> 172.21.15.80:0/569984335 conn(0x7f6ce00b4030 msgr2=0x7f6ce00b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:54.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 -- 172.21.15.80:0/569984335 shutdown_connections 2024-04-16T15:35:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.035+0000 7f6ce7022640 1 -- 172.21.15.80:0/569984335 wait complete. 2024-04-16T15:35:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.036+0000 7f6ce7022640 1 Processor -- start 2024-04-16T15:35:54.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.036+0000 7f6ce7022640 1 -- start start 2024-04-16T15:35:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 0x7f6ce00718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00b1490 con 0x7f6ce009b9c0 2024-04-16T15:35:54.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce00ce2a0 con 0x7f6ce015c8e0 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce7022640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce009bf20 con 0x7f6ce00d0e30 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce4dbe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce4dbe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58868/0 (socket says 172.21.15.80:58868) 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/3350428447 learned_addr learned my addr 172.21.15.80:0/3350428447 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce55bf640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 0x7f6ce00718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6cdffff640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.037+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 msgr2=0x7f6ce00713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce4dbe640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 msgr2=0x7f6ce00718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce4dbe640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 0x7f6ce00718e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce4dbe640 1 -- 172.21.15.80:0/3350428447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce00c96b0 con 0x7f6ce009b9c0 2024-04-16T15:35:54.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce55bf640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 0x7f6ce00718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6cdffff640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce4dbe640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00098c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0032630 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd00327f0 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce00c9990 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0032be0 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.038+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce00c9f50 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.039+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce0068a40 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.039+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cd003b3f0 con 0x7f6ce009b9c0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.040+0000 7f6cdd7fa640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 0x7f6ccc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.040+0000 7f6cdffff640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 0x7f6ccc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.040+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6cd002f030 con 0x7f6ce009b9c0 2024-04-16T15:35:54.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.040+0000 7f6cdffff640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 0x7f6ccc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ce015bbd0 tx=0x7f6cd4007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.045+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6cd0040070 con 0x7f6ce009b9c0 2024-04-16T15:35:54.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.256+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ce00b0d40 con 0x7f6ce009b9c0 2024-04-16T15:35:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.256+0000 7f6cdd7fa640 1 -- 172.21.15.80:0/3350428447 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f6cd007be50 con 0x7f6ce009b9c0 2024-04-16T15:35:54.256 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:54.256 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:35:52.285985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:35:54.256 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 7 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 msgr2=0x7f6ccc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 0x7f6ccc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ce015bbd0 tx=0x7f6cd4007ca0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 msgr2=0x7f6ce01567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00098c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 shutdown_connections 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce015c8e0 0x7f6ce00718e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6ccc06c8f0 0x7f6ccc06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6ce00d0e30 0x7f6ce00713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 --2- 172.21.15.80:0/3350428447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6ce009b9c0 0x7f6ce01567d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 >> 172.21.15.80:0/3350428447 conn(0x7f6ce00b4030 msgr2=0x7f6ce009abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 shutdown_connections 2024-04-16T15:35:54.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.258+0000 7f6ce7022640 1 -- 172.21.15.80:0/3350428447 wait complete. 2024-04-16T15:35:54.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.372+0000 7f9d4b37c640 1 Processor -- start 2024-04-16T15:35:54.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.372+0000 7f9d4b37c640 1 -- start start 2024-04-16T15:35:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d4415ece0 0x7f9d4406d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d03f0 0x7f9d440d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d440d0d70 0x7f9d4409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440d1200 con 0x7f9d440d0d70 2024-04-16T15:35:54.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9d4406d800 con 0x7f9d4415ece0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d4b37c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4406dae0 con 0x7f9d440d03f0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d440d0d70 0x7f9d4409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f9d440d0d70 0x7f9d4409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58872/0 (socket says 172.21.15.80:58872) 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 -- 172.21.15.80:0/471409757 learned_addr learned my addr 172.21.15.80:0/471409757 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d48917640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d03f0 0x7f9d440d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49118640 1 --2- 172.21.15.80:0/471409757 >> v2:172.21.15.87:3300/0 conn(0x7f9d4415ece0 0x7f9d4406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 -- 172.21.15.80:0/471409757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d03f0 msgr2=0x7f9d440d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d03f0 0x7f9d440d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 -- 172.21.15.80:0/471409757 >> v2:172.21.15.87:3300/0 conn(0x7f9d4415ece0 msgr2=0x7f9d4406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 --2- 172.21.15.80:0/471409757 >> v2:172.21.15.87:3300/0 conn(0x7f9d4415ece0 0x7f9d4406d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.373+0000 7f9d49919640 1 -- 172.21.15.80:0/471409757 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4406ddc0 con 0x7f9d440d0d70 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.374+0000 7f9d49919640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d0d70 0x7f9d4409aa70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d44073540 tx=0x7f9d3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14decccc0cb34f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.374+0000 7f9d3bfff640 1 -- 172.21.15.80:0/471409757 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c02ca70 con 0x7f9d440d0d70 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.374+0000 7f9d3bfff640 1 -- 172.21.15.80:0/471409757 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c02cc10 con 0x7f9d440d0d70 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.374+0000 7f9d3bfff640 1 -- 172.21.15.80:0/471409757 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0343f0 con 0x7f9d440d0d70 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 -- 172.21.15.80:0/471409757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d0d70 msgr2=0x7f9d4409aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d0d70 0x7f9d4409aa70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d44073540 tx=0x7f9d3c02bed0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 -- 172.21.15.80:0/471409757 shutdown_connections 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d0d70 0x7f9d4409aa70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/471409757 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d03f0 0x7f9d440d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/471409757 >> v2:172.21.15.87:3300/0 conn(0x7f9d4415ece0 0x7f9d4406d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 -- 172.21.15.80:0/471409757 >> 172.21.15.80:0/471409757 conn(0x7f9d440d24f0 msgr2=0x7f9d440d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 -- 172.21.15.80:0/471409757 shutdown_connections 2024-04-16T15:35:54.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.375+0000 7f9d4b37c640 1 -- 172.21.15.80:0/471409757 wait complete. 2024-04-16T15:35:54.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.376+0000 7f9d4b37c640 1 Processor -- start 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.376+0000 7f9d4b37c640 1 -- start start 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 0x7f9d440c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 0x7f9d44161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4415f0c0 con 0x7f9d440d03f0 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4406e380 con 0x7f9d4415ece0 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4415f240 con 0x7f9d440d0d70 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58882/0 (socket says 172.21.15.80:58882) 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 -- 172.21.15.80:0/2125552457 learned_addr learned my addr 172.21.15.80:0/2125552457 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d48917640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 0x7f9d440c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49919640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 0x7f9d44161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 -- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 msgr2=0x7f9d440c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 0x7f9d440c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 -- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 msgr2=0x7f9d44161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 0x7f9d44161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 -- 172.21.15.80:0/2125552457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d44159ad0 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49919640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 0x7f9d44161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d48917640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 0x7f9d440c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d49118640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000d5f0 tx=0x7f9d4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d400125f0 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d40019070 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d44160bf0 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d400129d0 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.377+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d441611b0 con 0x7f9d440d03f0 2024-04-16T15:35:54.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.378+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d44068a40 con 0x7f9d440d03f0 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.379+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d40012b70 con 0x7f9d440d03f0 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.379+0000 7f9d39ffb640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 0x7f9d2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.379+0000 7f9d48917640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 0x7f9d2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.379+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d4008c1d0 con 0x7f9d440d03f0 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.380+0000 7f9d48917640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 0x7f9d2806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d4415e6f0 tx=0x7f9d34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:54.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.385+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d4005a2c0 con 0x7f9d440d03f0 2024-04-16T15:35:54.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.560+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d440cda80 con 0x7f9d440d03f0 2024-04-16T15:35:54.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.561+0000 7f9d39ffb640 1 -- 172.21.15.80:0/2125552457 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f9d40059bc0 con 0x7f9d440d03f0 2024-04-16T15:35:54.561 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:54.561 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.563+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 msgr2=0x7f9d2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.563+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 0x7f9d2806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d4415e6f0 tx=0x7f9d34008040 comp rx=0 tx=0).stop 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.563+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 msgr2=0x7f9d44159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.563+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000d5f0 tx=0x7f9d4000dab0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 shutdown_connections 2024-04-16T15:35:54.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d4415ece0 0x7f9d44161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9d2806c8f0 0x7f9d2806edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9d440d0d70 0x7f9d440c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 --2- 172.21.15.80:0/2125552457 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9d440d03f0 0x7f9d44159590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 >> 172.21.15.80:0/2125552457 conn(0x7f9d440d24f0 msgr2=0x7f9d440cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 shutdown_connections 2024-04-16T15:35:54.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:54.564+0000 7f9d4b37c640 1 -- 172.21.15.80:0/2125552457 wait complete. 2024-04-16T15:35:54.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T15:35:47.236177+0000', 'modified': '2024-04-16T15:35:52.285985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2875259766', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6833', 'nonce': 2875259766}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2875259766}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4299, 'qdb_cluster': [4299]} 2024-04-16T15:35:54.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T15:35:54.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-16T15:35:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.087+0000 7f4ffbf31640 1 Processor -- start 2024-04-16T15:35:55.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.087+0000 7f4ffbf31640 1 -- start start 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffbf31640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff40d0df0 0x7f4ff40d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffbf31640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ff406e5b0 0x7f4ff415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffbf31640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff40d1710 con 0x7f4ff4160430 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffbf31640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff415fb80 con 0x7f4ff406e5b0 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffbf31640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff415fe60 con 0x7f4ff40d0df0 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ff406e5b0 0x7f4ff415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4ff406e5b0 0x7f4ff415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42858/0 (socket says 172.21.15.80:42858) 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/1928158293 learned_addr learned my addr 172.21.15.80:0/1928158293 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff40d0df0 0x7f4ff40d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/1928158293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff40d0df0 msgr2=0x7f4ff40d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff40d0df0 0x7f4ff40d11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/1928158293 >> v1:172.21.15.87:6789/0 conn(0x7f4ff4160430 legacy=0x7f4ff406dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.088+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/1928158293 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff406d6a0 con 0x7f4ff406e5b0 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff406e5b0 0x7f4ff415ed60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009e50 tx=0x7f4fe402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311c8cf6ce63da13 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ff8ccb640 1 -- 172.21.15.80:0/1928158293 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe402ca70 con 0x7f4ff406e5b0 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ff8ccb640 1 -- 172.21.15.80:0/1928158293 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe402cc10 con 0x7f4ff406e5b0 2024-04-16T15:35:55.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ff8ccb640 1 -- 172.21.15.80:0/1928158293 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40343f0 con 0x7f4ff406e5b0 2024-04-16T15:35:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ffbf31640 1 -- 172.21.15.80:0/1928158293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff406e5b0 msgr2=0x7f4ff415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.089+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff406e5b0 0x7f4ff415ed60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009e50 tx=0x7f4fe402bed0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 -- 172.21.15.80:0/1928158293 shutdown_connections 2024-04-16T15:35:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff406e5b0 0x7f4ff415ed60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/1928158293 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff40d0df0 0x7f4ff40d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 -- 172.21.15.80:0/1928158293 >> 172.21.15.80:0/1928158293 conn(0x7f4ff40d24e0 msgr2=0x7f4ff40d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 -- 172.21.15.80:0/1928158293 shutdown_connections 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.090+0000 7f4ffbf31640 1 -- 172.21.15.80:0/1928158293 wait complete. 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 Processor -- start 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 -- start start 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff406e5b0 0x7f4ff40b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ff40d0df0 0x7f4ff40b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40d07b0 con 0x7f4ff4160430 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff406d350 con 0x7f4ff40d0df0 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.091+0000 7f4ffbf31640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40d0930 con 0x7f4ff406e5b0 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42870/0 (socket says 172.21.15.80:42870) 2024-04-16T15:35:55.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/3536509943 learned_addr learned my addr 172.21.15.80:0/3536509943 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff406e5b0 0x7f4ff40b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ff40d0df0 0x7f4ff40b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff406e5b0 msgr2=0x7f4ff40b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff406e5b0 0x7f4ff40b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ff40d0df0 msgr2=0x7f4ff40b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ff40d0df0 0x7f4ff40b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 -- 172.21.15.80:0/3536509943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40cc510 con 0x7f4ff4160430 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009e50 tx=0x7f4fe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ff27fc640 1 -- 172.21.15.80:0/3536509943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4043020 con 0x7f4ff4160430 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ff27fc640 1 -- 172.21.15.80:0/3536509943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe403e450 con 0x7f4ff4160430 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ff27fc640 1 -- 172.21.15.80:0/3536509943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4009510 con 0x7f4ff4160430 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff40b6c00 con 0x7f4ff4160430 2024-04-16T15:35:55.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.092+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff40b71c0 con 0x7f4ff4160430 2024-04-16T15:35:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.094+0000 7f4ff27fc640 1 -- 172.21.15.80:0/3536509943 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fe4046020 con 0x7f4ff4160430 2024-04-16T15:35:55.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.094+0000 7f4ff27fc640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 0x7f4fe006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.094+0000 7f4ff27fc640 1 -- 172.21.15.80:0/3536509943 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4fe40ae5d0 con 0x7f4ff4160430 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.094+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 0x7f4fe006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.095+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 0x7f4fe006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fec006fd0 tx=0x7f4fec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.095+0000 7f4ffebf1740 1 Processor -- start 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.095+0000 7f4ffebf1740 1 -- start start 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632eaa8b10 0x55632ead5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55632ea129c0 con 0x55632ead8af0 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55632e9b9650 con 0x55632eaa8b10 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55632ea0e980 con 0x55632eaac670 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42882/0 (socket says 172.21.15.80:42882) 2024-04-16T15:35:55.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/444127668 learned_addr learned my addr 172.21.15.80:0/444127668 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632eaa8b10 0x55632ead5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 msgr2=0x55632ead62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632eaa8b10 msgr2=0x55632ead5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632eaa8b10 0x55632ead5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/444127668 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55632e7252d0 con 0x55632ead8af0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.096+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007fd0 tx=0x7f4fec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1294ca32827a9ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/444127668 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec027070 con 0x55632ead8af0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/444127668 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec003820 con 0x55632ead8af0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/444127668 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec003bd0 con 0x55632ead8af0 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 -- 172.21.15.80:0/444127668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 msgr2=0x55632ead8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007fd0 tx=0x7f4fec013000 comp rx=0 tx=0).stop 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 -- 172.21.15.80:0/444127668 shutdown_connections 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632eaa8b10 0x55632ead5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/444127668 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632ead8ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 -- 172.21.15.80:0/444127668 >> 172.21.15.80:0/444127668 conn(0x55632eaaad80 msgr2=0x55632eaf3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 -- 172.21.15.80:0/444127668 shutdown_connections 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.097+0000 7f4ffebf1740 1 -- 172.21.15.80:0/444127668 wait complete. 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.098+0000 7f4ffebf1740 1 -- start start 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.098+0000 7f4ffebf1740 1 Processor -- start 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eadad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55632eaad820 con 0x55632ead8af0 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55632e9cca10 con 0x55632ead5080 2024-04-16T15:35:55.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55632eaacc10 con 0x55632eaac670 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffebf1740 10 client.0 _ll_register_callbacks cb 0x55632e9cc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42892/0 (socket says 172.21.15.80:42892) 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 -- 172.21.15.80:0/1829655137 learned_addr learned my addr 172.21.15.80:0/1829655137 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eadad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 -- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 msgr2=0x55632ead4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 -- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 msgr2=0x55632eadad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eadad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 -- 172.21.15.80:0/1829655137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55632e7ef6b0 con 0x55632ead8af0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8003ca0 tx=0x7f4fe80015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601644362b59046a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.099+0000 7f4fd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8007050 con 0x55632ead8af0 2024-04-16T15:35:55.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec003820 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4fe8010040 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4fe80071f0 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 10 client.4443 fetch_fsmap learned FSMap version 7 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55632eada500 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec003820 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f4fe8007390 con 0x55632ead8af0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 10 client.4443 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 20 client.4443 populate_metadata read hostname 'smithi080' 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eadd5c0 0x55632eadd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 4 client.4443 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 --> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55632ea203e0 con 0x55632eadd5c0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.100+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eadd5c0 0x55632eadd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4fd8ff9640 10 client.4443 ms_handle_connect on v2:172.21.15.87:6833/2875259766 2024-04-16T15:35:55.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eadd5c0 0x55632eadd9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db0f0cc805f96e7 server_cookie=a269f1732930db6 in_seq=0 out_seq=0 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/1829655137 <== mds.0 v2:172.21.15.87:6833/2875259766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55632ea203e0 con 0x55632eadd5c0 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4fd8ff9640 10 client.4443 handle_command_reply: tid=0 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 client.4443 shutdown 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 msgr2=0x55632eb04220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8003ca0 tx=0x7f4fe80015f0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 shutdown_connections 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eadd5c0 0x55632eadd9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eadad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.101+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead8af0 0x55632eb04220 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/1829655137 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632ead4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4fd8ff9640 0 client.4443 ms_handle_reset on v2:172.21.15.87:6833/2875259766 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 >> 172.21.15.80:0/1829655137 conn(0x55632eaa8b10 msgr2=0x55632eaad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 shutdown_connections 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4ffebf1740 1 -- 172.21.15.80:0/1829655137 wait complete. 2024-04-16T15:35:55.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.102+0000 7f4ffebf1740 20 client.4443 trim_cache size 0 max 16384 2024-04-16T15:35:55.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 Processor -- start 2024-04-16T15:35:55.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 -- start start 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632eaad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead8af0 0x55632ead9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4201440 con 0x55632ead5080 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff42007d0 con 0x55632ead8af0 2024-04-16T15:35:55.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.120+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff4200e20 con 0x55632eaac670 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42908/0 (socket says 172.21.15.80:42908) 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 -- 172.21.15.80:0/3790234429 learned_addr learned my addr 172.21.15.80:0/3790234429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead8af0 0x55632ead9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632eaad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 -- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 msgr2=0x55632eaad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632eaad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 -- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead8af0 msgr2=0x55632ead9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead8af0 0x55632ead9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 -- 172.21.15.80:0/3790234429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55632eaaa620 con 0x55632ead5080 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632eaad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8001040 tx=0x7f4fe8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614311b8ef7634d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4fdaffd640 1 -- 172.21.15.80:0/3790234429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8007390 con 0x55632ead5080 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4fdaffd640 1 -- 172.21.15.80:0/3790234429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8006aa0 con 0x55632ead5080 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.121+0000 7f4fdaffd640 1 -- 172.21.15.80:0/3790234429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8006e50 con 0x55632ead5080 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- 172.21.15.80:0/3790234429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 msgr2=0x55632ead9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8001040 tx=0x7f4fe8011000 comp rx=0 tx=0).stop 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- 172.21.15.80:0/3790234429 shutdown_connections 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead8af0 0x55632ead9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632ead5080 0x55632ead9900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/3790234429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632eaac670 0x55632eaad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- 172.21.15.80:0/3790234429 >> 172.21.15.80:0/3790234429 conn(0x55632eaa8b10 msgr2=0x55632eaf6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- 172.21.15.80:0/3790234429 shutdown_connections 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- 172.21.15.80:0/3790234429 wait complete. 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 -- start start 2024-04-16T15:35:55.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.122+0000 7f4ffebf1740 1 Processor -- start 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eb0e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632ead8af0 0x55632ead9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55632eadb240 con 0x55632eaac670 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55632eb04b60 con 0x55632ead5080 2024-04-16T15:35:55.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55632eadf330 con 0x55632ead8af0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffebf1740 10 client.0 _ll_register_callbacks cb 0x7f4fe8003900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42910/0 (socket says 172.21.15.80:42910) 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/779965148 learned_addr learned my addr 172.21.15.80:0/779965148 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ffa4ce640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632ead8af0 0x55632ead9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eb0e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632ead8af0 msgr2=0x55632ead9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632ead8af0 0x55632ead9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 msgr2=0x55632eb0e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eb0e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.123+0000 7f4ff9ccd640 1 -- 172.21.15.80:0/779965148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55632ead31c0 con 0x55632eaac670 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ff9ccd640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0041e0 tx=0x7f4fec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90fec29e477b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-16T15:35:55.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec027040 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4fec003cd0 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe8006aa0 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4fec041050 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 10 client.4449 fetch_fsmap learned FSMap version 7 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55632ead25b0 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8006aa0 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f4fec044020 con 0x55632eaac670 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 10 client.4449 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 20 client.4449 populate_metadata read hostname 'smithi080' 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eb6eb60 0x55632eb0cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 4 client.4449 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T15:35:55.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 --> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] -- command(tid 0: {"prefix": "status"}) -- 0x55632ea1a250 con 0x55632eb6eb60 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.124+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eb6eb60 0x55632eb0cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4fd8ff9640 10 client.4449 ms_handle_connect on v2:172.21.15.87:6833/2875259766 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ff94cc640 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eb6eb60 0x55632eb0cf30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d2cf957529a3626 server_cookie=1f18ad289dbe6a67 in_seq=0 out_seq=0 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4fd8ff9640 1 -- 172.21.15.80:0/779965148 <== mds.0 v2:172.21.15.87:6833/2875259766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55632ea1a250 con 0x55632eb6eb60 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4fd8ff9640 10 client.4449 handle_command_reply: tid=0 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 client.4449 shutdown 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 msgr2=0x55632eb6f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0041e0 tx=0x7f4fec004730 comp rx=0 tx=0).stop 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 shutdown_connections 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55632ead8af0 0x55632ead9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55632eb6eb60 0x55632eb0cf30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55632ead5080 0x55632eb0e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 --2- 172.21.15.80:0/779965148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55632eaac670 0x55632eb6f190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4fd8ff9640 0 client.4449 ms_handle_reset on v2:172.21.15.87:6833/2875259766 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 >> 172.21.15.80:0/779965148 conn(0x55632eaa8b10 msgr2=0x55632eaf3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 shutdown_connections 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 1 -- 172.21.15.80:0/779965148 wait complete. 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.125+0000 7f4ffebf1740 20 client.4449 trim_cache size 0 max 16384 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "a7d324ba-fc74-42df-88c0-3e8f3a7e8eab", 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4299, 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-16T15:35:55.131 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 7.2265958870000002, 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 7, 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 25, 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 23, 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 14.300882165999999 2024-04-16T15:35:55.132 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 msgr2=0x7f4fe006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 0x7f4fe006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fec006fd0 tx=0x7f4fec008040 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 msgr2=0x7f4ff40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009e50 tx=0x7f4fe4004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 shutdown_connections 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4ff4160430 0x7f4ff40b30d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ff40d0df0 0x7f4ff40b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fe006c8f0 0x7f4fe006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 --2- 172.21.15.80:0/3536509943 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4ff406e5b0 0x7f4ff40b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 >> 172.21.15.80:0/3536509943 conn(0x7f4ff40d24e0 msgr2=0x7f4ff40b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 shutdown_connections 2024-04-16T15:35:55.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.126+0000 7f4ffbf31640 1 -- 172.21.15.80:0/3536509943 wait complete. 2024-04-16T15:35:55.135 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:35:55.135 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:55.135 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:35:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 Processor -- start 2024-04-16T15:35:55.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 -- start start 2024-04-16T15:35:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f684c09b180 0x7f684c0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f684c0d13c0 con 0x7f684c0b1370 2024-04-16T15:35:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f684c15ee70 con 0x7f684c15ea90 2024-04-16T15:35:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f685179f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f684c06e7a0 con 0x7f684c09b180 2024-04-16T15:35:55.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.241+0000 7f6843fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f684c0b1370 0x7f684c09aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53568/0 (socket says 172.21.15.80:53568) 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f6843fff640 1 -- 172.21.15.80:0/1364519259 learned_addr learned my addr 172.21.15.80:0/1364519259 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f6850f9e640 1 --2- 172.21.15.80:0/1364519259 >> v2:172.21.15.87:3300/0 conn(0x7f684c09b180 0x7f684c0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972252342 0 0) 0x7f6834001110 con 0x7f684c0b1370 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6838003520 con 0x7f684c0b1370 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f6850f9e640 1 -- 172.21.15.80:0/1364519259 >> v1:172.21.15.87:6789/0 conn(0x7f684c15ea90 legacy=0x7f684c06e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712252330 0 0) 0x7f684c15ee70 con 0x7f684c15ea90 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f6850f9e640 1 -- 172.21.15.80:0/1364519259 >> v1:172.21.15.80:6789/0 conn(0x7f684c0b1370 legacy=0x7f684c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.242+0000 7f6850f9e640 1 -- 172.21.15.80:0/1364519259 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c06d030 con 0x7f684c09b180 2024-04-16T15:35:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.243+0000 7f6850f9e640 1 --2- 172.21.15.80:0/1364519259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c09b180 0x7f684c0d0c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f684c06e920 tx=0x7f684402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7627b329f82a0995 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.243+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844039070 con 0x7f684c09b180 2024-04-16T15:35:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.243+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684402cce0 con 0x7f684c09b180 2024-04-16T15:35:55.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.243+0000 7f684b7fe640 1 -- 172.21.15.80:0/1364519259 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844034640 con 0x7f684c09b180 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.243+0000 7f685179f640 1 -- 172.21.15.80:0/1364519259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c09b180 msgr2=0x7f684c0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 --2- 172.21.15.80:0/1364519259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c09b180 0x7f684c0d0c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f684c06e920 tx=0x7f684402bf30 comp rx=0 tx=0).stop 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 -- 172.21.15.80:0/1364519259 shutdown_connections 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 --2- 172.21.15.80:0/1364519259 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c09b180 0x7f684c0d0c20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 -- 172.21.15.80:0/1364519259 >> 172.21.15.80:0/1364519259 conn(0x7f684c0d2310 msgr2=0x7f684c0d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 -- 172.21.15.80:0/1364519259 shutdown_connections 2024-04-16T15:35:55.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.244+0000 7f685179f640 1 -- 172.21.15.80:0/1364519259 wait complete. 2024-04-16T15:35:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 Processor -- start 2024-04-16T15:35:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 -- start start 2024-04-16T15:35:55.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f684c09b180 0x7f684c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c0b1370 0x7f684c0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.245+0000 7f685179f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f684c06d5b0 con 0x7f684c15ea90 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f685179f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f684c0d1160 con 0x7f684c0b1370 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f685179f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f684c06d890 con 0x7f684c09b180 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42914/0 (socket says 172.21.15.80:42914) 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 -- 172.21.15.80:0/3350066727 learned_addr learned my addr 172.21.15.80:0/3350066727 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f684bfff640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f684c09b180 0x7f684c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6843fff640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c0b1370 0x7f684c0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 -- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f684c09b180 msgr2=0x7f684c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f684c09b180 0x7f684c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 -- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c0b1370 msgr2=0x7f684c0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c0b1370 0x7f684c0c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 -- 172.21.15.80:0/3350066727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c0b1a20 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f6850f9e640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f684402c540 tx=0x7f6844004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844042030 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f684403a040 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c0b1d00 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844039070 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.246+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c15ae50 con 0x7f684c15ea90 2024-04-16T15:35:55.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.247+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c04fd90 con 0x7f684c15ea90 2024-04-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.248+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6844045070 con 0x7f684c15ea90 2024-04-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.248+0000 7f68497fa640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 0x7f682c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.248+0000 7f684bfff640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 0x7f682c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.248+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68440ade00 con 0x7f684c15ea90 2024-04-16T15:35:55.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.249+0000 7f684bfff640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 0x7f682c06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f683c007fd0 tx=0x7f683c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:55.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.253+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f684404c070 con 0x7f684c15ea90 2024-04-16T15:35:55.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.465+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f684c06db60 con 0x7f684c15ea90 2024-04-16T15:35:55.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.466+0000 7f68497fa640 1 -- 172.21.15.80:0/3350066727 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f6844045e40 con 0x7f684c15ea90 2024-04-16T15:35:55.464 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 msgr2=0x7f682c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 0x7f682c06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f683c007fd0 tx=0x7f683c009040 comp rx=0 tx=0).stop 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 msgr2=0x7f684c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f684402c540 tx=0x7f6844004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 shutdown_connections 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f684c15ea90 0x7f684c0b4db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f684c0b1370 0x7f684c0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f682c06c920 0x7f682c06ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 --2- 172.21.15.80:0/3350066727 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f684c09b180 0x7f684c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:55.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 >> 172.21.15.80:0/3350066727 conn(0x7f684c0d2310 msgr2=0x7f684c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:55.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 shutdown_connections 2024-04-16T15:35:55.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55.468+0000 7f685179f640 1 -- 172.21.15.80:0/3350066727 wait complete. 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:35:55.477 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T15:35:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:55.478 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-16T15:35:55.493 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:35:55.493 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:35:55.494 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:35:55.495 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:35:55.495 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42756sec preferred_lft 42756sec 2024-04-16T15:35:55.495 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-04-16T15:35:55.495 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:35:55.495 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T15:35:55.495 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T15:35:55.496 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:35:55.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:35:55.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:55.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:55.688 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:35:55.717 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-16T15:35:55.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:55.719 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-16T15:35:55.787 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-16T15:35:55.787 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:35:55.787 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:35:55.787 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:35:55.787 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:35:55.788 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:35:55.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:35:56.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:56.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:56.111 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-16T15:35:56.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:56.127 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-16T15:35:56.181 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:35:56.182 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:35:56.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:35:56.182 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-16T15:35:56.182 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:35:56.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:35:56.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:56.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-16T15:35:56.307 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:35:56.307 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-16T15:35:56.308 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:35:56.357 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:35:56.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:56.490 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:35:56.490 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:35:56.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-16T15:35:56.490 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T15:35:56.490 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:35:56.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:35:56.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:56.575 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-16T15:35:56.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:35:56.575 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:56.602 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T15:35:56.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:35:56.602 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:56.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:35:56.726 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:35:56.782 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:35:56.782 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:35:56.782 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:35:56.783 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:35:56.784 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:35:56.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:56.785 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:35:56.838 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T15:35:56.839 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-16T15:35:56.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:35:56.909 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:35:56.966 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:35:56.967 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:35:56.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:56.969 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:35:56.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:2024-04-16T15:35:56.975+0000 7f82c7759480 -1 init, newargv = 0x564ee54242c0 newargc=15 2024-04-16T15:35:56.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[44868]: starting ceph client 2024-04-16T15:35:56.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[44868]: starting fuse 2024-04-16T15:35:56.987 INFO:teuthology.orchestra.run.smithi080.stdout:41 2024-04-16T15:35:56.988 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> import re 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> import os 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2024-04-16T15:35:56.988 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:35:56.989 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> return f 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.admin")) 2024-04-16T15:35:56.990 DEBUG:teuthology.orchestra.run.smithi080:> ' 2024-04-16T15:35:57.110 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.admin.44868.asok 2024-04-16T15:35:57.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:57.121 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44868.asok 2024-04-16T15:35:57.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:57.121 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44868.asok status 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "admin", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "44868", 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2024-04-16T15:35:57.261 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4461, 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 4461 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3336900004 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:35:57.262 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 3336900004 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.4461 192.168.0.1:0/3336900004", 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "192.168.0.1:0/3336900004", 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 7, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 25, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2024-04-16T15:35:57.263 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:35:57.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:57.269 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2024-04-16T15:35:57.269 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:57.285 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2024-04-16T15:35:57.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:57.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:35:57.286 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:35:57.356 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-16T15:35:57.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T15:35:57.479 INFO:teuthology.orchestra.run.smithi080.stdout:# file: . 2024-04-16T15:35:57.479 INFO:teuthology.orchestra.run.smithi080.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-16T15:35:57.479 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:57.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:35:57.485 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:57.485 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:35:57.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:57.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.646+0000 7f826edc3640 1 Processor -- start 2024-04-16T15:35:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.646+0000 7f826edc3640 1 -- start start 2024-04-16T15:35:57.648 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826edc3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8268161e20 0x7f8268162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826edc3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82680cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826edc3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82680b7830 con 0x7f82680cf8a0 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826edc3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f82680d1cc0 con 0x7f8268161e20 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826edc3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8268162200 con 0x7f82680ba020 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826d360640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f82680cf8a0 0x7f82680b6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53580/0 (socket says 172.21.15.80:53580) 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826d360640 1 -- 172.21.15.80:0/3794761076 learned_addr learned my addr 172.21.15.80:0/3794761076 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825ffff640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82680cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f826cb5f640 1 --2- 172.21.15.80:0/3794761076 >> v2:172.21.15.87:3300/0 conn(0x7f8268161e20 0x7f8268162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546900577 0 0) 0x7f8260001490 con 0x7f82680cf8a0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8250003520 con 0x7f82680cf8a0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2118939424 0 0) 0x7f8250003520 con 0x7f82680cf8a0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 msgr2=0x7f82680cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82680cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 >> v2:172.21.15.87:3300/0 conn(0x7f8268161e20 msgr2=0x7f8268162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 --2- 172.21.15.80:0/3794761076 >> v2:172.21.15.87:3300/0 conn(0x7f8268161e20 0x7f8268162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8268162b70 con 0x7f82680cf8a0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.647+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f8260001bc0 con 0x7f82680cf8a0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 >> v1:172.21.15.80:6789/0 conn(0x7f82680cf8a0 legacy=0x7f82680b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82500039b0 0x7f8250003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f82680d1cc0 con 0x7f82500039b0 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f825000b9c0 con 0x7f8250004800 2024-04-16T15:35:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f825000bb40 con 0x7f82680ba020 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82500039b0 0x7f8250003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f825ffff640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826d360640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 -- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 msgr2=0x7f82500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82680ba020 0x7f82500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 -- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8250004800 msgr2=0x7f8250004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8250004800 0x7f8250004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.648+0000 7f826cb5f640 1 -- 172.21.15.80:0/3794761076 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8250003520 con 0x7f82500039b0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826cb5f640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82500039b0 0x7f8250003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8264009ac0 tx=0x7f8250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fc7e48439d0bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264039070 con 0x7f82500039b0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826402c710 con 0x7f82500039b0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f825f7fe640 1 -- 172.21.15.80:0/3794761076 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264009690 con 0x7f82500039b0 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 -- 172.21.15.80:0/3794761076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82500039b0 msgr2=0x7f8250003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 --2- 172.21.15.80:0/3794761076 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f82500039b0 0x7f8250003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8264009ac0 tx=0x7f8250005830 comp rx=0 tx=0).stop 2024-04-16T15:35:57.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826d360640 1 -- 172.21.15.80:0/3794761076 reap_dead start 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 -- 172.21.15.80:0/3794761076 shutdown_connections 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 -- 172.21.15.80:0/3794761076 >> 172.21.15.80:0/3794761076 conn(0x7f826806cba0 msgr2=0x7f826806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 -- 172.21.15.80:0/3794761076 shutdown_connections 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.649+0000 7f826edc3640 1 -- 172.21.15.80:0/3794761076 wait complete. 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 Processor -- start 2024-04-16T15:35:57.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 -- start start 2024-04-16T15:35:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82500039b0 0x7f82680c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f826814fd30 0x7f82680ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f82680d2a60 con 0x7f826814f8b0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f82680d2d40 con 0x7f826814fd30 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.651+0000 7f826edc3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8268163130 con 0x7f82500039b0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42934/0 (socket says 172.21.15.80:42934) 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 -- 172.21.15.80:0/2994592551 learned_addr learned my addr 172.21.15.80:0/2994592551 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f826cb5f640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82500039b0 0x7f82680c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f826d360640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f826814fd30 0x7f82680ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 -- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82500039b0 msgr2=0x7f82680c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82500039b0 0x7f82680c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 -- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f826814fd30 msgr2=0x7f82680ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f826814fd30 0x7f82680ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 -- 172.21.15.80:0/2994592551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82681e9820 con 0x7f826814f8b0 2024-04-16T15:35:57.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825ffff640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f82580118e0 tx=0x7f8258011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825800faf0 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825800fc90 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82681e9b00 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258014440 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.652+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82680cbae0 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.653+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8268068a40 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.654+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8258012040 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.654+0000 7f825d7fa640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.654+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f825808c530 con 0x7f826814f8b0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.654+0000 7f826cb5f640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.654+0000 7f826cb5f640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8264036000 tx=0x7f8264030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.658+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8258019030 con 0x7f826814f8b0 2024-04-16T15:35:57.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.835+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f826806cff0 con 0x7f826814f8b0 2024-04-16T15:35:57.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.836+0000 7f825d7fa640 1 -- 172.21.15.80:0/2994592551 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f825805a060 con 0x7f826814f8b0 2024-04-16T15:35:57.835 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:57.835 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 msgr2=0x7f825406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8264036000 tx=0x7f8264030000 comp rx=0 tx=0).stop 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 msgr2=0x7f82680cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f82580118e0 tx=0x7f8258011da0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 shutdown_connections 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f826814fd30 0x7f82680ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f826814f8b0 0x7f82680cdd00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.838+0000 7f826edc3640 1 --2- 172.21.15.80:0/2994592551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f82500039b0 0x7f82680c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.839+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 >> 172.21.15.80:0/2994592551 conn(0x7f826806cba0 msgr2=0x7f82680b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.839+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 shutdown_connections 2024-04-16T15:35:57.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.839+0000 7f826edc3640 1 -- 172.21.15.80:0/2994592551 wait complete. 2024-04-16T15:35:57.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:35:57.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:35:57.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.955+0000 7f9431b04640 1 Processor -- start 2024-04-16T15:35:57.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.955+0000 7f9431b04640 1 -- start start 2024-04-16T15:35:57.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c161f20 0x7f942c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f942c0b74e0 0x7f942c0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f942c0d0ff0 0x7f942c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f942c0cfd90 con 0x7f942c0b74e0 2024-04-16T15:35:57.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f942c0d0050 con 0x7f942c0d0ff0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f9431b04640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f942c0d0330 con 0x7f942c161f20 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f942c0b74e0 0x7f942c0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f942c0b74e0 0x7f942c0cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42942/0 (socket says 172.21.15.80:42942) 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 -- 172.21.15.80:0/2143337912 learned_addr learned my addr 172.21.15.80:0/2143337912 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942bfff640 1 --2- 172.21.15.80:0/2143337912 >> v2:172.21.15.87:3300/0 conn(0x7f942c0d0ff0 0x7f942c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942b7fe640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c161f20 0x7f942c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 -- 172.21.15.80:0/2143337912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c161f20 msgr2=0x7f942c0cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c161f20 0x7f942c0cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 -- 172.21.15.80:0/2143337912 >> v2:172.21.15.87:3300/0 conn(0x7f942c0d0ff0 msgr2=0x7f942c0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 --2- 172.21.15.80:0/2143337912 >> v2:172.21.15.87:3300/0 conn(0x7f942c0d0ff0 0x7f942c0d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.956+0000 7f942affd640 1 -- 172.21.15.80:0/2143337912 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0d0610 con 0x7f942c0b74e0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f942affd640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c0b74e0 0x7f942c0cf770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f942c0d4520 tx=0x7f942002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9c12f922d3879f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f942a7fc640 1 -- 172.21.15.80:0/2143337912 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420035020 con 0x7f942c0b74e0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f942a7fc640 1 -- 172.21.15.80:0/2143337912 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420031870 con 0x7f942c0b74e0 2024-04-16T15:35:57.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f942a7fc640 1 -- 172.21.15.80:0/2143337912 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420031c40 con 0x7f942c0b74e0 2024-04-16T15:35:57.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 -- 172.21.15.80:0/2143337912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c0b74e0 msgr2=0x7f942c0cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c0b74e0 0x7f942c0cf770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f942c0d4520 tx=0x7f942002b910 comp rx=0 tx=0).stop 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 -- 172.21.15.80:0/2143337912 shutdown_connections 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 --2- 172.21.15.80:0/2143337912 >> v2:172.21.15.87:3300/0 conn(0x7f942c0d0ff0 0x7f942c0d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c0b74e0 0x7f942c0cf770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 --2- 172.21.15.80:0/2143337912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c161f20 0x7f942c0cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.957+0000 7f9431b04640 1 -- 172.21.15.80:0/2143337912 >> 172.21.15.80:0/2143337912 conn(0x7f942c08c000 msgr2=0x7f942c0d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.958+0000 7f9431b04640 1 -- 172.21.15.80:0/2143337912 shutdown_connections 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.958+0000 7f9431b04640 1 -- 172.21.15.80:0/2143337912 wait complete. 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.959+0000 7f9431b04640 1 Processor -- start 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.959+0000 7f9431b04640 1 -- start start 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.959+0000 7f9431b04640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c0b74e0 0x7f942c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.959+0000 7f9431b04640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c0d0ff0 0x7f942c160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0d27e0 con 0x7f942c161f20 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f942c0b5730 con 0x7f942c0d0ff0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f942c0d2960 con 0x7f942c0b74e0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42944/0 (socket says 172.21.15.80:42944) 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 -- 172.21.15.80:0/2176553185 learned_addr learned my addr 172.21.15.80:0/2176553185 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942b7fe640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c0b74e0 0x7f942c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942affd640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c0d0ff0 0x7f942c160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 -- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c0b74e0 msgr2=0x7f942c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c0b74e0 0x7f942c0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 -- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c0d0ff0 msgr2=0x7f942c160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c0d0ff0 0x7f942c160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 -- 172.21.15.80:0/2176553185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0cc6e0 con 0x7f942c161f20 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f942bfff640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9424007e60 tx=0x7f942400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424014620 con 0x7f942c161f20 2024-04-16T15:35:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424019070 con 0x7f942c161f20 2024-04-16T15:35:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c0c93b0 con 0x7f942c161f20 2024-04-16T15:35:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424014a20 con 0x7f942c161f20 2024-04-16T15:35:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.960+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c0c9970 con 0x7f942c161f20 2024-04-16T15:35:57.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.961+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c068a40 con 0x7f942c161f20 2024-04-16T15:35:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.962+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9424014bc0 con 0x7f942c161f20 2024-04-16T15:35:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.962+0000 7f9413fff640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 0x7f941806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.962+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f942408c6a0 con 0x7f942c161f20 2024-04-16T15:35:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.962+0000 7f942b7fe640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 0x7f941806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:57.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.963+0000 7f942b7fe640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 0x7f941806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f941c006fd0 tx=0x7f941c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:57.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:57.967+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f942c0cc6e0 con 0x7f942c161f20 2024-04-16T15:35:58.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.141+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f942c0d41c0 con 0x7f942c161f20 2024-04-16T15:35:58.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.142+0000 7f9413fff640 1 -- 172.21.15.80:0/2176553185 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f942405a820 con 0x7f942c161f20 2024-04-16T15:35:58.140 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:35:58.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 msgr2=0x7f941806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 0x7f941806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f941c006fd0 tx=0x7f941c008040 comp rx=0 tx=0).stop 2024-04-16T15:35:58.142 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 msgr2=0x7f942c15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9424007e60 tx=0x7f942400e4b0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 shutdown_connections 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f942c161f20 0x7f942c15ebe0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f942c0d0ff0 0x7f942c160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f941806c8f0 0x7f941806edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 --2- 172.21.15.80:0/2176553185 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f942c0b74e0 0x7f942c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 >> 172.21.15.80:0/2176553185 conn(0x7f942c08c000 msgr2=0x7f942c0b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 shutdown_connections 2024-04-16T15:35:58.143 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.144+0000 7f9431b04640 1 -- 172.21.15.80:0/2176553185 wait complete. 2024-04-16T15:35:58.153 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:35:58.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.261+0000 7f970eba8640 1 Processor -- start 2024-04-16T15:35:58.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.261+0000 7f970eba8640 1 -- start start 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970eba8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f97080b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970eba8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f970815ed30 0x7f9708162690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970eba8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9708163560 con 0x7f97080d1a20 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970eba8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f97080b8090 con 0x7f970815ed30 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970eba8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9708162fa0 con 0x7f970815e950 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970d145640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f97080d1a20 0x7f97080cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53582/0 (socket says 172.21.15.80:53582) 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970d145640 1 -- 172.21.15.80:0/180561948 learned_addr learned my addr 172.21.15.80:0/180561948 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:58.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f970c944640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f97080b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f9707fff640 1 --2- 172.21.15.80:0/180561948 >> v2:172.21.15.87:3300/0 conn(0x7f970815ed30 0x7f9708162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785800425 0 0) 0x7f9708163560 con 0x7f97080d1a20 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.262+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96f0003520 con 0x7f97080d1a20 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2209074772 0 0) 0x7f96f0003520 con 0x7f97080d1a20 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 msgr2=0x7f97080b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f97080b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 >> v2:172.21.15.87:3300/0 conn(0x7f970815ed30 msgr2=0x7f9708162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 --2- 172.21.15.80:0/180561948 >> v2:172.21.15.87:3300/0 conn(0x7f970815ed30 0x7f9708162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708163280 con 0x7f97080d1a20 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f9707fff640 1 --2- 172.21.15.80:0/180561948 >> v2:172.21.15.87:3300/0 conn(0x7f970815ed30 0x7f9708162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f97000019f0 con 0x7f97080d1a20 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 >> v1:172.21.15.80:6789/0 conn(0x7f97080d1a20 legacy=0x7f97080cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f96f00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0003f30 0x7f96f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96f0004d40 0x7f96f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f97080b8090 con 0x7f96f0004d40 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9708162fa0 con 0x7f96f0003f30 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f96f000b9c0 con 0x7f970815e950 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96f0004d40 0x7f96f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970c944640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f96f00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f9707fff640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0003f30 0x7f96f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 -- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 msgr2=0x7f96f00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815e950 0x7f96f00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 -- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0003f30 msgr2=0x7f96f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0003f30 0x7f96f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.263+0000 7f970d145640 1 -- 172.21.15.80:0/180561948 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f0003520 con 0x7f96f0004d40 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.264+0000 7f970d145640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96f0004d40 0x7f96f00051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f970000a8f0 tx=0x7f96f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3a2f51ef0bd48 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.264+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970000a4c0 con 0x7f96f0004d40 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.264+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9700034650 con 0x7f96f0004d40 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.264+0000 7f97077fe640 1 -- 172.21.15.80:0/180561948 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700034a80 con 0x7f96f0004d40 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 -- 172.21.15.80:0/180561948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96f0004d40 msgr2=0x7f96f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 --2- 172.21.15.80:0/180561948 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f96f0004d40 0x7f96f00051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f970000a8f0 tx=0x7f96f0005830 comp rx=0 tx=0).stop 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970d145640 1 -- 172.21.15.80:0/180561948 reap_dead start 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 -- 172.21.15.80:0/180561948 shutdown_connections 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 -- 172.21.15.80:0/180561948 >> 172.21.15.80:0/180561948 conn(0x7f97080b6430 msgr2=0x7f97080b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 -- 172.21.15.80:0/180561948 shutdown_connections 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.265+0000 7f970eba8640 1 -- 172.21.15.80:0/180561948 wait complete. 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.266+0000 7f970eba8640 1 Processor -- start 2024-04-16T15:35:58.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.266+0000 7f970eba8640 1 -- start start 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 0x7f970814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815ab70 0x7f970815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9708162bd0 con 0x7f97080caf70 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f97080d2bc0 con 0x7f96f0004d40 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9708162d50 con 0x7f970815ab70 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42960/0 (socket says 172.21.15.80:42960) 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 -- 172.21.15.80:0/2826578813 learned_addr learned my addr 172.21.15.80:0/2826578813 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:58.270 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970c944640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 0x7f970814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970d145640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815ab70 0x7f970815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 -- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815ab70 msgr2=0x7f970815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815ab70 0x7f970815aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 -- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 msgr2=0x7f970814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 0x7f970814b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 -- 172.21.15.80:0/2826578813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970815f190 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970c944640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 0x7f970814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f9707fff640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96fc011cd0 tx=0x7f96fc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00fd20 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc004030 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970815f470 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.267+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc004420 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.268+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970815fa30 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.269+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9708068a40 con 0x7f97080caf70 2024-04-16T15:35:58.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.269+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96fc012040 con 0x7f97080caf70 2024-04-16T15:35:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.269+0000 7f97057fa640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 0x7f96f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.269+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96fc08c320 con 0x7f97080caf70 2024-04-16T15:35:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.269+0000 7f970c944640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 0x7f96f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.270+0000 7f970c944640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 0x7f96f406ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97080b4ad0 tx=0x7f96f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.274+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96fc019070 con 0x7f97080caf70 2024-04-16T15:35:58.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.447+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f97080d2620 con 0x7f97080caf70 2024-04-16T15:35:58.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.448+0000 7f97057fa640 1 -- 172.21.15.80:0/2826578813 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f96fc059dc0 con 0x7f97080caf70 2024-04-16T15:35:58.446 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:35:58.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.449+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 msgr2=0x7f96f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.449+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 0x7f96f406ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97080b4ad0 tx=0x7f96f8008040 comp rx=0 tx=0).stop 2024-04-16T15:35:58.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 msgr2=0x7f97081592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96fc011cd0 tx=0x7f96fc00f610 comp rx=0 tx=0).stop 2024-04-16T15:35:58.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 shutdown_connections 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f96f406c920 0x7f96f406ede0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f970815ab70 0x7f970815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f97080caf70 0x7f97081592b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 --2- 172.21.15.80:0/2826578813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f96f0004d40 0x7f970814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 >> 172.21.15.80:0/2826578813 conn(0x7f97080b6430 msgr2=0x7f97080b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 shutdown_connections 2024-04-16T15:35:58.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.450+0000 7f970eba8640 1 -- 172.21.15.80:0/2826578813 wait complete. 2024-04-16T15:35:58.459 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:35:58.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.566+0000 7f36d8c1b640 1 Processor -- start 2024-04-16T15:35:58.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.566+0000 7f36d8c1b640 1 -- start start 2024-04-16T15:35:58.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d8c1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d4161f20 0x7f36d40cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d8c1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36d40d1700 0x7f36d40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d8c1b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d40cfd90 con 0x7f36d40b74e0 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d8c1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f36d40d0050 con 0x7f36d40d1700 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d8c1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f36d40d0330 con 0x7f36d4161f20 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.567+0000 7f36d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36d40d1700 0x7f36d40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f36d40d1700 0x7f36d40cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42976/0 (socket says 172.21.15.80:42976) 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d1d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f36d40b74e0 0x7f36d40d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53584/0 (socket says 172.21.15.80:53584) 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 -- 172.21.15.80:0/3644701660 learned_addr learned my addr 172.21.15.80:0/3644701660 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d259c640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d4161f20 0x7f36d40cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 -- 172.21.15.80:0/3644701660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d4161f20 msgr2=0x7f36d40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d4161f20 0x7f36d40cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 -- 172.21.15.80:0/3644701660 >> v1:172.21.15.80:6789/0 conn(0x7f36d40b74e0 legacy=0x7f36d40d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d2d9d640 1 -- 172.21.15.80:0/3644701660 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d40d0610 con 0x7f36d40d1700 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.568+0000 7f36d159a640 1 -- 172.21.15.80:0/3644701660 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809525100 0 0) 0x7f36d40cfd90 con 0x7f36d40b74e0 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d2d9d640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40cf770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009870 tx=0x7f36cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ccaaf7beab06c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d159a640 1 -- 172.21.15.80:0/3644701660 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc034070 con 0x7f36d40d1700 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d159a640 1 -- 172.21.15.80:0/3644701660 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc030840 con 0x7f36d40d1700 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d159a640 1 -- 172.21.15.80:0/3644701660 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc030c10 con 0x7f36d40d1700 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 -- 172.21.15.80:0/3644701660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 msgr2=0x7f36d40cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40cf770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009870 tx=0x7f36cc02b980 comp rx=0 tx=0).stop 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 -- 172.21.15.80:0/3644701660 shutdown_connections 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40cf770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/3644701660 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d4161f20 0x7f36d40cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 -- 172.21.15.80:0/3644701660 >> 172.21.15.80:0/3644701660 conn(0x7f36d408c000 msgr2=0x7f36d40d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 -- 172.21.15.80:0/3644701660 shutdown_connections 2024-04-16T15:35:58.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.569+0000 7f36d8c1b640 1 -- 172.21.15.80:0/3644701660 wait complete. 2024-04-16T15:35:58.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 Processor -- start 2024-04-16T15:35:58.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 -- start start 2024-04-16T15:35:58.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d40b74e0 0x7f36d40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d4161f20 0x7f36d40cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40d27e0 con 0x7f36d40d1700 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f36d40b5730 con 0x7f36d4161f20 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d8c1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f36d40d2960 con 0x7f36d40b74e0 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d1d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42978/0 (socket says 172.21.15.80:42978) 2024-04-16T15:35:58.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.571+0000 7f36d1d9b640 1 -- 172.21.15.80:0/2569550974 learned_addr learned my addr 172.21.15.80:0/2569550974 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d2d9d640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d4161f20 0x7f36d40cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d259c640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d40b74e0 0x7f36d40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 -- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d40b74e0 msgr2=0x7f36d40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d40b74e0 0x7f36d40ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 -- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d4161f20 msgr2=0x7f36d40cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d4161f20 0x7f36d40cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 -- 172.21.15.80:0/2569550974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d41f61c0 con 0x7f36d40d1700 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d1d9b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00c4d0 tx=0x7f36bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc018070 con 0x7f36d40d1700 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc007500 con 0x7f36d40d1700 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36bc004a20 con 0x7f36d40d1700 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d41f6460 con 0x7f36d40d1700 2024-04-16T15:35:58.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.572+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d40ceaf0 con 0x7f36d40d1700 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.573+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d41f6850 con 0x7f36d40d1700 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.574+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36bc01b070 con 0x7f36d40d1700 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.574+0000 7f36caffd640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 0x7f36b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.574+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36bc08b100 con 0x7f36d40d1700 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.574+0000 7f36d259c640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 0x7f36b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.574+0000 7f36d259c640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 0x7f36b406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36c40099c0 tx=0x7f36c4003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.578+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36bc059280 con 0x7f36d40d1700 2024-04-16T15:35:58.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.752+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f36d4068a40 con 0x7f36d40d1700 2024-04-16T15:35:58.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.753+0000 7f36caffd640 1 -- 172.21.15.80:0/2569550974 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f36bc058b80 con 0x7f36d40d1700 2024-04-16T15:35:58.752 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 msgr2=0x7f36b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 0x7f36b406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36c40099c0 tx=0x7f36c4003990 comp rx=0 tx=0).stop 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 msgr2=0x7f36d40c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00c4d0 tx=0x7f36bc00c990 comp rx=0 tx=0).stop 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 shutdown_connections 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36d4161f20 0x7f36d40cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f36d40d1700 0x7f36d40c81c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f36b406c8f0 0x7f36b406edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 --2- 172.21.15.80:0/2569550974 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f36d40b74e0 0x7f36d40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.754+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 >> 172.21.15.80:0/2569550974 conn(0x7f36d408c000 msgr2=0x7f36d40d5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.755+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 shutdown_connections 2024-04-16T15:35:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.755+0000 7f36d8c1b640 1 -- 172.21.15.80:0/2569550974 wait complete. 2024-04-16T15:35:58.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:35:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.871+0000 7f27a1e55640 1 Processor -- start 2024-04-16T15:35:58.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.871+0000 7f27a1e55640 1 -- start start 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f27a1e55640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f279c15ed30 0x7f279c0b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f27a1e55640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 0x7f279c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f27a1e55640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c163560 con 0x7f279c15e950 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f27a1e55640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f279c0b8090 con 0x7f279c15ed30 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f27a1e55640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f279c162fa0 con 0x7f279c0d1a20 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f279c15ed30 0x7f279c0b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f279c15ed30 0x7f279c0b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42992/0 (socket says 172.21.15.80:42992) 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 -- 172.21.15.80:0/1755451922 learned_addr learned my addr 172.21.15.80:0/1755451922 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279b7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f279c15e950 0x7f279c162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53598/0 (socket says 172.21.15.80:53598) 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279bfff640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 0x7f279c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 -- 172.21.15.80:0/1755451922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 msgr2=0x7f279c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:58.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 0x7f279c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 -- 172.21.15.80:0/1755451922 >> v1:172.21.15.80:6789/0 conn(0x7f279c15e950 legacy=0x7f279c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279affd640 1 -- 172.21.15.80:0/1755451922 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c163280 con 0x7f279c15ed30 2024-04-16T15:35:58.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.872+0000 7f279bfff640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 0x7f279c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.873+0000 7f279affd640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15ed30 0x7f279c0b7b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2790009870 tx=0x7f279002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4f6681c669ee4f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.873+0000 7f279a7fc640 1 -- 172.21.15.80:0/1755451922 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790034070 con 0x7f279c15ed30 2024-04-16T15:35:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.873+0000 7f279a7fc640 1 -- 172.21.15.80:0/1755451922 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2790030840 con 0x7f279c15ed30 2024-04-16T15:35:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.873+0000 7f279a7fc640 1 -- 172.21.15.80:0/1755451922 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790030c10 con 0x7f279c15ed30 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 -- 172.21.15.80:0/1755451922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15ed30 msgr2=0x7f279c0b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15ed30 0x7f279c0b7b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2790009870 tx=0x7f279002b980 comp rx=0 tx=0).stop 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 -- 172.21.15.80:0/1755451922 shutdown_connections 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c0d1a20 0x7f279c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 --2- 172.21.15.80:0/1755451922 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15ed30 0x7f279c0b7b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 -- 172.21.15.80:0/1755451922 >> 172.21.15.80:0/1755451922 conn(0x7f279c0b6430 msgr2=0x7f279c0b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 -- 172.21.15.80:0/1755451922 shutdown_connections 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.874+0000 7f27a1e55640 1 -- 172.21.15.80:0/1755451922 wait complete. 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.875+0000 7f27a1e55640 1 Processor -- start 2024-04-16T15:35:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.875+0000 7f27a1e55640 1 -- start start 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f279c0d1a20 0x7f279c153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c15ed30 0x7f279c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0cfce0 con 0x7f279c15e950 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0d2bc0 con 0x7f279c0d1a20 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f27a1e55640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f279c0cfe60 con 0x7f279c15ed30 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43008/0 (socket says 172.21.15.80:43008) 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 -- 172.21.15.80:0/3408203456 learned_addr learned my addr 172.21.15.80:0/3408203456 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279bfff640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c15ed30 0x7f279c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279b7fe640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f279c0d1a20 0x7f279c153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 -- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c15ed30 msgr2=0x7f279c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c15ed30 0x7f279c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 -- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f279c0d1a20 msgr2=0x7f279c153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f279c0d1a20 0x7f279c153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 -- 172.21.15.80:0/3408203456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c153a90 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.876+0000 7f279affd640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f27900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.877+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790034040 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.877+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2790039d90 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.877+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c0cc5b0 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.877+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790043610 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.877+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c0ccb30 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.878+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c068a40 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.878+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f279004a060 con 0x7f279c15e950 2024-04-16T15:35:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.878+0000 7f2783fff640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 0x7f278806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.878+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f27900addb0 con 0x7f279c15e950 2024-04-16T15:35:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.878+0000 7f279b7fe640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 0x7f278806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:58.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.879+0000 7f279b7fe640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 0x7f278806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f279c0ca480 tx=0x7f278c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:58.883+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f279003e070 con 0x7f279c15e950 2024-04-16T15:35:59.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.057+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f279c0d5390 con 0x7f279c15e950 2024-04-16T15:35:59.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.057+0000 7f2783fff640 1 -- 172.21.15.80:0/3408203456 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f279007b850 con 0x7f279c15e950 2024-04-16T15:35:59.056 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:35:59.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 msgr2=0x7f278806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 0x7f278806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f279c0ca480 tx=0x7f278c007e80 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 msgr2=0x7f279c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f27900046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 shutdown_connections 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f278806c8f0 0x7f278806edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f279c15ed30 0x7f279c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f279c15e950 0x7f279c15c8c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 --2- 172.21.15.80:0/3408203456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f279c0d1a20 0x7f279c153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 >> 172.21.15.80:0/3408203456 conn(0x7f279c0b6430 msgr2=0x7f279c0b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 shutdown_connections 2024-04-16T15:35:59.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.059+0000 7f27a1e55640 1 -- 172.21.15.80:0/3408203456 wait complete. 2024-04-16T15:35:59.069 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:35:59.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.174+0000 7fa868637640 1 Processor -- start 2024-04-16T15:35:59.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.174+0000 7fa868637640 1 -- start start 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa868637640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa86015e7a0 0x7fa8600cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa868637640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8600b3870 0x7fa8600d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa868637640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8600d1fc0 con 0x7fa8600d1bc0 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa868637640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa86015eb80 con 0x7fa8600b3870 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa868637640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa8600d32a0 con 0x7fa86015e7a0 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa865bd2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8600b3870 0x7fa8600d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa865bd2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa8600b3870 0x7fa8600d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43020/0 (socket says 172.21.15.80:43020) 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa865bd2640 1 -- 172.21.15.80:0/4518604 learned_addr learned my addr 172.21.15.80:0/4518604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.175+0000 7fa8663d3640 1 --2- 172.21.15.80:0/4518604 >> v2:172.21.15.87:3300/0 conn(0x7fa86015e7a0 0x7fa8600cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.175 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa865bd2640 1 -- 172.21.15.80:0/4518604 >> v2:172.21.15.87:3300/0 conn(0x7fa86015e7a0 msgr2=0x7fa8600cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa865bd2640 1 --2- 172.21.15.80:0/4518604 >> v2:172.21.15.87:3300/0 conn(0x7fa86015e7a0 0x7fa8600cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa865bd2640 1 -- 172.21.15.80:0/4518604 >> v1:172.21.15.87:6789/0 conn(0x7fa8600d1bc0 legacy=0x7fa860162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa865bd2640 1 -- 172.21.15.80:0/4518604 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8600d3580 con 0x7fa8600b3870 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa865bd2640 1 --2- 172.21.15.80:0/4518604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600b3870 0x7fa8600d1680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8600b67f0 tx=0x7fa85002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93aeea8d3298153 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa8653d1640 1 -- 172.21.15.80:0/4518604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850035020 con 0x7fa8600b3870 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.176+0000 7fa8653d1640 1 -- 172.21.15.80:0/4518604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850031870 con 0x7fa8600b3870 2024-04-16T15:35:59.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa8653d1640 1 -- 172.21.15.80:0/4518604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850031c40 con 0x7fa8600b3870 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 -- 172.21.15.80:0/4518604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600b3870 msgr2=0x7fa8600d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 --2- 172.21.15.80:0/4518604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600b3870 0x7fa8600d1680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8600b67f0 tx=0x7fa85002b910 comp rx=0 tx=0).stop 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 -- 172.21.15.80:0/4518604 shutdown_connections 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 --2- 172.21.15.80:0/4518604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600b3870 0x7fa8600d1680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 --2- 172.21.15.80:0/4518604 >> v2:172.21.15.87:3300/0 conn(0x7fa86015e7a0 0x7fa8600cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 -- 172.21.15.80:0/4518604 >> 172.21.15.80:0/4518604 conn(0x7fa8600734f0 msgr2=0x7fa860073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 -- 172.21.15.80:0/4518604 shutdown_connections 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.177+0000 7fa868637640 1 -- 172.21.15.80:0/4518604 wait complete. 2024-04-16T15:35:59.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.178+0000 7fa868637640 1 Processor -- start 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.178+0000 7fa868637640 1 -- start start 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8600b3870 0x7fa8600cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 0x7fa86015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa8600d3e20 con 0x7fa8600d1bc0 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa8600d3b40 con 0x7fa8600b3870 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa868637640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa8600b7720 con 0x7fa86015e7a0 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa865bd2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa865bd2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43036/0 (socket says 172.21.15.80:43036) 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa865bd2640 1 -- 172.21.15.80:0/3234547165 learned_addr learned my addr 172.21.15.80:0/3234547165 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa8663d3640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8600b3870 0x7fa8600cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.179+0000 7fa866bd4640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 0x7fa86015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 -- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 msgr2=0x7fa86015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 0x7fa86015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 -- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8600b3870 msgr2=0x7fa8600cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8600b3870 0x7fa8600cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 -- 172.21.15.80:0/3234547165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8600cd1e0 con 0x7fa8600d1bc0 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa866bd4640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 0x7fa86015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa865bd2640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa850000c00 tx=0x7fa8500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850040070 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850030d00 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8600cf6c0 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850035040 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.180+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8600cda40 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.181+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa860068a40 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.181+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa85004b060 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.182+0000 7fa856ffd640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.182+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa8500adaf0 con 0x7fa8600d1bc0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.182+0000 7fa8663d3640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.182+0000 7fa8663d3640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 0x7fa84406ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0079a0 tx=0x7fa85c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.186+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa85007bc70 con 0x7fa8600d1bc0 2024-04-16T15:35:59.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.372+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa86006bba0 con 0x7fa8600d1bc0 2024-04-16T15:35:59.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.372+0000 7fa856ffd640 1 -- 172.21.15.80:0/3234547165 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa85007b570 con 0x7fa8600d1bc0 2024-04-16T15:35:59.371 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 msgr2=0x7fa84406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 0x7fa84406ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0079a0 tx=0x7fa85c008040 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 msgr2=0x7fa8600ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa850000c00 tx=0x7fa8500046c0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 shutdown_connections 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa86015e7a0 0x7fa86015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa8600d1bc0 0x7fa8600ce520 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 --2- 172.21.15.80:0/3234547165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa8600b3870 0x7fa8600cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 >> 172.21.15.80:0/3234547165 conn(0x7fa8600734f0 msgr2=0x7fa86015dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 shutdown_connections 2024-04-16T15:35:59.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.374+0000 7fa868637640 1 -- 172.21.15.80:0/3234547165 wait complete. 2024-04-16T15:35:59.383 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:35:59.383 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:35:59.399 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:35:59.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.543+0000 7f4e14de8640 1 Processor -- start 2024-04-16T15:35:59.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.543+0000 7f4e14de8640 1 -- start start 2024-04-16T15:35:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e14de8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e100d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e14de8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4e100cccf0 0x7f4e100cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e14de8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1006d560 con 0x7f4e1015ece0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e14de8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4e1009ba80 con 0x7f4e100cccf0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e14de8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1006d800 con 0x7f4e1006d120 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e0e59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e1015ece0 0x7f4e100d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53604/0 (socket says 172.21.15.80:53604) 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e0e59c640 1 -- 172.21.15.80:0/3579127049 learned_addr learned my addr 172.21.15.80:0/3579127049 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/3579127049 >> v2:172.21.15.87:3300/0 conn(0x7f4e100cccf0 0x7f4e100cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e0dd9b640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e100d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.544+0000 7f4e0d59a640 1 -- 172.21.15.80:0/3579127049 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566548150 0 0) 0x7f4e1006d560 con 0x7f4e1015ece0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0d59a640 1 -- 172.21.15.80:0/3579127049 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df8003520 con 0x7f4e1015ece0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 msgr2=0x7f4e100d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e100d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/3579127049 >> v1:172.21.15.80:6789/0 conn(0x7f4e1015ece0 legacy=0x7f4e100d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/3579127049 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1006dae0 con 0x7f4e100cccf0 2024-04-16T15:35:59.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.545+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100cd180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009d90 tx=0x7f4e0802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=527c3bf9ea9b9f79 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e0d59a640 1 -- 172.21.15.80:0/3579127049 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08039070 con 0x7f4e100cccf0 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e0d59a640 1 -- 172.21.15.80:0/3579127049 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0802cc50 con 0x7f4e100cccf0 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e0d59a640 1 -- 172.21.15.80:0/3579127049 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08034440 con 0x7f4e100cccf0 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 -- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 msgr2=0x7f4e100cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100cd180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009d90 tx=0x7f4e0802bea0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 -- 172.21.15.80:0/3579127049 shutdown_connections 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100cd180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 --2- 172.21.15.80:0/3579127049 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e100d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 -- 172.21.15.80:0/3579127049 >> 172.21.15.80:0/3579127049 conn(0x7f4e100d24f0 msgr2=0x7f4e100d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 -- 172.21.15.80:0/3579127049 shutdown_connections 2024-04-16T15:35:59.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.546+0000 7f4e14de8640 1 -- 172.21.15.80:0/3579127049 wait complete. 2024-04-16T15:35:59.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.548+0000 7f4e14de8640 1 Processor -- start 2024-04-16T15:35:59.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.548+0000 7f4e14de8640 1 -- start start 2024-04-16T15:35:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.548+0000 7f4e14de8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e10146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1006e380 con 0x7f4e1015ece0 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1006e0a0 con 0x7f4e100cccf0 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1015f0c0 con 0x7f4e1006d120 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43040/0 (socket says 172.21.15.80:43040) 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/2081640972 learned_addr learned my addr 172.21.15.80:0/2081640972 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0e59c640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e10146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0dd9b640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 msgr2=0x7f4e10146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e10146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 msgr2=0x7f4e100c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 -- 172.21.15.80:0/2081640972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100cc490 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0e59c640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e10146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e0ed9d640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e08037040 tx=0x7f4e08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08042030 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0803a040 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e100701d0 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08039070 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.549+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e10070790 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.550+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e10068a40 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.551+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e08045070 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.551+0000 7f4dfeffd640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 0x7f4df006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.551+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4e080adc60 con 0x7f4e1015ece0 2024-04-16T15:35:59.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.551+0000 7f4e0e59c640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 0x7f4df006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.552+0000 7f4e0e59c640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 0x7f4df006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e00007fd0 tx=0x7f4e00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.555+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e0804c070 con 0x7f4e1015ece0 2024-04-16T15:35:59.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.732+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e1006e980 con 0x7f4e1015ece0 2024-04-16T15:35:59.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.734+0000 7f4dfeffd640 1 -- 172.21.15.80:0/2081640972 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f4e0807bd90 con 0x7f4e1015ece0 2024-04-16T15:35:59.732 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:35:59.732 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 msgr2=0x7f4df006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 0x7f4df006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e00007fd0 tx=0x7f4e00009040 comp rx=0 tx=0).stop 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 msgr2=0x7f4e100c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e08037040 tx=0x7f4e08004a40 comp rx=0 tx=0).stop 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 shutdown_connections 2024-04-16T15:35:59.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1015ece0 0x7f4e100c8cc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e100cccf0 0x7f4e100c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df006c8f0 0x7f4df006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 --2- 172.21.15.80:0/2081640972 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e1006d120 0x7f4e10146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.735+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 >> 172.21.15.80:0/2081640972 conn(0x7f4e100d24f0 msgr2=0x7f4e100ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.736+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 shutdown_connections 2024-04-16T15:35:59.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.736+0000 7f4e14de8640 1 -- 172.21.15.80:0/2081640972 wait complete. 2024-04-16T15:35:59.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:35:59.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:35:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.852+0000 7fe91e874640 1 Processor -- start 2024-04-16T15:35:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.852+0000 7fe91e874640 1 -- start start 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91e874640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9180d0df0 0x7fe9180d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91e874640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe918160430 0x7fe91806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91e874640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9180d1710 con 0x7fe91806e3e0 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91e874640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe91815fb80 con 0x7fe918160430 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91e874640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe91815fe60 con 0x7fe9180d0df0 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe90ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe918160430 0x7fe91806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91ce11640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe91806e3e0 0x7fe91815ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53616/0 (socket says 172.21.15.80:53616) 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe90ffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe918160430 0x7fe91806dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43054/0 (socket says 172.21.15.80:43054) 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.853+0000 7fe91ce11640 1 -- 172.21.15.80:0/1012277396 learned_addr learned my addr 172.21.15.80:0/1012277396 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:35:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe917fff640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9180d0df0 0x7fe9180d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe90ffff640 1 -- 172.21.15.80:0/1012277396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9180d0df0 msgr2=0x7fe9180d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe90ffff640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9180d0df0 0x7fe9180d11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe90ffff640 1 -- 172.21.15.80:0/1012277396 >> v1:172.21.15.80:6789/0 conn(0x7fe91806e3e0 legacy=0x7fe91815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe90ffff640 1 -- 172.21.15.80:0/1012277396 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91806d6a0 con 0x7fe918160430 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe9177fe640 1 -- 172.21.15.80:0/1012277396 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929794518 0 0) 0x7fe9180d1710 con 0x7fe91806e3e0 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.854+0000 7fe90ffff640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe918160430 0x7fe91806dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9000097a0 tx=0x7fe90002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9df9c0c2781538f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe9177fe640 1 -- 172.21.15.80:0/1012277396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000315a0 con 0x7fe918160430 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe9177fe640 1 -- 172.21.15.80:0/1012277396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe900037070 con 0x7fe918160430 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe9177fe640 1 -- 172.21.15.80:0/1012277396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900031960 con 0x7fe918160430 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 -- 172.21.15.80:0/1012277396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe918160430 msgr2=0x7fe91806dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe918160430 0x7fe91806dea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9000097a0 tx=0x7fe90002b840 comp rx=0 tx=0).stop 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 -- 172.21.15.80:0/1012277396 shutdown_connections 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe918160430 0x7fe91806dea0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 --2- 172.21.15.80:0/1012277396 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe9180d0df0 0x7fe9180d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 -- 172.21.15.80:0/1012277396 >> 172.21.15.80:0/1012277396 conn(0x7fe9180d24e0 msgr2=0x7fe9180d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:35:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 -- 172.21.15.80:0/1012277396 shutdown_connections 2024-04-16T15:35:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.855+0000 7fe91e874640 1 -- 172.21.15.80:0/1012277396 wait complete. 2024-04-16T15:35:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.856+0000 7fe91e874640 1 Processor -- start 2024-04-16T15:35:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.856+0000 7fe91e874640 1 -- start start 2024-04-16T15:35:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 0x7fe9181f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 0x7fe9180b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe91806e850 con 0x7fe91806e3e0 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe91806d350 con 0x7fe9180d0df0 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91e874640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe91806e9d0 con 0x7fe918160430 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe917fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe917fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43058/0 (socket says 172.21.15.80:43058) 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe917fff640 1 -- 172.21.15.80:0/2528238144 learned_addr learned my addr 172.21.15.80:0/2528238144 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe90ffff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 0x7fe9181f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.857+0000 7fe91ce11640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 0x7fe9180b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 -- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 msgr2=0x7fe9180b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 0x7fe9180b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 -- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 msgr2=0x7fe9181f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 0x7fe9181f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 -- 172.21.15.80:0/2528238144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9181f5be0 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe91ce11640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 0x7fe9180b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe90ffff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 0x7fe9181f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe917fff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d5f0 tx=0x7fe90800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080125f0 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe908019070 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9181f5ec0 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080129d0 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.858+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9181f5730 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.859+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe918068a40 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.859+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe908012b70 con 0x7fe91806e3e0 2024-04-16T15:35:59.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.860+0000 7fe9157fa640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 0x7fe8f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:35:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.860+0000 7fe90ffff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 0x7fe8f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:35:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.860+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe90808c250 con 0x7fe91806e3e0 2024-04-16T15:35:59.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.860+0000 7fe90ffff640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 0x7fe8f806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe900036000 tx=0x7fe90003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:35:59.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:35:59.864+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe90805a3d0 con 0x7fe91806e3e0 2024-04-16T15:36:00.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.043+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe91815af90 con 0x7fe91806e3e0 2024-04-16T15:36:00.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.044+0000 7fe9157fa640 1 -- 172.21.15.80:0/2528238144 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe908059cd0 con 0x7fe91806e3e0 2024-04-16T15:36:00.042 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:00.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 msgr2=0x7fe8f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 0x7fe8f806edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe900036000 tx=0x7fe90003d040 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 msgr2=0x7fe9180b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d5f0 tx=0x7fe90800dab0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 shutdown_connections 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe8f806c8f0 0x7fe8f806edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe918160430 0x7fe9180b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe9180d0df0 0x7fe9181f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 --2- 172.21.15.80:0/2528238144 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe91806e3e0 0x7fe9180b77f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 >> 172.21.15.80:0/2528238144 conn(0x7fe9180d24e0 msgr2=0x7fe91815a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 shutdown_connections 2024-04-16T15:36:00.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.046+0000 7fe91e874640 1 -- 172.21.15.80:0/2528238144 wait complete. 2024-04-16T15:36:00.055 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.162+0000 7f71af2d9640 1 Processor -- start 2024-04-16T15:36:00.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.162+0000 7f71af2d9640 1 -- start start 2024-04-16T15:36:00.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71af2d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a815e930 0x7f71a80cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71af2d9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71a80d5090 0x7f71a80d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71af2d9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a815ed10 con 0x7f71a80d0f80 2024-04-16T15:36:00.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71af2d9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f71a80d02e0 con 0x7f71a80d5090 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71af2d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f71a80d05b0 con 0x7f71a815e930 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71a80d5090 0x7f71a80d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71a80d5090 0x7f71a80d3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43060/0 (socket says 172.21.15.80:43060) 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 -- 172.21.15.80:0/141898585 learned_addr learned my addr 172.21.15.80:0/141898585 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ad075640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a815e930 0x7f71a80cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 -- 172.21.15.80:0/141898585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a815e930 msgr2=0x7f71a80cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a815e930 0x7f71a80cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 -- 172.21.15.80:0/141898585 >> v1:172.21.15.87:6789/0 conn(0x7f71a80d0f80 legacy=0x7f71a806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.163+0000 7f71ac874640 1 -- 172.21.15.80:0/141898585 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a80d2280 con 0x7f71a80d5090 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.164+0000 7f71ac874640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a80d5090 0x7f71a80d3040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7198009870 tx=0x7f719802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e3b6341a120ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.164+0000 7f719ffff640 1 -- 172.21.15.80:0/141898585 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198034070 con 0x7f71a80d5090 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.164+0000 7f719ffff640 1 -- 172.21.15.80:0/141898585 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7198030840 con 0x7f71a80d5090 2024-04-16T15:36:00.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.164+0000 7f719ffff640 1 -- 172.21.15.80:0/141898585 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198030c10 con 0x7f71a80d5090 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 -- 172.21.15.80:0/141898585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a80d5090 msgr2=0x7f71a80d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a80d5090 0x7f71a80d3040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7198009870 tx=0x7f719802b980 comp rx=0 tx=0).stop 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 -- 172.21.15.80:0/141898585 shutdown_connections 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a80d5090 0x7f71a80d3040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 --2- 172.21.15.80:0/141898585 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a815e930 0x7f71a80cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 -- 172.21.15.80:0/141898585 >> 172.21.15.80:0/141898585 conn(0x7f71a808c000 msgr2=0x7f71a80d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 -- 172.21.15.80:0/141898585 shutdown_connections 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.165+0000 7f71af2d9640 1 -- 172.21.15.80:0/141898585 wait complete. 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.166+0000 7f71af2d9640 1 Processor -- start 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.166+0000 7f71af2d9640 1 -- start start 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a80d0f80 0x7f71a81f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 0x7f71a80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80d2b20 con 0x7f71a815e930 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80d2840 con 0x7f71a80d5090 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f71a80d3580 con 0x7f71a80d0f80 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43066/0 (socket says 172.21.15.80:43066) 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 -- 172.21.15.80:0/3803469168 learned_addr learned my addr 172.21.15.80:0/3803469168 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad075640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a80d0f80 0x7f71a81f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ac874640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 0x7f71a80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 -- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a80d0f80 msgr2=0x7f71a81f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a80d0f80 0x7f71a81f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 -- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 msgr2=0x7f71a80b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 0x7f71a80b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 -- 172.21.15.80:0/3803469168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a81f1d70 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ac874640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 0x7f71a80b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71ad876640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c7a0 tx=0x7f71a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0003b70 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a0003d30 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000aa90 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.167+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a81596a0 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.168+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81590e0 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.169+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a8068a40 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.169+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71a000ac30 con 0x7f71a815e930 2024-04-16T15:36:00.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.169+0000 7f719dffb640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 0x7f718c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.170+0000 7f71ad075640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 0x7f718c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.170+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f71a008bd90 con 0x7f71a815e930 2024-04-16T15:36:00.173 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.170+0000 7f71ad075640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 0x7f718c06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006fd0 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.174+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71a0059e80 con 0x7f71a815e930 2024-04-16T15:36:00.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.354+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f71a815c820 con 0x7f71a815e930 2024-04-16T15:36:00.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.354+0000 7f719dffb640 1 -- 172.21.15.80:0/3803469168 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f71a0059780 con 0x7f71a815e930 2024-04-16T15:36:00.353 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 msgr2=0x7f718c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 0x7f718c06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71a4006fd0 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 msgr2=0x7f71a80b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c7a0 tx=0x7f71a000cc60 comp rx=0 tx=0).stop 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 shutdown_connections 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71a815e930 0x7f71a80b18e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f71a80d5090 0x7f71a80b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f718c06c920 0x7f718c06ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 --2- 172.21.15.80:0/3803469168 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71a80d0f80 0x7f71a81f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 >> 172.21.15.80:0/3803469168 conn(0x7f71a808c000 msgr2=0x7f71a815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 shutdown_connections 2024-04-16T15:36:00.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.356+0000 7f71af2d9640 1 -- 172.21.15.80:0/3803469168 wait complete. 2024-04-16T15:36:00.365 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.473+0000 7efdbec9a640 1 Processor -- start 2024-04-16T15:36:00.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.473+0000 7efdbec9a640 1 -- start start 2024-04-16T15:36:00.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbec9a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 0x7efdb809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbec9a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbec9a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80ceb20 con 0x7efdb809ba70 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbec9a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efdb80d0f70 con 0x7efdb815fd80 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbec9a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80d1250 con 0x7efdb80cd1a0 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:40058/0 (socket says 172.21.15.80:40058) 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 -- 172.21.15.80:0/594010245 learned_addr learned my addr 172.21.15.80:0/594010245 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbca36640 1 --2- 172.21.15.80:0/594010245 >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 0x7efdb809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 -- 172.21.15.80:0/594010245 >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 msgr2=0x7efdb809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 --2- 172.21.15.80:0/594010245 >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 0x7efdb809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 -- 172.21.15.80:0/594010245 >> v1:172.21.15.87:6789/0 conn(0x7efdb809ba70 legacy=0x7efdb809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbd237640 1 -- 172.21.15.80:0/594010245 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80b3090 con 0x7efdb80cd1a0 2024-04-16T15:36:00.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.474+0000 7efdbca36640 1 --2- 172.21.15.80:0/594010245 >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 0x7efdb809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.475+0000 7efdbd237640 1 --2- 172.21.15.80:0/594010245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce852fd9d9ffc758 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.475+0000 7efdaf7fe640 1 -- 172.21.15.80:0/594010245 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb002cb00 con 0x7efdb80cd1a0 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.475+0000 7efdaf7fe640 1 -- 172.21.15.80:0/594010245 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb002cca0 con 0x7efdb80cd1a0 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.475+0000 7efdaf7fe640 1 -- 172.21.15.80:0/594010245 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0034610 con 0x7efdb80cd1a0 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 -- 172.21.15.80:0/594010245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 msgr2=0x7efdb80cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 --2- 172.21.15.80:0/594010245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009e50 tx=0x7efdb002bf60 comp rx=0 tx=0).stop 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 -- 172.21.15.80:0/594010245 shutdown_connections 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 --2- 172.21.15.80:0/594010245 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb80cd5e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 --2- 172.21.15.80:0/594010245 >> v2:172.21.15.87:3300/0 conn(0x7efdb815fd80 0x7efdb809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 -- 172.21.15.80:0/594010245 >> 172.21.15.80:0/594010245 conn(0x7efdb80d24e0 msgr2=0x7efdb80d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 -- 172.21.15.80:0/594010245 shutdown_connections 2024-04-16T15:36:00.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.476+0000 7efdbec9a640 1 -- 172.21.15.80:0/594010245 wait complete. 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.477+0000 7efdbec9a640 1 Processor -- start 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.477+0000 7efdbec9a640 1 -- start start 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdb809ba70 0x7efdb80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb8155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81602e0 con 0x7efdb815fd80 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8160160 con 0x7efdb809ba70 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbec9a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80cdb20 con 0x7efdb80cd1a0 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43076/0 (socket says 172.21.15.80:43076) 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 -- 172.21.15.80:0/2785719480 learned_addr learned my addr 172.21.15.80:0/2785719480 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdaffff640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb8155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbca36640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdb809ba70 0x7efdb80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 -- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 msgr2=0x7efdb8155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb8155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 -- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdb809ba70 msgr2=0x7efdb80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdb809ba70 0x7efdb80b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.478+0000 7efdbd237640 1 -- 172.21.15.80:0/2785719480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80b0f90 con 0x7efdb815fd80 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdbd237640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdb0036040 tx=0x7efdb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0043020 con 0x7efdb815fd80 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb002ce50 con 0x7efdb815fd80 2024-04-16T15:36:00.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb80b1270 con 0x7efdb815fd80 2024-04-16T15:36:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0009510 con 0x7efdb815fd80 2024-04-16T15:36:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.479+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80b1b10 con 0x7efdb815fd80 2024-04-16T15:36:00.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.480+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb80d20d0 con 0x7efdb815fd80 2024-04-16T15:36:00.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.480+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdb0046020 con 0x7efdb815fd80 2024-04-16T15:36:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.481+0000 7efdad7fa640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 0x7efda406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.481+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efdb00ae310 con 0x7efdb815fd80 2024-04-16T15:36:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.481+0000 7efdbca36640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 0x7efda406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.481+0000 7efdbca36640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 0x7efda406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdb815e8c0 tx=0x7efdb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.485+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efdb80d20d0 con 0x7efdb815fd80 2024-04-16T15:36:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.658+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efdb80b1440 con 0x7efdb815fd80 2024-04-16T15:36:00.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.658+0000 7efdad7fa640 1 -- 172.21.15.80:0/2785719480 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7efdb004d030 con 0x7efdb815fd80 2024-04-16T15:36:00.657 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 msgr2=0x7efda406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 0x7efda406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdb815e8c0 tx=0x7efdb4008040 comp rx=0 tx=0).stop 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 msgr2=0x7efdb80b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdb0036040 tx=0x7efdb0004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 shutdown_connections 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efdb815fd80 0x7efdb80b2010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efda406c8f0 0x7efda406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efdb80cd1a0 0x7efdb8155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 --2- 172.21.15.80:0/2785719480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efdb809ba70 0x7efdb80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 >> 172.21.15.80:0/2785719480 conn(0x7efdb80d24e0 msgr2=0x7efdb8071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 shutdown_connections 2024-04-16T15:36:00.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.660+0000 7efdbec9a640 1 -- 172.21.15.80:0/2785719480 wait complete. 2024-04-16T15:36:00.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:00.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.778+0000 7f6bdb00d640 1 Processor -- start 2024-04-16T15:36:00.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.778+0000 7f6bdb00d640 1 -- start start 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bdb00d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd409b180 0x7f6bd40d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bdb00d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6bd40b3190 0x7f6bd40d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bdb00d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd40ccba0 con 0x7f6bd40b2c00 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bdb00d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd40b2fe0 con 0x7f6bd409b180 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bdb00d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd40d34f0 con 0x7f6bd40b3190 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd409b180 0x7f6bd40d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6bd409b180 0x7f6bd40d1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43078/0 (socket says 172.21.15.80:43078) 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 -- 172.21.15.80:0/3295991735 learned_addr learned my addr 172.21.15.80:0/3295991735 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd95aa640 1 --2- 172.21.15.80:0/3295991735 >> v2:172.21.15.87:3300/0 conn(0x7f6bd40b3190 0x7f6bd40d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 -- 172.21.15.80:0/3295991735 >> v2:172.21.15.87:3300/0 conn(0x7f6bd40b3190 msgr2=0x7f6bd40d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/3295991735 >> v2:172.21.15.87:3300/0 conn(0x7f6bd40b3190 0x7f6bd40d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 -- 172.21.15.80:0/3295991735 >> v1:172.21.15.87:6789/0 conn(0x7f6bd40b2c00 legacy=0x7f6bd409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:00.785 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.779+0000 7f6bd3fff640 1 -- 172.21.15.80:0/3295991735 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd40d3210 con 0x7f6bd409b180 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.780+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/3295991735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd40d1f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bd409bc40 tx=0x7f6bc802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c64d2074ca0f8a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.780+0000 7f6bd37fe640 1 -- 172.21.15.80:0/3295991735 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc802e070 con 0x7f6bd409b180 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.780+0000 7f6bd37fe640 1 -- 172.21.15.80:0/3295991735 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc8037070 con 0x7f6bd409b180 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.780+0000 7f6bd37fe640 1 -- 172.21.15.80:0/3295991735 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8031a00 con 0x7f6bd409b180 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 -- 172.21.15.80:0/3295991735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 msgr2=0x7f6bd40d1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/3295991735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd40d1f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6bd409bc40 tx=0x7f6bc802b880 comp rx=0 tx=0).stop 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 -- 172.21.15.80:0/3295991735 shutdown_connections 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/3295991735 >> v2:172.21.15.87:3300/0 conn(0x7f6bd40b3190 0x7f6bd40d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/3295991735 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd40d1f70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 -- 172.21.15.80:0/3295991735 >> 172.21.15.80:0/3295991735 conn(0x7f6bd40d2550 msgr2=0x7f6bd40d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 -- 172.21.15.80:0/3295991735 shutdown_connections 2024-04-16T15:36:00.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.781+0000 7f6bdb00d640 1 -- 172.21.15.80:0/3295991735 wait complete. 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.782+0000 7f6bdb00d640 1 Processor -- start 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.782+0000 7f6bdb00d640 1 -- start start 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 0x7f6bd415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6bd40b3190 0x7f6bd40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd406dcb0 con 0x7f6bd409b180 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd406d940 con 0x7f6bd40b2c00 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bdb00d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd40d0f90 con 0x7f6bd40b3190 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43094/0 (socket says 172.21.15.80:43094) 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 -- 172.21.15.80:0/2572221513 learned_addr learned my addr 172.21.15.80:0/2572221513 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 0x7f6bd415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd95aa640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6bd40b3190 0x7f6bd40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 -- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6bd40b3190 msgr2=0x7f6bd40cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6bd40b3190 0x7f6bd40cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 -- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 msgr2=0x7f6bd415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 0x7f6bd415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd8da9640 1 -- 172.21.15.80:0/2572221513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd40caa50 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.783+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 0x7f6bd415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bd8da9640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c430 tx=0x7f6bc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011790 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc4017070 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011bb0 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd40cad30 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.784+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd40cb2f0 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.785+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd4068a40 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.785+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bc401c460 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.786+0000 7f6bd17fa640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 0x7f6bc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.786+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6bc408bc90 con 0x7f6bd409b180 2024-04-16T15:36:00.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.786+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 0x7f6bc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:00.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.786+0000 7f6bd3fff640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 0x7f6bc006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8036000 tx=0x7f6bc803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:00.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.790+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6bc4059d80 con 0x7f6bd409b180 2024-04-16T15:36:00.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.966+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6bd4071d80 con 0x7f6bd409b180 2024-04-16T15:36:00.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.967+0000 7f6bd17fa640 1 -- 172.21.15.80:0/2572221513 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f6bc4059680 con 0x7f6bd409b180 2024-04-16T15:36:00.965 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 msgr2=0x7f6bc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 0x7f6bc006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8036000 tx=0x7f6bc803d040 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 msgr2=0x7f6bd414e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c430 tx=0x7f6bc400c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 shutdown_connections 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bc006c8f0 0x7f6bc006edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6bd40b3190 0x7f6bd40cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6bd40b2c00 0x7f6bd415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 --2- 172.21.15.80:0/2572221513 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6bd409b180 0x7f6bd414e7f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 >> 172.21.15.80:0/2572221513 conn(0x7f6bd40d2550 msgr2=0x7f6bd4070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 shutdown_connections 2024-04-16T15:36:00.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:00.969+0000 7f6bdb00d640 1 -- 172.21.15.80:0/2572221513 wait complete. 2024-04-16T15:36:00.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.083+0000 7f455fa41640 1 Processor -- start 2024-04-16T15:36:01.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 -- start start 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455815ee50 0x7f455815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f455815f770 0x7f455806c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45581592b0 con 0x7f455806ca40 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f455806e800 con 0x7f455815f770 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.084+0000 7f455fa41640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f455806d230 con 0x7f455815ee50 2024-04-16T15:36:01.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f455815f770 0x7f455806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f455815f770 0x7f455806c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43104/0 (socket says 172.21.15.80:43104) 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 -- 172.21.15.80:0/2978126352 learned_addr learned my addr 172.21.15.80:0/2978126352 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455d7dd640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455815ee50 0x7f455815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 -- 172.21.15.80:0/2978126352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455815ee50 msgr2=0x7f455815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455815ee50 0x7f455815f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 -- 172.21.15.80:0/2978126352 >> v1:172.21.15.87:6789/0 conn(0x7f455806ca40 legacy=0x7f455806f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.085+0000 7f455cfdc640 1 -- 172.21.15.80:0/2978126352 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455806eaa0 con 0x7f455815f770 2024-04-16T15:36:01.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455cfdc640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815f770 0x7f455806c500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6172a98dd811123 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f4557fff640 1 -- 172.21.15.80:0/2978126352 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c02f840 con 0x7f455815f770 2024-04-16T15:36:01.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f4557fff640 1 -- 172.21.15.80:0/2978126352 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c02f9e0 con 0x7f455815f770 2024-04-16T15:36:01.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f4557fff640 1 -- 172.21.15.80:0/2978126352 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c02fdb0 con 0x7f455815f770 2024-04-16T15:36:01.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 -- 172.21.15.80:0/2978126352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815f770 msgr2=0x7f455806c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815f770 0x7f455806c500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02ba20 comp rx=0 tx=0).stop 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 -- 172.21.15.80:0/2978126352 shutdown_connections 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815f770 0x7f455806c500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 --2- 172.21.15.80:0/2978126352 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455815ee50 0x7f455815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 -- 172.21.15.80:0/2978126352 >> 172.21.15.80:0/2978126352 conn(0x7f45580d0c50 msgr2=0x7f45580d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 -- 172.21.15.80:0/2978126352 shutdown_connections 2024-04-16T15:36:01.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.086+0000 7f455fa41640 1 -- 172.21.15.80:0/2978126352 wait complete. 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 Processor -- start 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 -- start start 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455806ca40 0x7f45581f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f455815f770 0x7f45580c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f455815fbd0 con 0x7f455815ee50 2024-04-16T15:36:01.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f455806f060 con 0x7f455815f770 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.088+0000 7f455fa41640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f455806ceb0 con 0x7f455806ca40 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43120/0 (socket says 172.21.15.80:43120) 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 -- 172.21.15.80:0/1493867713 learned_addr learned my addr 172.21.15.80:0/1493867713 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455d7dd640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455806ca40 0x7f45581f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455dfde640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f455815f770 0x7f45580c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 -- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455806ca40 msgr2=0x7f45581f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455806ca40 0x7f45581f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 -- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f455815f770 msgr2=0x7f45580c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f455815f770 0x7f45580c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 -- 172.21.15.80:0/1493867713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455815b290 con 0x7f455815ee50 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455cfdc640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f454c02ba60 tx=0x7f454c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c047070 con 0x7f455815ee50 2024-04-16T15:36:01.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c037d40 con 0x7f455815ee50 2024-04-16T15:36:01.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455815b570 con 0x7f455815ee50 2024-04-16T15:36:01.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c042630 con 0x7f455815ee50 2024-04-16T15:36:01.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.089+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455815bb30 con 0x7f455815ee50 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.090+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558069150 con 0x7f455815ee50 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.091+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f454c04a070 con 0x7f455815ee50 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.091+0000 7f4555ffb640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 0x7f454406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.091+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f454c0adcf0 con 0x7f455815ee50 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.091+0000 7f455d7dd640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 0x7f454406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.092+0000 7f455d7dd640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 0x7f454406edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4548003b80 tx=0x7f45480098a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.095+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f454c0b2070 con 0x7f455815ee50 2024-04-16T15:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.284+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f455806d590 con 0x7f455815ee50 2024-04-16T15:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.284+0000 7f4555ffb640 1 -- 172.21.15.80:0/1493867713 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f454c033030 con 0x7f455815ee50 2024-04-16T15:36:01.283 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 msgr2=0x7f454406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 0x7f454406edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4548003b80 tx=0x7f45480098a0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 msgr2=0x7f45580c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f454c02ba60 tx=0x7f454c004730 comp rx=0 tx=0).stop 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 shutdown_connections 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f455815f770 0x7f45580c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f455815ee50 0x7f45580c86e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f454406c8f0 0x7f454406edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 --2- 172.21.15.80:0/1493867713 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f455806ca40 0x7f45581f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.286+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 >> 172.21.15.80:0/1493867713 conn(0x7f45580d0c50 msgr2=0x7f45580af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:01.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.287+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 shutdown_connections 2024-04-16T15:36:01.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.287+0000 7f455fa41640 1 -- 172.21.15.80:0/1493867713 wait complete. 2024-04-16T15:36:01.296 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2024-04-16T15:36:01.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:01.296 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-16T15:36:01.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi080.stderr:ceph-fuse[44868]: fuse finished with error 0 and tester_r 0 2024-04-16T15:36:01.325 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:01.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:36:01.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:01.365 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-16T15:36:01.427 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:01.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.573+0000 7fc5b9b74640 1 Processor -- start 2024-04-16T15:36:01.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.573+0000 7fc5b9b74640 1 -- start start 2024-04-16T15:36:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b9b74640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc5b40b4d80 0x7fc5b40b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b9b74640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b9b74640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b40b3960 con 0x7fc5b415ecc0 2024-04-16T15:36:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b9b74640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b409be20 con 0x7fc5b40b4d80 2024-04-16T15:36:01.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b9b74640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b40b3c00 con 0x7fc5b40b2750 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc5b40b4d80 0x7fc5b40b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:40098/0 (socket says 172.21.15.80:40098) 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.574+0000 7fc5b3fff640 1 -- 172.21.15.80:0/2801445673 learned_addr learned my addr 172.21.15.80:0/2801445673 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b27fc640 1 -- 172.21.15.80:0/2801445673 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084816205 0 0) 0x7fc5b40b3960 con 0x7fc5b415ecc0 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b27fc640 1 -- 172.21.15.80:0/2801445673 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc59c003520 con 0x7fc5b415ecc0 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b2ffd640 1 -- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 msgr2=0x7fc5b406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b2ffd640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b2ffd640 1 -- 172.21.15.80:0/2801445673 >> v1:172.21.15.87:6789/0 conn(0x7fc5b415ecc0 legacy=0x7fc5b40b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b2ffd640 1 -- 172.21.15.80:0/2801445673 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b409b620 con 0x7fc5b40b4d80 2024-04-16T15:36:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b3fff640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.575+0000 7fc5b2ffd640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b2210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80097a0 tx=0x7fc5a802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e4b4ba489b1740 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b27fc640 1 -- 172.21.15.80:0/2801445673 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8034070 con 0x7fc5b40b4d80 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b27fc640 1 -- 172.21.15.80:0/2801445673 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8030610 con 0x7fc5b40b4d80 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b27fc640 1 -- 172.21.15.80:0/2801445673 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80309c0 con 0x7fc5b40b4d80 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 msgr2=0x7fc5b40b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b2210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80097a0 tx=0x7fc5a802b960 comp rx=0 tx=0).stop 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2801445673 shutdown_connections 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2801445673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b2210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2801445673 >> 172.21.15.80:0/2801445673 conn(0x7fc5b40b4030 msgr2=0x7fc5b40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2801445673 shutdown_connections 2024-04-16T15:36:01.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.576+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2801445673 wait complete. 2024-04-16T15:36:01.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.577+0000 7fc5b9b74640 1 Processor -- start 2024-04-16T15:36:01.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 -- start start 2024-04-16T15:36:01.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b40d1450 con 0x7fc5b415ecc0 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b415f0a0 con 0x7fc5b40b4d80 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b9b74640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b40d15d0 con 0x7fc5b40b2750 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.578+0000 7fc5b3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b2ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b37fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43126/0 (socket says 172.21.15.80:43126) 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 -- 172.21.15.80:0/2870381217 learned_addr learned my addr 172.21.15.80:0/2870381217 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 -- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 msgr2=0x7fc5b4157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b4157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 -- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 msgr2=0x7fc5b40b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 -- 172.21.15.80:0/2870381217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b40c75c0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b3fff640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00e930 tx=0x7fc5ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac017070 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac00ca00 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00cdd0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b40c78a0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.579+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b40b5710 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.580+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b4068a40 con 0x7fc5b415ecc0 2024-04-16T15:36:01.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.581+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5ac013470 con 0x7fc5b415ecc0 2024-04-16T15:36:01.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.581+0000 7fc59bfff640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.581+0000 7fc5b37fe640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.581+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5ac08bd40 con 0x7fc5b415ecc0 2024-04-16T15:36:01.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.581+0000 7fc5b37fe640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 0x7fc5a006edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001e00 tx=0x7fc5a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.585+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5ac0597e0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.759+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5b406e5e0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.761+0000 7fc59bfff640 1 -- 172.21.15.80:0/2870381217 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc5ac05dae0 con 0x7fc5b415ecc0 2024-04-16T15:36:01.759 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:01.759 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 msgr2=0x7fc5a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 0x7fc5a006edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4001e00 tx=0x7fc5a4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 msgr2=0x7fc5b40b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00e930 tx=0x7fc5ac00edf0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 shutdown_connections 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc5b415ecc0 0x7fc5b40b79d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b40b4d80 0x7fc5b40b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 --2- 172.21.15.80:0/2870381217 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc5b40b2750 0x7fc5b4157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 >> 172.21.15.80:0/2870381217 conn(0x7fc5b40b4030 msgr2=0x7fc5b40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 shutdown_connections 2024-04-16T15:36:01.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.763+0000 7fc5b9b74640 1 -- 172.21.15.80:0/2870381217 wait complete. 2024-04-16T15:36:01.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:01.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.877+0000 7eff46081640 1 Processor -- start 2024-04-16T15:36:01.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.877+0000 7eff46081640 1 -- start start 2024-04-16T15:36:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff46081640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 0x7eff40072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff46081640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff400727d0 con 0x7eff4015c0f0 2024-04-16T15:36:01.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff46081640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff400afbe0 con 0x7eff400ce460 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff46081640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7eff400b57a0 con 0x7eff40071eb0 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff3effd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff4015c0f0 0x7eff400b3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53630/0 (socket says 172.21.15.80:53630) 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.878+0000 7eff3effd640 1 -- 172.21.15.80:0/3488684720 learned_addr learned my addr 172.21.15.80:0/3488684720 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3f7fe640 1 --2- 172.21.15.80:0/3488684720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 0x7eff40072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764559675 0 0) 0x7eff400727d0 con 0x7eff4015c0f0 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff28003440 con 0x7eff4015c0f0 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986119998 0 0) 0x7eff400afbe0 con 0x7eff400ce460 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff400727d0 con 0x7eff400ce460 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3f7fe640 1 -- 172.21.15.80:0/3488684720 >> v1:172.21.15.87:6789/0 conn(0x7eff400ce460 legacy=0x7eff400b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3f7fe640 1 -- 172.21.15.80:0/3488684720 >> v1:172.21.15.80:6789/0 conn(0x7eff4015c0f0 legacy=0x7eff400b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.879+0000 7eff3f7fe640 1 -- 172.21.15.80:0/3488684720 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff400afec0 con 0x7eff40071eb0 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff3f7fe640 1 --2- 172.21.15.80:0/3488684720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 0x7eff40072290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff300097d0 tx=0x7eff3002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d3f79a14fd6b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30035020 con 0x7eff40071eb0 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff30031800 con 0x7eff40071eb0 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff3e7fc640 1 -- 172.21.15.80:0/3488684720 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30031bb0 con 0x7eff40071eb0 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 -- 172.21.15.80:0/3488684720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 msgr2=0x7eff40072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 --2- 172.21.15.80:0/3488684720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 0x7eff40072290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff300097d0 tx=0x7eff3002b8a0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 -- 172.21.15.80:0/3488684720 shutdown_connections 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 --2- 172.21.15.80:0/3488684720 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff40071eb0 0x7eff40072290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 -- 172.21.15.80:0/3488684720 >> 172.21.15.80:0/3488684720 conn(0x7eff400b2940 msgr2=0x7eff4006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 -- 172.21.15.80:0/3488684720 shutdown_connections 2024-04-16T15:36:01.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.880+0000 7eff46081640 1 -- 172.21.15.80:0/3488684720 wait complete. 2024-04-16T15:36:01.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.881+0000 7eff46081640 1 Processor -- start 2024-04-16T15:36:01.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 -- start start 2024-04-16T15:36:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40071eb0 0x7eff4014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 0x7eff401f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7eff400ce8b0 con 0x7eff4015c0f0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7eff400b50e0 con 0x7eff40071eb0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.882+0000 7eff46081640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7eff400cea30 con 0x7eff400ce460 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43134/0 (socket says 172.21.15.80:43134) 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 -- 172.21.15.80:0/1295473870 learned_addr learned my addr 172.21.15.80:0/1295473870 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3f7fe640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40071eb0 0x7eff4014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3effd640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 0x7eff401f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 -- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 msgr2=0x7eff401f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 0x7eff401f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 -- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40071eb0 msgr2=0x7eff4014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40071eb0 0x7eff4014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 -- 172.21.15.80:0/1295473870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff401f0650 con 0x7eff4015c0f0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3effd640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 0x7eff401f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff3ffff640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c790 tx=0x7eff3800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38003b70 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38003d10 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff401f1350 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3800aa50 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.883+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4014df00 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.884+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40068a40 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.885+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff3800abf0 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.885+0000 7eff27fff640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 0x7eff2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.885+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7eff3808be50 con 0x7eff4015c0f0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.885+0000 7eff3f7fe640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 0x7eff2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:01.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.886+0000 7eff3f7fe640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 0x7eff2c06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff30036000 tx=0x7eff3003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:01.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:01.889+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff38059f40 con 0x7eff4015c0f0 2024-04-16T15:36:02.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.067+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff40151f60 con 0x7eff4015c0f0 2024-04-16T15:36:02.066 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.068+0000 7eff27fff640 1 -- 172.21.15.80:0/1295473870 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7eff38059840 con 0x7eff4015c0f0 2024-04-16T15:36:02.066 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:02.067 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:02.068 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 msgr2=0x7eff2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 0x7eff2c06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff30036000 tx=0x7eff3003c040 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 msgr2=0x7eff4014ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c790 tx=0x7eff3800cc50 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 shutdown_connections 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff4015c0f0 0x7eff4014ae70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7eff2c06c8f0 0x7eff2c06edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff400ce460 0x7eff401f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 --2- 172.21.15.80:0/1295473870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff40071eb0 0x7eff4014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 >> 172.21.15.80:0/1295473870 conn(0x7eff400b2940 msgr2=0x7eff400cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 shutdown_connections 2024-04-16T15:36:02.069 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.070+0000 7eff46081640 1 -- 172.21.15.80:0/1295473870 wait complete. 2024-04-16T15:36:02.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T15:36:02.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.187+0000 7fdf5e463640 1 Processor -- start 2024-04-16T15:36:02.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.187+0000 7fdf5e463640 1 -- start start 2024-04-16T15:36:02.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5e463640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 0x7fdf5806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:02.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5e463640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf580d19a0 con 0x7fdf580d13e0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5e463640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf580d1c80 con 0x7fdf5806b9a0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5e463640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fdf581457f0 con 0x7fdf58146c90 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5ca00640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fdf580d13e0 0x7fdf581684d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53640/0 (socket says 172.21.15.80:53640) 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf5ca00640 1 -- 172.21.15.80:0/1817681538 learned_addr learned my addr 172.21.15.80:0/1817681538 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf4f7fe640 1 --2- 172.21.15.80:0/1817681538 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 0x7fdf5806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660597528 0 0) 0x7fdf580d19a0 con 0x7fdf580d13e0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf44003520 con 0x7fdf580d13e0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf4f7fe640 1 -- 172.21.15.80:0/1817681538 >> v1:172.21.15.87:6789/0 conn(0x7fdf5806b9a0 legacy=0x7fdf580b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1146277179 0 0) 0x7fdf580d1c80 con 0x7fdf5806b9a0 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf4f7fe640 1 -- 172.21.15.80:0/1817681538 >> v1:172.21.15.80:6789/0 conn(0x7fdf580d13e0 legacy=0x7fdf581684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.188+0000 7fdf4f7fe640 1 -- 172.21.15.80:0/1817681538 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580d1f60 con 0x7fdf58146c90 2024-04-16T15:36:02.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.189+0000 7fdf4f7fe640 1 --2- 172.21.15.80:0/1817681538 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 0x7fdf5806bd80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009800 tx=0x7fdf4002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=307f013d025947ad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:02.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.189+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40035020 con 0x7fdf58146c90 2024-04-16T15:36:02.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.189+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf40031800 con 0x7fdf58146c90 2024-04-16T15:36:02.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.189+0000 7fdf577fe640 1 -- 172.21.15.80:0/1817681538 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40031bb0 con 0x7fdf58146c90 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 -- 172.21.15.80:0/1817681538 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 msgr2=0x7fdf5806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1817681538 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 0x7fdf5806bd80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009800 tx=0x7fdf4002b8a0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 -- 172.21.15.80:0/1817681538 shutdown_connections 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1817681538 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf58146c90 0x7fdf5806bd80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 -- 172.21.15.80:0/1817681538 >> 172.21.15.80:0/1817681538 conn(0x7fdf580b6ba0 msgr2=0x7fdf5809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 -- 172.21.15.80:0/1817681538 shutdown_connections 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.190+0000 7fdf5e463640 1 -- 172.21.15.80:0/1817681538 wait complete. 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.191+0000 7fdf5e463640 1 Processor -- start 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.191+0000 7fdf5e463640 1 -- start start 2024-04-16T15:36:02.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 0x7fdf5815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf580d13e0 0x7fdf58160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5806c440 con 0x7fdf58146c90 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5806c2c0 con 0x7fdf5806b9a0 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5e463640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5806c5c0 con 0x7fdf580d13e0 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43150/0 (socket says 172.21.15.80:43150) 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 -- 172.21.15.80:0/1504221579 learned_addr learned my addr 172.21.15.80:0/1504221579 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf4f7fe640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf580d13e0 0x7fdf58160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf57fff640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 0x7fdf5815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 -- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf580d13e0 msgr2=0x7fdf58160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf580d13e0 0x7fdf58160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 -- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 msgr2=0x7fdf5815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 0x7fdf5815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 -- 172.21.15.80:0/1504221579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5815ff80 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf57fff640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 0x7fdf5815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.192+0000 7fdf5ca00640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000cad0 tx=0x7fdf5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.193+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.193+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf5000ac30 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.193+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5815f9c0 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.193+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50012400 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.193+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf581419c0 con 0x7fdf58146c90 2024-04-16T15:36:02.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.194+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf58068a40 con 0x7fdf58146c90 2024-04-16T15:36:02.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.194+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf5001a070 con 0x7fdf58146c90 2024-04-16T15:36:02.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.195+0000 7fdf557fa640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 0x7fdf3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:02.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.195+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf5008bbb0 con 0x7fdf58146c90 2024-04-16T15:36:02.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.195+0000 7fdf57fff640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 0x7fdf3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:02.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.195+0000 7fdf57fff640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 0x7fdf3806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf48000f60 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:02.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.199+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdf50059d30 con 0x7fdf58146c90 2024-04-16T15:36:02.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.414+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdf58161de0 con 0x7fdf58146c90 2024-04-16T15:36:02.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.962+0000 7fdf557fa640 1 -- 172.21.15.80:0/1504221579 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fdf50059630 con 0x7fdf58146c90 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 msgr2=0x7fdf3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 0x7fdf3806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf48000f60 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 msgr2=0x7fdf5815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000cad0 tx=0x7fdf5000cf90 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 shutdown_connections 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdf58146c90 0x7fdf5815ef70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdf3806c8f0 0x7fdf3806edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdf580d13e0 0x7fdf58160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 --2- 172.21.15.80:0/1504221579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdf5806b9a0 0x7fdf5815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:02.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 >> 172.21.15.80:0/1504221579 conn(0x7fdf580b6ba0 msgr2=0x7fdf5806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 shutdown_connections 2024-04-16T15:36:02.964 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:02.964+0000 7fdf5e463640 1 -- 172.21.15.80:0/1504221579 wait complete. 2024-04-16T15:36:02.975 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-16T15:36:02.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T15:36:03.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.084+0000 7f387aa88640 1 Processor -- start 2024-04-16T15:36:03.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.084+0000 7f387aa88640 1 -- start start 2024-04-16T15:36:03.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f387aa88640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3874145eb0 0x7f387415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f387aa88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38740ce870 0x7f38740d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f387aa88640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38740ceea0 con 0x7f38740d18f0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f387aa88640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f38740cf180 con 0x7f3874145eb0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f387aa88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f38740cf460 con 0x7f38740ce870 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3879025640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f38740d18f0 0x7f38740cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53648/0 (socket says 172.21.15.80:53648) 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3879025640 1 -- 172.21.15.80:0/863550732 learned_addr learned my addr 172.21.15.80:0/863550732 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38740ce870 0x7f38740d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3878824640 1 --2- 172.21.15.80:0/863550732 >> v2:172.21.15.87:3300/0 conn(0x7f3874145eb0 0x7f387415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870828183 0 0) 0x7f38740ceea0 con 0x7f38740d18f0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3860003520 con 0x7f38740d18f0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2547771257 0 0) 0x7f3860003520 con 0x7f38740d18f0 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38740ce870 msgr2=0x7f38740d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38740ce870 0x7f38740d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 >> v2:172.21.15.87:3300/0 conn(0x7f3874145eb0 msgr2=0x7f387415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 --2- 172.21.15.80:0/863550732 >> v2:172.21.15.87:3300/0 conn(0x7f3874145eb0 0x7f387415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38740cf740 con 0x7f38740d18f0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f385c001670 con 0x7f38740d18f0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 >> v1:172.21.15.80:6789/0 conn(0x7f38740d18f0 legacy=0x7f38740cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38600039b0 0x7f3860003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38600043a0 0x7f3860004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3860004ef0 0x7f386000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f38740cf180 con 0x7f38600043a0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f38740cf460 con 0x7f3860004ef0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f386000bf00 con 0x7f38600039b0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3878824640 1 --2- 172.21.15.80:0/863550732 >> v2:172.21.15.87:3300/0 conn(0x7f3874145eb0 0x7f387415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.085+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38740ce870 0x7f38740d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38600043a0 0x7f3860004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3879025640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3860004ef0 0x7f386000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3878824640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38600039b0 0x7f3860003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 -- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38600039b0 msgr2=0x7f3860003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f38600039b0 0x7f3860003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 -- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3860004ef0 msgr2=0x7f386000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3860004ef0 0x7f386000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.086+0000 7f3873fff640 1 -- 172.21.15.80:0/863550732 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3860003520 con 0x7f38600043a0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f3873fff640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38600043a0 0x7f3860004880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f386400e1f0 tx=0x7f3860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d463da0f7d766154 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864009d40 con 0x7f38600043a0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386402cce0 con 0x7f38600043a0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f38737fe640 1 -- 172.21.15.80:0/863550732 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864003bb0 con 0x7f38600043a0 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 -- 172.21.15.80:0/863550732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38600043a0 msgr2=0x7f3860004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 --2- 172.21.15.80:0/863550732 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f38600043a0 0x7f3860004880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f386400e1f0 tx=0x7f3860005830 comp rx=0 tx=0).stop 2024-04-16T15:36:03.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f3879025640 1 -- 172.21.15.80:0/863550732 reap_dead start 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 -- 172.21.15.80:0/863550732 shutdown_connections 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 -- 172.21.15.80:0/863550732 >> 172.21.15.80:0/863550732 conn(0x7f38740b6ba0 msgr2=0x7f387409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 -- 172.21.15.80:0/863550732 shutdown_connections 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.087+0000 7f387aa88640 1 -- 172.21.15.80:0/863550732 wait complete. 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.088+0000 7f387aa88640 1 Processor -- start 2024-04-16T15:36:03.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.088+0000 7f387aa88640 1 -- start start 2024-04-16T15:36:03.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 0x7f38741e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f387413aa40 0x7f38741f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3874146410 con 0x7f3874141b70 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3874146290 con 0x7f38600043a0 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f387aa88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f38740d13b0 con 0x7f387413aa40 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f3873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f3873fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43176/0 (socket says 172.21.15.80:43176) 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f3873fff640 1 -- 172.21.15.80:0/3556862340 learned_addr learned my addr 172.21.15.80:0/3556862340 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f3879025640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f387413aa40 0x7f38741f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.089+0000 7f3878824640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 0x7f38741e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 -- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f387413aa40 msgr2=0x7f38741f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f387413aa40 0x7f38741f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 -- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 msgr2=0x7f38741e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 0x7f38741e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 -- 172.21.15.80:0/3556862340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3874141ff0 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3878824640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 0x7f38741e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f3873fff640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f386400e1f0 tx=0x7f3864009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864043020 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864003e30 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3874140ad0 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864009d40 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.090+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3874141090 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.091+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3874068a40 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.091+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3864046020 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.092+0000 7f38717fa640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.092+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f38640ae7b0 con 0x7f3874141b70 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.092+0000 7f3878824640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:03.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.092+0000 7f3878824640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 0x7f385406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f386c009d50 tx=0x7f386c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:03.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.097+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f386404d030 con 0x7f3874141b70 2024-04-16T15:36:03.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.311+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f38740ae7f0 con 0x7f3874141b70 2024-04-16T15:36:03.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.970+0000 7f38717fa640 1 -- 172.21.15.80:0/3556862340 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f386407c930 con 0x7f3874141b70 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 msgr2=0x7f385406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 0x7f385406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f386c009d50 tx=0x7f386c008040 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 msgr2=0x7f3874140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f386400e1f0 tx=0x7f3864009750 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 shutdown_connections 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f387413aa40 0x7f38741f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3874141b70 0x7f3874140360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 --2- 172.21.15.80:0/3556862340 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38600043a0 0x7f38741e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 >> 172.21.15.80:0/3556862340 conn(0x7f38740b6ba0 msgr2=0x7f38740cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:03.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 shutdown_connections 2024-04-16T15:36:03.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:03.972+0000 7f387aa88640 1 -- 172.21.15.80:0/3556862340 wait complete. 2024-04-16T15:36:03.983 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T15:36:03.983 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:04.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.092+0000 7fbe9c0e4640 1 Processor -- start 2024-04-16T15:36:04.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.092+0000 7fbe9c0e4640 1 -- start start 2024-04-16T15:36:04.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.092+0000 7fbe9c0e4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe9415fe20 0x7fbe941604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe9c0e4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe94070e30 con 0x7fbe940ccec0 2024-04-16T15:36:04.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe9c0e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe94160200 con 0x7fbe94071de0 2024-04-16T15:36:04.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe9c0e4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbe940d06c0 con 0x7fbe9415fe20 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe99e80640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbe9415fe20 0x7fbe941604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe9967f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbe940ccec0 0x7fbe94070010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53658/0 (socket says 172.21.15.80:53658) 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe9967f640 1 -- 172.21.15.80:0/491916630 learned_addr learned my addr 172.21.15.80:0/491916630 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe99e80640 1 -- 172.21.15.80:0/491916630 >> v1:172.21.15.87:6789/0 conn(0x7fbe94071de0 legacy=0x7fbe94070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe99e80640 1 -- 172.21.15.80:0/491916630 >> v1:172.21.15.80:6789/0 conn(0x7fbe940ccec0 legacy=0x7fbe94070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe99e80640 1 -- 172.21.15.80:0/491916630 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe94161070 con 0x7fbe9415fe20 2024-04-16T15:36:04.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.093+0000 7fbe98e7e640 1 -- 172.21.15.80:0/491916630 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937614623 0 0) 0x7fbe94070e30 con 0x7fbe940ccec0 2024-04-16T15:36:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe99e80640 1 --2- 172.21.15.80:0/491916630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9415fe20 0x7fbe941604a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30334c452edc0faf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe98e7e640 1 -- 172.21.15.80:0/491916630 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c039070 con 0x7fbe9415fe20 2024-04-16T15:36:04.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe98e7e640 1 -- 172.21.15.80:0/491916630 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c02cbd0 con 0x7fbe9415fe20 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe98e7e640 1 -- 172.21.15.80:0/491916630 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c034440 con 0x7fbe9415fe20 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/491916630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9415fe20 msgr2=0x7fbe941604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/491916630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9415fe20 0x7fbe941604a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c02be20 comp rx=0 tx=0).stop 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/491916630 shutdown_connections 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/491916630 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe9415fe20 0x7fbe941604a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/491916630 >> 172.21.15.80:0/491916630 conn(0x7fbe940b3f80 msgr2=0x7fbe940b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.094+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/491916630 shutdown_connections 2024-04-16T15:36:04.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.095+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/491916630 wait complete. 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 Processor -- start 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 -- start start 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe940ccec0 0x7fbe94157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe9415fe20 0x7fbe941e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940d03e0 con 0x7fbe94071de0 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940d0100 con 0x7fbe9415fe20 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe9c0e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbe94071970 con 0x7fbe940ccec0 2024-04-16T15:36:04.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe99e80640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe99e80640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43194/0 (socket says 172.21.15.80:43194) 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.096+0000 7fbe99e80640 1 -- 172.21.15.80:0/4184671741 learned_addr learned my addr 172.21.15.80:0/4184671741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 -- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe940ccec0 msgr2=0x7fbe94157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe940ccec0 0x7fbe94157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 -- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe9415fe20 msgr2=0x7fbe941e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe9415fe20 0x7fbe941e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 -- 172.21.15.80:0/4184671741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe941e7d60 con 0x7fbe94071de0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe99e80640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c044020 con 0x7fbe94071de0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c03f670 con 0x7fbe94071de0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe941e63d0 con 0x7fbe94071de0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c039040 con 0x7fbe94071de0 2024-04-16T15:36:04.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.097+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941e6990 con 0x7fbe94071de0 2024-04-16T15:36:04.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.098+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe94069150 con 0x7fbe94071de0 2024-04-16T15:36:04.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.099+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe8c047020 con 0x7fbe94071de0 2024-04-16T15:36:04.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.099+0000 7fbe927fc640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 0x7fbe8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.099+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe8c0aeae0 con 0x7fbe94071de0 2024-04-16T15:36:04.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.099+0000 7fbe9967f640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 0x7fbe8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.099+0000 7fbe9967f640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 0x7fbe8006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe88007fd0 tx=0x7fbe88007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.103+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe8c04e030 con 0x7fbe94071de0 2024-04-16T15:36:04.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.312+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe940ce850 con 0x7fbe94071de0 2024-04-16T15:36:04.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.312+0000 7fbe927fc640 1 -- 172.21.15.80:0/4184671741 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fbe8c07cbd0 con 0x7fbe94071de0 2024-04-16T15:36:04.311 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:04.311 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:04.312 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 msgr2=0x7fbe8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 0x7fbe8006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe88007fd0 tx=0x7fbe88007960 comp rx=0 tx=0).stop 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 msgr2=0x7fbe940c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 shutdown_connections 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe9415fe20 0x7fbe941e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbe8006c8f0 0x7fbe8006edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbe940ccec0 0x7fbe94157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 --2- 172.21.15.80:0/4184671741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbe94071de0 0x7fbe940c7d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.314+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 >> 172.21.15.80:0/4184671741 conn(0x7fbe940b3f80 msgr2=0x7fbe940cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.315+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 shutdown_connections 2024-04-16T15:36:04.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.315+0000 7fbe9c0e4640 1 -- 172.21.15.80:0/4184671741 wait complete. 2024-04-16T15:36:04.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:04.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.428+0000 7f84fbfba640 1 Processor -- start 2024-04-16T15:36:04.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 -- start start 2024-04-16T15:36:04.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 0x7f84f40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 0x7f84f40d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f40d2280 con 0x7f84f40d3600 2024-04-16T15:36:04.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f84f40d3170 con 0x7f84f415e930 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.429+0000 7f84fbfba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f84f40d2560 con 0x7f84f40d17d0 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f9555640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f84f40d3600 0x7f84f40d10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53666/0 (socket says 172.21.15.80:53666) 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f9555640 1 -- 172.21.15.80:0/1385848778 learned_addr learned my addr 172.21.15.80:0/1385848778 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f9d56640 1 --2- 172.21.15.80:0/1385848778 >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 0x7f84f40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84fa557640 1 --2- 172.21.15.80:0/1385848778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 0x7f84f40d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995081651 0 0) 0x7f84f40d2280 con 0x7f84f40d3600 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84e0003520 con 0x7f84f40d3600 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84fa557640 1 -- 172.21.15.80:0/1385848778 >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 msgr2=0x7f84f40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84fa557640 1 --2- 172.21.15.80:0/1385848778 >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 0x7f84f40cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2554619661 0 0) 0x7f84e0003520 con 0x7f84f40d3600 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84fa557640 1 -- 172.21.15.80:0/1385848778 >> v1:172.21.15.80:6789/0 conn(0x7f84f40d3600 legacy=0x7f84f40d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84fa557640 1 -- 172.21.15.80:0/1385848778 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f40d2840 con 0x7f84f40d17d0 2024-04-16T15:36:04.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.430+0000 7f84f9d56640 1 --2- 172.21.15.80:0/1385848778 >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 0x7f84f40cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:04.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.431+0000 7f84fa557640 1 --2- 172.21.15.80:0/1385848778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 0x7f84f40d0400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec02bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb88d5f75b0ee14f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.431+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec039070 con 0x7f84f40d17d0 2024-04-16T15:36:04.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.431+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ec02c810 con 0x7f84f40d17d0 2024-04-16T15:36:04.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.431+0000 7f84f8d54640 1 -- 172.21.15.80:0/1385848778 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0001670 con 0x7f84f40d17d0 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 -- 172.21.15.80:0/1385848778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 msgr2=0x7f84f40d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1385848778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 0x7f84f40d0400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec02bce0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 -- 172.21.15.80:0/1385848778 shutdown_connections 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1385848778 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f40d17d0 0x7f84f40d0400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1385848778 >> v2:172.21.15.87:3300/0 conn(0x7f84f415e930 0x7f84f40cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 -- 172.21.15.80:0/1385848778 >> 172.21.15.80:0/1385848778 conn(0x7f84f408c000 msgr2=0x7f84f40d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 -- 172.21.15.80:0/1385848778 shutdown_connections 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.432+0000 7f84fbfba640 1 -- 172.21.15.80:0/1385848778 wait complete. 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.433+0000 7f84fbfba640 1 Processor -- start 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.433+0000 7f84fbfba640 1 -- start start 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 0x7f84f41f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 0x7f84f40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f84f415ed10 con 0x7f84f40d17d0 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40d2e00 con 0x7f84f40d3600 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f84f40cc7d0 con 0x7f84f415e930 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43204/0 (socket says 172.21.15.80:43204) 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 -- 172.21.15.80:0/1843034579 learned_addr learned my addr 172.21.15.80:0/1843034579 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fa557640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 0x7f84f40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9555640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 0x7f84f41f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 -- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 msgr2=0x7f84f40cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 0x7f84f40cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 -- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 msgr2=0x7f84f41f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 0x7f84f41f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 -- 172.21.15.80:0/1843034579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f40cca20 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fa557640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 0x7f84f40cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9555640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 0x7f84f41f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84f9d56640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e960 tx=0x7f84e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8017070 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e800ca00 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f40ccd00 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e800cdd0 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.434+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f40cd2c0 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.435+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f4069150 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.436+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84e801a070 con 0x7f84f40d17d0 2024-04-16T15:36:04.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.436+0000 7f84e67fc640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 0x7f84d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.436+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84e808c020 con 0x7f84f40d17d0 2024-04-16T15:36:04.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.436+0000 7f84f9555640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 0x7f84d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.437+0000 7f84f9555640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 0x7f84d806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84f40b3020 tx=0x7f84f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.440+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84e805a1a0 con 0x7f84f40d17d0 2024-04-16T15:36:04.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.616+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84f40d1e10 con 0x7f84f40d17d0 2024-04-16T15:36:04.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.617+0000 7f84e67fc640 1 -- 172.21.15.80:0/1843034579 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f84e8059aa0 con 0x7f84f40d17d0 2024-04-16T15:36:04.617 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:04.617 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:04.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 msgr2=0x7f84d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 0x7f84d806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84f40b3020 tx=0x7f84f0009040 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 msgr2=0x7f84f40b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e960 tx=0x7f84e800ee20 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 shutdown_connections 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f84d806c8f0 0x7f84d806edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f84f415e930 0x7f84f40cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f84f40d3600 0x7f84f41f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 --2- 172.21.15.80:0/1843034579 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f84f40d17d0 0x7f84f40b7bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 >> 172.21.15.80:0/1843034579 conn(0x7f84f408c000 msgr2=0x7f84f415f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 shutdown_connections 2024-04-16T15:36:04.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.619+0000 7f84fbfba640 1 -- 172.21.15.80:0/1843034579 wait complete. 2024-04-16T15:36:04.629 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T15:36:04.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:36:04.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.733+0000 7f0d53332640 1 Processor -- start 2024-04-16T15:36:04.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 -- start start 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d4c0d1450 0x7f0d4c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 0x7f0d4c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4c0cfeb0 con 0x7f0d4c163350 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0d4c162900 con 0x7f0d4c0d1450 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.734+0000 7f0d53332640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4c162ec0 con 0x7f0d4c15ef80 2024-04-16T15:36:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d510ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0d4c0d1450 0x7f0d4c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d518cf640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0d4c163350 0x7f0d4c0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33848/0 (socket says 172.21.15.80:33848) 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d518cf640 1 -- 172.21.15.80:0/4213152007 learned_addr learned my addr 172.21.15.80:0/4213152007 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d508cd640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 0x7f0d4c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d510ce640 1 -- 172.21.15.80:0/4213152007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 msgr2=0x7f0d4c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d510ce640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 0x7f0d4c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d510ce640 1 -- 172.21.15.80:0/4213152007 >> v1:172.21.15.80:6789/0 conn(0x7f0d4c163350 legacy=0x7f0d4c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d3ffff640 1 -- 172.21.15.80:0/4213152007 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207371916 0 0) 0x7f0d4c0cfeb0 con 0x7f0d4c163350 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d510ce640 1 -- 172.21.15.80:0/4213152007 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c0d0190 con 0x7f0d4c0d1450 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.735+0000 7f0d508cd640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 0x7f0d4c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d510ce640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c0d1450 0x7f0d4c15fe60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d400097a0 tx=0x7f0d4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29867ee3d3cfc627 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d3ffff640 1 -- 172.21.15.80:0/4213152007 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d400315a0 con 0x7f0d4c0d1450 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d3ffff640 1 -- 172.21.15.80:0/4213152007 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d40037070 con 0x7f0d4c0d1450 2024-04-16T15:36:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d3ffff640 1 -- 172.21.15.80:0/4213152007 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40031960 con 0x7f0d4c0d1450 2024-04-16T15:36:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 -- 172.21.15.80:0/4213152007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c0d1450 msgr2=0x7f0d4c15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c0d1450 0x7f0d4c15fe60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d400097a0 tx=0x7f0d4002b840 comp rx=0 tx=0).stop 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 -- 172.21.15.80:0/4213152007 shutdown_connections 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c15ef80 0x7f0d4c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 --2- 172.21.15.80:0/4213152007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c0d1450 0x7f0d4c15fe60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.736+0000 7f0d53332640 1 -- 172.21.15.80:0/4213152007 >> 172.21.15.80:0/4213152007 conn(0x7f0d4c06ce20 msgr2=0x7f0d4c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.737+0000 7f0d53332640 1 -- 172.21.15.80:0/4213152007 shutdown_connections 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.737+0000 7f0d53332640 1 -- 172.21.15.80:0/4213152007 wait complete. 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 Processor -- start 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 -- start start 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c0d1450 0x7f0d4c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c163350 0x7f0d4c14b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c0d2ff0 con 0x7f0d4c15ef80 2024-04-16T15:36:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4c1637c0 con 0x7f0d4c163350 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.738+0000 7f0d53332640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4c0d3170 con 0x7f0d4c0d1450 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34564/0 (socket says 172.21.15.80:34564) 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 -- 172.21.15.80:0/2994080432 learned_addr learned my addr 172.21.15.80:0/2994080432 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d510ce640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c0d1450 0x7f0d4c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d518cf640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c163350 0x7f0d4c14b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 -- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c0d1450 msgr2=0x7f0d4c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c0d1450 0x7f0d4c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 -- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c163350 msgr2=0x7f0d4c14b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c163350 0x7f0d4c14b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 -- 172.21.15.80:0/2994080432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4c0c96f0 con 0x7f0d4c15ef80 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d508cd640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e7e0 tx=0x7f0d4800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800f040 con 0x7f0d4c15ef80 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48004030 con 0x7f0d4c15ef80 2024-04-16T15:36:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4c0c99d0 con 0x7f0d4c15ef80 2024-04-16T15:36:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004400 con 0x7f0d4c15ef80 2024-04-16T15:36:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.739+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4c0c9f90 con 0x7f0d4c15ef80 2024-04-16T15:36:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.740+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d4c068a40 con 0x7f0d4c15ef80 2024-04-16T15:36:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.741+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d4800c6d0 con 0x7f0d4c15ef80 2024-04-16T15:36:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.741+0000 7f0d3dffb640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 0x7f0d3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.741+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d4808bc70 con 0x7f0d4c15ef80 2024-04-16T15:36:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.741+0000 7f0d510ce640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 0x7f0d3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.742+0000 7f0d510ce640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 0x7f0d3006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d40036000 tx=0x7f0d4003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.745+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d48017020 con 0x7f0d4c15ef80 2024-04-16T15:36:04.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.917+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d4c0d0a40 con 0x7f0d3006c8f0 2024-04-16T15:36:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.926+0000 7f0d3dffb640 1 -- 172.21.15.80:0/2994080432 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f0d4c0d0a40 con 0x7f0d3006c8f0 2024-04-16T15:36:04.929 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:04.932 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 msgr2=0x7f0d3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 0x7f0d3006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d40036000 tx=0x7f0d4003d040 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 msgr2=0x7f0d4c14b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e7e0 tx=0x7f0d4800eca0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 shutdown_connections 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0d4c163350 0x7f0d4c14b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0d4c15ef80 0x7f0d4c14b090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0d3006c8f0 0x7f0d3006edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 --2- 172.21.15.80:0/2994080432 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0d4c0d1450 0x7f0d4c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:04.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 >> 172.21.15.80:0/2994080432 conn(0x7f0d4c06ce20 msgr2=0x7f0d4c0d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:04.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 shutdown_connections 2024-04-16T15:36:04.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:04.929+0000 7f0d53332640 1 -- 172.21.15.80:0/2994080432 wait complete. 2024-04-16T15:36:04.938 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-16T15:36:03.160949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219468,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755252,"statfs":{"total":773094113280,"available":772869378048,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002182"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083878+0000","last_change":"2024-04-16T15:35:46.903839+0000","last_active":"2024-04-16T15:35:55.083878+0000","last_peered":"2024-04-16T15:35:55.083878+0000","last_clean":"2024-04-16T15:35:55.083878+0000","last_became_active":"2024-04-16T15:35:46.903559+0000","last_became_peered":"2024-04-16T15:35:46.903559+0000","last_unstale":"2024-04-16T15:35:55.083878+0000","last_undegraded":"2024-04-16T15:35:55.083878+0000","last_fullsized":"2024-04-16T15:35:55.083878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928439+0000","last_change":"2024-04-16T15:35:47.906302+0000","last_active":"2024-04-16T15:35:53.928439+0000","last_peered":"2024-04-16T15:35:53.928439+0000","last_clean":"2024-04-16T15:35:53.928439+0000","last_became_active":"2024-04-16T15:35:47.905445+0000","last_became_peered":"2024-04-16T15:35:47.905445+0000","last_unstale":"2024-04-16T15:35:53.928439+0000","last_undegraded":"2024-04-16T15:35:53.928439+0000","last_fullsized":"2024-04-16T15:35:53.928439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927788+0000","last_change":"2024-04-16T15:35:52.665449+0000","last_active":"2024-04-16T15:35:53.927788+0000","last_peered":"2024-04-16T15:35:53.927788+0000","last_clean":"2024-04-16T15:35:53.927788+0000","last_became_active":"2024-04-16T15:35:52.665084+0000","last_became_peered":"2024-04-16T15:35:52.665084+0000","last_unstale":"2024-04-16T15:35:53.927788+0000","last_undegraded":"2024-04-16T15:35:53.927788+0000","last_fullsized":"2024-04-16T15:35:53.927788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:19:37.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928611+0000","last_change":"2024-04-16T15:35:46.898739+0000","last_active":"2024-04-16T15:35:53.928611+0000","last_peered":"2024-04-16T15:35:53.928611+0000","last_clean":"2024-04-16T15:35:53.928611+0000","last_became_active":"2024-04-16T15:35:46.898423+0000","last_became_peered":"2024-04-16T15:35:46.898423+0000","last_unstale":"2024-04-16T15:35:53.928611+0000","last_undegraded":"2024-04-16T15:35:53.928611+0000","last_fullsized":"2024-04-16T15:35:53.928611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083665+0000","last_change":"2024-04-16T15:35:47.907617+0000","last_active":"2024-04-16T15:35:55.083665+0000","last_peered":"2024-04-16T15:35:55.083665+0000","last_clean":"2024-04-16T15:35:55.083665+0000","last_became_active":"2024-04-16T15:35:47.907273+0000","last_became_peered":"2024-04-16T15:35:47.907273+0000","last_unstale":"2024-04-16T15:35:55.083665+0000","last_undegraded":"2024-04-16T15:35:55.083665+0000","last_fullsized":"2024-04-16T15:35:55.083665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:55.452016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930079+0000","last_change":"2024-04-16T15:35:51.944987+0000","last_active":"2024-04-16T15:35:53.930079+0000","last_peered":"2024-04-16T15:35:53.930079+0000","last_clean":"2024-04-16T15:35:53.930079+0000","last_became_active":"2024-04-16T15:35:51.944345+0000","last_became_peered":"2024-04-16T15:35:51.944345+0000","last_unstale":"2024-04-16T15:35:53.930079+0000","last_undegraded":"2024-04-16T15:35:53.930079+0000","last_fullsized":"2024-04-16T15:35:53.930079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082829+0000","last_change":"2024-04-16T15:35:46.902233+0000","last_active":"2024-04-16T15:35:55.082829+0000","last_peered":"2024-04-16T15:35:55.082829+0000","last_clean":"2024-04-16T15:35:55.082829+0000","last_became_active":"2024-04-16T15:35:46.901940+0000","last_became_peered":"2024-04-16T15:35:46.901940+0000","last_unstale":"2024-04-16T15:35:55.082829+0000","last_undegraded":"2024-04-16T15:35:55.082829+0000","last_fullsized":"2024-04-16T15:35:55.082829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930367+0000","last_change":"2024-04-16T15:35:47.898146+0000","last_active":"2024-04-16T15:35:53.930367+0000","last_peered":"2024-04-16T15:35:53.930367+0000","last_clean":"2024-04-16T15:35:53.930367+0000","last_became_active":"2024-04-16T15:35:47.897840+0000","last_became_peered":"2024-04-16T15:35:47.897840+0000","last_unstale":"2024-04-16T15:35:53.930367+0000","last_undegraded":"2024-04-16T15:35:53.930367+0000","last_fullsized":"2024-04-16T15:35:53.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930469+0000","last_change":"2024-04-16T15:35:51.945269+0000","last_active":"2024-04-16T15:35:53.930469+0000","last_peered":"2024-04-16T15:35:53.930469+0000","last_clean":"2024-04-16T15:35:53.930469+0000","last_became_active":"2024-04-16T15:35:51.943815+0000","last_became_peered":"2024-04-16T15:35:51.943815+0000","last_unstale":"2024-04-16T15:35:53.930469+0000","last_undegraded":"2024-04-16T15:35:53.930469+0000","last_fullsized":"2024-04-16T15:35:53.930469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082796+0000","last_change":"2024-04-16T15:35:46.901105+0000","last_active":"2024-04-16T15:35:55.082796+0000","last_peered":"2024-04-16T15:35:55.082796+0000","last_clean":"2024-04-16T15:35:55.082796+0000","last_became_active":"2024-04-16T15:35:46.900800+0000","last_became_peered":"2024-04-16T15:35:46.900800+0000","last_unstale":"2024-04-16T15:35:55.082796+0000","last_undegraded":"2024-04-16T15:35:55.082796+0000","last_fullsized":"2024-04-16T15:35:55.082796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:11.448206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930964+0000","last_change":"2024-04-16T15:35:47.897967+0000","last_active":"2024-04-16T15:35:53.930964+0000","last_peered":"2024-04-16T15:35:53.930964+0000","last_clean":"2024-04-16T15:35:53.930964+0000","last_became_active":"2024-04-16T15:35:47.897689+0000","last_became_peered":"2024-04-16T15:35:47.897689+0000","last_unstale":"2024-04-16T15:35:53.930964+0000","last_undegraded":"2024-04-16T15:35:53.930964+0000","last_fullsized":"2024-04-16T15:35:53.930964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930582+0000","last_change":"2024-04-16T15:35:51.945075+0000","last_active":"2024-04-16T15:35:53.930582+0000","last_peered":"2024-04-16T15:35:53.930582+0000","last_clean":"2024-04-16T15:35:53.930582+0000","last_became_active":"2024-04-16T15:35:51.944674+0000","last_became_peered":"2024-04-16T15:35:51.944674+0000","last_unstale":"2024-04-16T15:35:53.930582+0000","last_undegraded":"2024-04-16T15:35:53.930582+0000","last_fullsized":"2024-04-16T15:35:53.930582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368841+0000","last_change":"2024-04-16T15:35:47.906053+0000","last_active":"2024-04-16T15:35:54.368841+0000","last_peered":"2024-04-16T15:35:54.368841+0000","last_clean":"2024-04-16T15:35:54.368841+0000","last_became_active":"2024-04-16T15:35:47.905735+0000","last_became_peered":"2024-04-16T15:35:47.905735+0000","last_unstale":"2024-04-16T15:35:54.368841+0000","last_undegraded":"2024-04-16T15:35:54.368841+0000","last_fullsized":"2024-04-16T15:35:54.368841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082789+0000","last_change":"2024-04-16T15:35:46.903005+0000","last_active":"2024-04-16T15:35:55.082789+0000","last_peered":"2024-04-16T15:35:55.082789+0000","last_clean":"2024-04-16T15:35:55.082789+0000","last_became_active":"2024-04-16T15:35:46.902690+0000","last_became_peered":"2024-04-16T15:35:46.902690+0000","last_unstale":"2024-04-16T15:35:55.082789+0000","last_undegraded":"2024-04-16T15:35:55.082789+0000","last_fullsized":"2024-04-16T15:35:55.082789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931392+0000","last_change":"2024-04-16T15:35:51.944672+0000","last_active":"2024-04-16T15:35:53.931392+0000","last_peered":"2024-04-16T15:35:53.931392+0000","last_clean":"2024-04-16T15:35:53.931392+0000","last_became_active":"2024-04-16T15:35:51.943902+0000","last_became_peered":"2024-04-16T15:35:51.943902+0000","last_unstale":"2024-04-16T15:35:53.931392+0000","last_undegraded":"2024-04-16T15:35:53.931392+0000","last_fullsized":"2024-04-16T15:35:53.931392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927970+0000","last_change":"2024-04-16T15:35:47.911396+0000","last_active":"2024-04-16T15:35:53.927970+0000","last_peered":"2024-04-16T15:35:53.927970+0000","last_clean":"2024-04-16T15:35:53.927970+0000","last_became_active":"2024-04-16T15:35:47.910994+0000","last_became_peered":"2024-04-16T15:35:47.910994+0000","last_unstale":"2024-04-16T15:35:53.927970+0000","last_undegraded":"2024-04-16T15:35:53.927970+0000","last_fullsized":"2024-04-16T15:35:53.927970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084084+0000","last_change":"2024-04-16T15:35:46.900976+0000","last_active":"2024-04-16T15:35:55.084084+0000","last_peered":"2024-04-16T15:35:55.084084+0000","last_clean":"2024-04-16T15:35:55.084084+0000","last_became_active":"2024-04-16T15:35:46.900725+0000","last_became_peered":"2024-04-16T15:35:46.900725+0000","last_unstale":"2024-04-16T15:35:55.084084+0000","last_undegraded":"2024-04-16T15:35:55.084084+0000","last_fullsized":"2024-04-16T15:35:55.084084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931016+0000","last_change":"2024-04-16T15:35:51.941220+0000","last_active":"2024-04-16T15:35:53.931016+0000","last_peered":"2024-04-16T15:35:53.931016+0000","last_clean":"2024-04-16T15:35:53.931016+0000","last_became_active":"2024-04-16T15:35:51.940585+0000","last_became_peered":"2024-04-16T15:35:51.940585+0000","last_unstale":"2024-04-16T15:35:53.931016+0000","last_undegraded":"2024-04-16T15:35:53.931016+0000","last_fullsized":"2024-04-16T15:35:53.931016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927961+0000","last_change":"2024-04-16T15:35:47.911281+0000","last_active":"2024-04-16T15:35:53.927961+0000","last_peered":"2024-04-16T15:35:53.927961+0000","last_clean":"2024-04-16T15:35:53.927961+0000","last_became_active":"2024-04-16T15:35:47.910748+0000","last_became_peered":"2024-04-16T15:35:47.910748+0000","last_unstale":"2024-04-16T15:35:53.927961+0000","last_undegraded":"2024-04-16T15:35:53.927961+0000","last_fullsized":"2024-04-16T15:35:53.927961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083203+0000","last_change":"2024-04-16T15:35:46.902533+0000","last_active":"2024-04-16T15:35:55.083203+0000","last_peered":"2024-04-16T15:35:55.083203+0000","last_clean":"2024-04-16T15:35:55.083203+0000","last_became_active":"2024-04-16T15:35:46.902221+0000","last_became_peered":"2024-04-16T15:35:46.902221+0000","last_unstale":"2024-04-16T15:35:55.083203+0000","last_undegraded":"2024-04-16T15:35:55.083203+0000","last_fullsized":"2024-04-16T15:35:55.083203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083349+0000","last_change":"2024-04-16T15:35:52.664607+0000","last_active":"2024-04-16T15:35:55.083349+0000","last_peered":"2024-04-16T15:35:55.083349+0000","last_clean":"2024-04-16T15:35:55.083349+0000","last_became_active":"2024-04-16T15:35:52.664234+0000","last_became_peered":"2024-04-16T15:35:52.664234+0000","last_unstale":"2024-04-16T15:35:55.083349+0000","last_undegraded":"2024-04-16T15:35:55.083349+0000","last_fullsized":"2024-04-16T15:35:55.083349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930192+0000","last_change":"2024-04-16T15:35:47.913469+0000","last_active":"2024-04-16T15:35:53.930192+0000","last_peered":"2024-04-16T15:35:53.930192+0000","last_clean":"2024-04-16T15:35:53.930192+0000","last_became_active":"2024-04-16T15:35:47.912952+0000","last_became_peered":"2024-04-16T15:35:47.912952+0000","last_unstale":"2024-04-16T15:35:53.930192+0000","last_undegraded":"2024-04-16T15:35:53.930192+0000","last_fullsized":"2024-04-16T15:35:53.930192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:12.452242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083012+0000","last_change":"2024-04-16T15:35:46.903630+0000","last_active":"2024-04-16T15:35:55.083012+0000","last_peered":"2024-04-16T15:35:55.083012+0000","last_clean":"2024-04-16T15:35:55.083012+0000","last_became_active":"2024-04-16T15:35:46.903282+0000","last_became_peered":"2024-04-16T15:35:46.903282+0000","last_unstale":"2024-04-16T15:35:55.083012+0000","last_undegraded":"2024-04-16T15:35:55.083012+0000","last_fullsized":"2024-04-16T15:35:55.083012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930012+0000","last_change":"2024-04-16T15:35:51.944348+0000","last_active":"2024-04-16T15:35:53.930012+0000","last_peered":"2024-04-16T15:35:53.930012+0000","last_clean":"2024-04-16T15:35:53.930012+0000","last_became_active":"2024-04-16T15:35:51.943917+0000","last_became_peered":"2024-04-16T15:35:51.943917+0000","last_unstale":"2024-04-16T15:35:53.930012+0000","last_undegraded":"2024-04-16T15:35:53.930012+0000","last_fullsized":"2024-04-16T15:35:53.930012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083778+0000","last_change":"2024-04-16T15:35:47.909155+0000","last_active":"2024-04-16T15:35:55.083778+0000","last_peered":"2024-04-16T15:35:55.083778+0000","last_clean":"2024-04-16T15:35:55.083778+0000","last_became_active":"2024-04-16T15:35:47.908864+0000","last_became_peered":"2024-04-16T15:35:47.908864+0000","last_unstale":"2024-04-16T15:35:55.083778+0000","last_undegraded":"2024-04-16T15:35:55.083778+0000","last_fullsized":"2024-04-16T15:35:55.083778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369537+0000","last_change":"2024-04-16T15:35:46.899721+0000","last_active":"2024-04-16T15:35:54.369537+0000","last_peered":"2024-04-16T15:35:54.369537+0000","last_clean":"2024-04-16T15:35:54.369537+0000","last_became_active":"2024-04-16T15:35:46.899479+0000","last_became_peered":"2024-04-16T15:35:46.899479+0000","last_unstale":"2024-04-16T15:35:54.369537+0000","last_undegraded":"2024-04-16T15:35:54.369537+0000","last_fullsized":"2024-04-16T15:35:54.369537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929961+0000","last_change":"2024-04-16T15:35:52.664780+0000","last_active":"2024-04-16T15:35:53.929961+0000","last_peered":"2024-04-16T15:35:53.929961+0000","last_clean":"2024-04-16T15:35:53.929961+0000","last_became_active":"2024-04-16T15:35:52.664358+0000","last_became_peered":"2024-04-16T15:35:52.664358+0000","last_unstale":"2024-04-16T15:35:53.929961+0000","last_undegraded":"2024-04-16T15:35:53.929961+0000","last_fullsized":"2024-04-16T15:35:53.929961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928626+0000","last_change":"2024-04-16T15:35:47.919497+0000","last_active":"2024-04-16T15:35:53.928626+0000","last_peered":"2024-04-16T15:35:53.928626+0000","last_clean":"2024-04-16T15:35:53.928626+0000","last_became_active":"2024-04-16T15:35:47.919212+0000","last_became_peered":"2024-04-16T15:35:47.919212+0000","last_unstale":"2024-04-16T15:35:53.928626+0000","last_undegraded":"2024-04-16T15:35:53.928626+0000","last_fullsized":"2024-04-16T15:35:53.928626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082805+0000","last_change":"2024-04-16T15:35:46.900937+0000","last_active":"2024-04-16T15:35:55.082805+0000","last_peered":"2024-04-16T15:35:55.082805+0000","last_clean":"2024-04-16T15:35:55.082805+0000","last_became_active":"2024-04-16T15:35:46.900654+0000","last_became_peered":"2024-04-16T15:35:46.900654+0000","last_unstale":"2024-04-16T15:35:55.082805+0000","last_undegraded":"2024-04-16T15:35:55.082805+0000","last_fullsized":"2024-04-16T15:35:55.082805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927710+0000","last_change":"2024-04-16T15:35:52.665635+0000","last_active":"2024-04-16T15:35:53.927710+0000","last_peered":"2024-04-16T15:35:53.927710+0000","last_clean":"2024-04-16T15:35:53.927710+0000","last_became_active":"2024-04-16T15:35:52.665117+0000","last_became_peered":"2024-04-16T15:35:52.665117+0000","last_unstale":"2024-04-16T15:35:53.927710+0000","last_undegraded":"2024-04-16T15:35:53.927710+0000","last_fullsized":"2024-04-16T15:35:53.927710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:14.451474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084034+0000","last_change":"2024-04-16T15:35:47.911904+0000","last_active":"2024-04-16T15:35:55.084034+0000","last_peered":"2024-04-16T15:35:55.084034+0000","last_clean":"2024-04-16T15:35:55.084034+0000","last_became_active":"2024-04-16T15:35:47.911640+0000","last_became_peered":"2024-04-16T15:35:47.911640+0000","last_unstale":"2024-04-16T15:35:55.084034+0000","last_undegraded":"2024-04-16T15:35:55.084034+0000","last_fullsized":"2024-04-16T15:35:55.084034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083711+0000","last_change":"2024-04-16T15:35:46.903622+0000","last_active":"2024-04-16T15:35:55.083711+0000","last_peered":"2024-04-16T15:35:55.083711+0000","last_clean":"2024-04-16T15:35:55.083711+0000","last_became_active":"2024-04-16T15:35:46.903301+0000","last_became_peered":"2024-04-16T15:35:46.903301+0000","last_unstale":"2024-04-16T15:35:55.083711+0000","last_undegraded":"2024-04-16T15:35:55.083711+0000","last_fullsized":"2024-04-16T15:35:55.083711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083996+0000","last_change":"2024-04-16T15:35:52.662090+0000","last_active":"2024-04-16T15:35:55.083996+0000","last_peered":"2024-04-16T15:35:55.083996+0000","last_clean":"2024-04-16T15:35:55.083996+0000","last_became_active":"2024-04-16T15:35:52.661689+0000","last_became_peered":"2024-04-16T15:35:52.661689+0000","last_unstale":"2024-04-16T15:35:55.083996+0000","last_undegraded":"2024-04-16T15:35:55.083996+0000","last_fullsized":"2024-04-16T15:35:55.083996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931070+0000","last_change":"2024-04-16T15:35:47.912680+0000","last_active":"2024-04-16T15:35:53.931070+0000","last_peered":"2024-04-16T15:35:53.931070+0000","last_clean":"2024-04-16T15:35:53.931070+0000","last_became_active":"2024-04-16T15:35:47.912362+0000","last_became_peered":"2024-04-16T15:35:47.912362+0000","last_unstale":"2024-04-16T15:35:53.931070+0000","last_undegraded":"2024-04-16T15:35:53.931070+0000","last_fullsized":"2024-04-16T15:35:53.931070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084115+0000","last_change":"2024-04-16T15:35:46.902183+0000","last_active":"2024-04-16T15:35:55.084115+0000","last_peered":"2024-04-16T15:35:55.084115+0000","last_clean":"2024-04-16T15:35:55.084115+0000","last_became_active":"2024-04-16T15:35:46.901974+0000","last_became_peered":"2024-04-16T15:35:46.901974+0000","last_unstale":"2024-04-16T15:35:55.084115+0000","last_undegraded":"2024-04-16T15:35:55.084115+0000","last_fullsized":"2024-04-16T15:35:55.084115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084296+0000","last_change":"2024-04-16T15:35:51.944263+0000","last_active":"2024-04-16T15:35:55.084296+0000","last_peered":"2024-04-16T15:35:55.084296+0000","last_clean":"2024-04-16T15:35:55.084296+0000","last_became_active":"2024-04-16T15:35:51.943863+0000","last_became_peered":"2024-04-16T15:35:51.943863+0000","last_unstale":"2024-04-16T15:35:55.084296+0000","last_undegraded":"2024-04-16T15:35:55.084296+0000","last_fullsized":"2024-04-16T15:35:55.084296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930852+0000","last_change":"2024-04-16T15:35:47.904118+0000","last_active":"2024-04-16T15:35:53.930852+0000","last_peered":"2024-04-16T15:35:53.930852+0000","last_clean":"2024-04-16T15:35:53.930852+0000","last_became_active":"2024-04-16T15:35:47.903698+0000","last_became_peered":"2024-04-16T15:35:47.903698+0000","last_unstale":"2024-04-16T15:35:53.930852+0000","last_undegraded":"2024-04-16T15:35:53.930852+0000","last_fullsized":"2024-04-16T15:35:53.930852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930850+0000","last_change":"2024-04-16T15:35:46.902362+0000","last_active":"2024-04-16T15:35:53.930850+0000","last_peered":"2024-04-16T15:35:53.930850+0000","last_clean":"2024-04-16T15:35:53.930850+0000","last_became_active":"2024-04-16T15:35:46.902062+0000","last_became_peered":"2024-04-16T15:35:46.902062+0000","last_unstale":"2024-04-16T15:35:53.930850+0000","last_undegraded":"2024-04-16T15:35:53.930850+0000","last_fullsized":"2024-04-16T15:35:53.930850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083986+0000","last_change":"2024-04-16T15:35:51.947084+0000","last_active":"2024-04-16T15:35:55.083986+0000","last_peered":"2024-04-16T15:35:55.083986+0000","last_clean":"2024-04-16T15:35:55.083986+0000","last_became_active":"2024-04-16T15:35:51.946724+0000","last_became_peered":"2024-04-16T15:35:51.946724+0000","last_unstale":"2024-04-16T15:35:55.083986+0000","last_undegraded":"2024-04-16T15:35:55.083986+0000","last_fullsized":"2024-04-16T15:35:55.083986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083003+0000","last_change":"2024-04-16T15:35:47.912577+0000","last_active":"2024-04-16T15:35:55.083003+0000","last_peered":"2024-04-16T15:35:55.083003+0000","last_clean":"2024-04-16T15:35:55.083003+0000","last_became_active":"2024-04-16T15:35:47.911408+0000","last_became_peered":"2024-04-16T15:35:47.911408+0000","last_unstale":"2024-04-16T15:35:55.083003+0000","last_undegraded":"2024-04-16T15:35:55.083003+0000","last_fullsized":"2024-04-16T15:35:55.083003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571080+0000","last_change":"2024-04-16T15:35:46.894699+0000","last_active":"2024-04-16T15:35:54.571080+0000","last_peered":"2024-04-16T15:35:54.571080+0000","last_clean":"2024-04-16T15:35:54.571080+0000","last_became_active":"2024-04-16T15:35:46.894408+0000","last_became_peered":"2024-04-16T15:35:46.894408+0000","last_unstale":"2024-04-16T15:35:54.571080+0000","last_undegraded":"2024-04-16T15:35:54.571080+0000","last_fullsized":"2024-04-16T15:35:54.571080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083498+0000","last_change":"2024-04-16T15:35:51.941063+0000","last_active":"2024-04-16T15:35:55.083498+0000","last_peered":"2024-04-16T15:35:55.083498+0000","last_clean":"2024-04-16T15:35:55.083498+0000","last_became_active":"2024-04-16T15:35:51.940669+0000","last_became_peered":"2024-04-16T15:35:51.940669+0000","last_unstale":"2024-04-16T15:35:55.083498+0000","last_undegraded":"2024-04-16T15:35:55.083498+0000","last_fullsized":"2024-04-16T15:35:55.083498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083196+0000","last_change":"2024-04-16T15:35:47.904932+0000","last_active":"2024-04-16T15:35:55.083196+0000","last_peered":"2024-04-16T15:35:55.083196+0000","last_clean":"2024-04-16T15:35:55.083196+0000","last_became_active":"2024-04-16T15:35:47.902287+0000","last_became_peered":"2024-04-16T15:35:47.902287+0000","last_unstale":"2024-04-16T15:35:55.083196+0000","last_undegraded":"2024-04-16T15:35:55.083196+0000","last_fullsized":"2024-04-16T15:35:55.083196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:46.901553+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:46.901306+0000","last_became_peered":"2024-04-16T15:35:46.901306+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083417+0000","last_change":"2024-04-16T15:35:52.664769+0000","last_active":"2024-04-16T15:35:55.083417+0000","last_peered":"2024-04-16T15:35:55.083417+0000","last_clean":"2024-04-16T15:35:55.083417+0000","last_became_active":"2024-04-16T15:35:52.664412+0000","last_became_peered":"2024-04-16T15:35:52.664412+0000","last_unstale":"2024-04-16T15:35:55.083417+0000","last_undegraded":"2024-04-16T15:35:55.083417+0000","last_fullsized":"2024-04-16T15:35:55.083417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927849+0000","last_change":"2024-04-16T15:35:47.922561+0000","last_active":"2024-04-16T15:35:53.927849+0000","last_peered":"2024-04-16T15:35:53.927849+0000","last_clean":"2024-04-16T15:35:53.927849+0000","last_became_active":"2024-04-16T15:35:47.922290+0000","last_became_peered":"2024-04-16T15:35:47.922290+0000","last_unstale":"2024-04-16T15:35:53.927849+0000","last_undegraded":"2024-04-16T15:35:53.927849+0000","last_fullsized":"2024-04-16T15:35:53.927849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930657+0000","last_change":"2024-04-16T15:35:46.896323+0000","last_active":"2024-04-16T15:35:53.930657+0000","last_peered":"2024-04-16T15:35:53.930657+0000","last_clean":"2024-04-16T15:35:53.930657+0000","last_became_active":"2024-04-16T15:35:46.895810+0000","last_became_peered":"2024-04-16T15:35:46.895810+0000","last_unstale":"2024-04-16T15:35:53.930657+0000","last_undegraded":"2024-04-16T15:35:53.930657+0000","last_fullsized":"2024-04-16T15:35:53.930657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083251+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:35:55.083251+0000","last_peered":"2024-04-16T15:35:55.083251+0000","last_clean":"2024-04-16T15:35:55.083251+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:35:55.083251+0000","last_undegraded":"2024-04-16T15:35:55.083251+0000","last_fullsized":"2024-04-16T15:35:55.083251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369307+0000","last_change":"2024-04-16T15:35:52.664786+0000","last_active":"2024-04-16T15:35:54.369307+0000","last_peered":"2024-04-16T15:35:54.369307+0000","last_clean":"2024-04-16T15:35:54.369307+0000","last_became_active":"2024-04-16T15:35:52.664391+0000","last_became_peered":"2024-04-16T15:35:52.664391+0000","last_unstale":"2024-04-16T15:35:54.369307+0000","last_undegraded":"2024-04-16T15:35:54.369307+0000","last_fullsized":"2024-04-16T15:35:54.369307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083545+0000","last_change":"2024-04-16T15:35:47.922117+0000","last_active":"2024-04-16T15:35:55.083545+0000","last_peered":"2024-04-16T15:35:55.083545+0000","last_clean":"2024-04-16T15:35:55.083545+0000","last_became_active":"2024-04-16T15:35:47.921710+0000","last_became_peered":"2024-04-16T15:35:47.921710+0000","last_unstale":"2024-04-16T15:35:55.083545+0000","last_undegraded":"2024-04-16T15:35:55.083545+0000","last_fullsized":"2024-04-16T15:35:55.083545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571271+0000","last_change":"2024-04-16T15:35:46.896754+0000","last_active":"2024-04-16T15:35:54.571271+0000","last_peered":"2024-04-16T15:35:54.571271+0000","last_clean":"2024-04-16T15:35:54.571271+0000","last_became_active":"2024-04-16T15:35:46.896444+0000","last_became_peered":"2024-04-16T15:35:46.896444+0000","last_unstale":"2024-04-16T15:35:54.571271+0000","last_undegraded":"2024-04-16T15:35:54.571271+0000","last_fullsized":"2024-04-16T15:35:54.571271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368973+0000","last_change":"2024-04-16T15:35:52.662295+0000","last_active":"2024-04-16T15:35:54.368973+0000","last_peered":"2024-04-16T15:35:54.368973+0000","last_clean":"2024-04-16T15:35:54.368973+0000","last_became_active":"2024-04-16T15:35:52.661789+0000","last_became_peered":"2024-04-16T15:35:52.661789+0000","last_unstale":"2024-04-16T15:35:54.368973+0000","last_undegraded":"2024-04-16T15:35:54.368973+0000","last_fullsized":"2024-04-16T15:35:54.368973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930470+0000","last_change":"2024-04-16T15:35:47.915448+0000","last_active":"2024-04-16T15:35:53.930470+0000","last_peered":"2024-04-16T15:35:53.930470+0000","last_clean":"2024-04-16T15:35:53.930470+0000","last_became_active":"2024-04-16T15:35:47.915151+0000","last_became_peered":"2024-04-16T15:35:47.915151+0000","last_unstale":"2024-04-16T15:35:53.930470+0000","last_undegraded":"2024-04-16T15:35:53.930470+0000","last_fullsized":"2024-04-16T15:35:53.930470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082565+0000","last_change":"2024-04-16T15:35:46.897447+0000","last_active":"2024-04-16T15:35:55.082565+0000","last_peered":"2024-04-16T15:35:55.082565+0000","last_clean":"2024-04-16T15:35:55.082565+0000","last_became_active":"2024-04-16T15:35:46.897179+0000","last_became_peered":"2024-04-16T15:35:46.897179+0000","last_unstale":"2024-04-16T15:35:55.082565+0000","last_undegraded":"2024-04-16T15:35:55.082565+0000","last_fullsized":"2024-04-16T15:35:55.082565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084143+0000","last_change":"2024-04-16T15:35:51.944235+0000","last_active":"2024-04-16T15:35:55.084143+0000","last_peered":"2024-04-16T15:35:55.084143+0000","last_clean":"2024-04-16T15:35:55.084143+0000","last_became_active":"2024-04-16T15:35:51.943896+0000","last_became_peered":"2024-04-16T15:35:51.943896+0000","last_unstale":"2024-04-16T15:35:55.084143+0000","last_undegraded":"2024-04-16T15:35:55.084143+0000","last_fullsized":"2024-04-16T15:35:55.084143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083827+0000","last_change":"2024-04-16T15:35:47.918103+0000","last_active":"2024-04-16T15:35:55.083827+0000","last_peered":"2024-04-16T15:35:55.083827+0000","last_clean":"2024-04-16T15:35:55.083827+0000","last_became_active":"2024-04-16T15:35:47.917822+0000","last_became_peered":"2024-04-16T15:35:47.917822+0000","last_unstale":"2024-04-16T15:35:55.083827+0000","last_undegraded":"2024-04-16T15:35:55.083827+0000","last_fullsized":"2024-04-16T15:35:55.083827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:17.070863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571348+0000","last_change":"2024-04-16T15:35:46.894341+0000","last_active":"2024-04-16T15:35:54.571348+0000","last_peered":"2024-04-16T15:35:54.571348+0000","last_clean":"2024-04-16T15:35:54.571348+0000","last_became_active":"2024-04-16T15:35:46.894073+0000","last_became_peered":"2024-04-16T15:35:46.894073+0000","last_unstale":"2024-04-16T15:35:54.571348+0000","last_undegraded":"2024-04-16T15:35:54.571348+0000","last_fullsized":"2024-04-16T15:35:54.571348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929370+0000","last_change":"2024-04-16T15:35:52.662624+0000","last_active":"2024-04-16T15:35:53.929370+0000","last_peered":"2024-04-16T15:35:53.929370+0000","last_clean":"2024-04-16T15:35:53.929370+0000","last_became_active":"2024-04-16T15:35:52.661957+0000","last_became_peered":"2024-04-16T15:35:52.661957+0000","last_unstale":"2024-04-16T15:35:53.929370+0000","last_undegraded":"2024-04-16T15:35:53.929370+0000","last_fullsized":"2024-04-16T15:35:53.929370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083699+0000","last_change":"2024-04-16T15:35:47.918195+0000","last_active":"2024-04-16T15:35:55.083699+0000","last_peered":"2024-04-16T15:35:55.083699+0000","last_clean":"2024-04-16T15:35:55.083699+0000","last_became_active":"2024-04-16T15:35:47.917803+0000","last_became_peered":"2024-04-16T15:35:47.917803+0000","last_unstale":"2024-04-16T15:35:55.083699+0000","last_undegraded":"2024-04-16T15:35:55.083699+0000","last_fullsized":"2024-04-16T15:35:55.083699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930244+0000","last_change":"2024-04-16T15:35:46.899018+0000","last_active":"2024-04-16T15:35:53.930244+0000","last_peered":"2024-04-16T15:35:53.930244+0000","last_clean":"2024-04-16T15:35:53.930244+0000","last_became_active":"2024-04-16T15:35:46.898729+0000","last_became_peered":"2024-04-16T15:35:46.898729+0000","last_unstale":"2024-04-16T15:35:53.930244+0000","last_undegraded":"2024-04-16T15:35:53.930244+0000","last_fullsized":"2024-04-16T15:35:53.930244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929608+0000","last_change":"2024-04-16T15:35:51.941144+0000","last_active":"2024-04-16T15:35:53.929608+0000","last_peered":"2024-04-16T15:35:53.929608+0000","last_clean":"2024-04-16T15:35:53.929608+0000","last_became_active":"2024-04-16T15:35:51.940597+0000","last_became_peered":"2024-04-16T15:35:51.940597+0000","last_unstale":"2024-04-16T15:35:53.929608+0000","last_undegraded":"2024-04-16T15:35:53.929608+0000","last_fullsized":"2024-04-16T15:35:53.929608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:41.324458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083262+0000","last_change":"2024-04-16T15:35:47.914496+0000","last_active":"2024-04-16T15:35:55.083262+0000","last_peered":"2024-04-16T15:35:55.083262+0000","last_clean":"2024-04-16T15:35:55.083262+0000","last_became_active":"2024-04-16T15:35:47.913786+0000","last_became_peered":"2024-04-16T15:35:47.913786+0000","last_unstale":"2024-04-16T15:35:55.083262+0000","last_undegraded":"2024-04-16T15:35:55.083262+0000","last_fullsized":"2024-04-16T15:35:55.083262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570927+0000","last_change":"2024-04-16T15:35:46.897628+0000","last_active":"2024-04-16T15:35:54.570927+0000","last_peered":"2024-04-16T15:35:54.570927+0000","last_clean":"2024-04-16T15:35:54.570927+0000","last_became_active":"2024-04-16T15:35:46.897367+0000","last_became_peered":"2024-04-16T15:35:46.897367+0000","last_unstale":"2024-04-16T15:35:54.570927+0000","last_undegraded":"2024-04-16T15:35:54.570927+0000","last_fullsized":"2024-04-16T15:35:54.570927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083283+0000","last_change":"2024-04-16T15:35:51.945992+0000","last_active":"2024-04-16T15:35:55.083283+0000","last_peered":"2024-04-16T15:35:55.083283+0000","last_clean":"2024-04-16T15:35:55.083283+0000","last_became_active":"2024-04-16T15:35:51.945596+0000","last_became_peered":"2024-04-16T15:35:51.945596+0000","last_unstale":"2024-04-16T15:35:55.083283+0000","last_undegraded":"2024-04-16T15:35:55.083283+0000","last_fullsized":"2024-04-16T15:35:55.083283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368868+0000","last_change":"2024-04-16T15:35:47.910686+0000","last_active":"2024-04-16T15:35:54.368868+0000","last_peered":"2024-04-16T15:35:54.368868+0000","last_clean":"2024-04-16T15:35:54.368868+0000","last_became_active":"2024-04-16T15:35:47.910289+0000","last_became_peered":"2024-04-16T15:35:47.910289+0000","last_unstale":"2024-04-16T15:35:54.368868+0000","last_undegraded":"2024-04-16T15:35:54.368868+0000","last_fullsized":"2024-04-16T15:35:54.368868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368949+0000","last_change":"2024-04-16T15:35:46.899316+0000","last_active":"2024-04-16T15:35:54.368949+0000","last_peered":"2024-04-16T15:35:54.368949+0000","last_clean":"2024-04-16T15:35:54.368949+0000","last_became_active":"2024-04-16T15:35:46.899031+0000","last_became_peered":"2024-04-16T15:35:46.899031+0000","last_unstale":"2024-04-16T15:35:54.368949+0000","last_undegraded":"2024-04-16T15:35:54.368949+0000","last_fullsized":"2024-04-16T15:35:54.368949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928588+0000","last_change":"2024-04-16T15:35:52.665294+0000","last_active":"2024-04-16T15:35:53.928588+0000","last_peered":"2024-04-16T15:35:53.928588+0000","last_clean":"2024-04-16T15:35:53.928588+0000","last_became_active":"2024-04-16T15:35:52.664948+0000","last_became_peered":"2024-04-16T15:35:52.664948+0000","last_unstale":"2024-04-16T15:35:53.928588+0000","last_undegraded":"2024-04-16T15:35:53.928588+0000","last_fullsized":"2024-04-16T15:35:53.928588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:52.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083368+0000","last_change":"2024-04-16T15:35:47.921106+0000","last_active":"2024-04-16T15:35:55.083368+0000","last_peered":"2024-04-16T15:35:55.083368+0000","last_clean":"2024-04-16T15:35:55.083368+0000","last_became_active":"2024-04-16T15:35:47.920831+0000","last_became_peered":"2024-04-16T15:35:47.920831+0000","last_unstale":"2024-04-16T15:35:55.083368+0000","last_undegraded":"2024-04-16T15:35:55.083368+0000","last_fullsized":"2024-04-16T15:35:55.083368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930813+0000","last_change":"2024-04-16T15:35:46.894785+0000","last_active":"2024-04-16T15:35:53.930813+0000","last_peered":"2024-04-16T15:35:53.930813+0000","last_clean":"2024-04-16T15:35:53.930813+0000","last_became_active":"2024-04-16T15:35:46.894416+0000","last_became_peered":"2024-04-16T15:35:46.894416+0000","last_unstale":"2024-04-16T15:35:53.930813+0000","last_undegraded":"2024-04-16T15:35:53.930813+0000","last_fullsized":"2024-04-16T15:35:53.930813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928344+0000","last_change":"2024-04-16T15:35:52.662123+0000","last_active":"2024-04-16T15:35:53.928344+0000","last_peered":"2024-04-16T15:35:53.928344+0000","last_clean":"2024-04-16T15:35:53.928344+0000","last_became_active":"2024-04-16T15:35:52.661758+0000","last_became_peered":"2024-04-16T15:35:52.661758+0000","last_unstale":"2024-04-16T15:35:53.928344+0000","last_undegraded":"2024-04-16T15:35:53.928344+0000","last_fullsized":"2024-04-16T15:35:53.928344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:12.922280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083720+0000","last_change":"2024-04-16T15:35:47.916216+0000","last_active":"2024-04-16T15:35:55.083720+0000","last_peered":"2024-04-16T15:35:55.083720+0000","last_clean":"2024-04-16T15:35:55.083720+0000","last_became_active":"2024-04-16T15:35:47.915566+0000","last_became_peered":"2024-04-16T15:35:47.915566+0000","last_unstale":"2024-04-16T15:35:55.083720+0000","last_undegraded":"2024-04-16T15:35:55.083720+0000","last_fullsized":"2024-04-16T15:35:55.083720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082527+0000","last_change":"2024-04-16T15:35:46.897293+0000","last_active":"2024-04-16T15:35:55.082527+0000","last_peered":"2024-04-16T15:35:55.082527+0000","last_clean":"2024-04-16T15:35:55.082527+0000","last_became_active":"2024-04-16T15:35:46.897006+0000","last_became_peered":"2024-04-16T15:35:46.897006+0000","last_unstale":"2024-04-16T15:35:55.082527+0000","last_undegraded":"2024-04-16T15:35:55.082527+0000","last_fullsized":"2024-04-16T15:35:55.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931065+0000","last_change":"2024-04-16T15:35:52.664883+0000","last_active":"2024-04-16T15:35:53.931065+0000","last_peered":"2024-04-16T15:35:53.931065+0000","last_clean":"2024-04-16T15:35:53.931065+0000","last_became_active":"2024-04-16T15:35:52.664454+0000","last_became_peered":"2024-04-16T15:35:52.664454+0000","last_unstale":"2024-04-16T15:35:53.931065+0000","last_undegraded":"2024-04-16T15:35:53.931065+0000","last_fullsized":"2024-04-16T15:35:53.931065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083452+0000","last_change":"2024-04-16T15:35:47.922333+0000","last_active":"2024-04-16T15:35:55.083452+0000","last_peered":"2024-04-16T15:35:55.083452+0000","last_clean":"2024-04-16T15:35:55.083452+0000","last_became_active":"2024-04-16T15:35:47.922051+0000","last_became_peered":"2024-04-16T15:35:47.922051+0000","last_unstale":"2024-04-16T15:35:55.083452+0000","last_undegraded":"2024-04-16T15:35:55.083452+0000","last_fullsized":"2024-04-16T15:35:55.083452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:56.980683+0000","last_change":"2024-04-16T15:35:46.899953+0000","last_active":"2024-04-16T15:35:56.980683+0000","last_peered":"2024-04-16T15:35:56.980683+0000","last_clean":"2024-04-16T15:35:56.980683+0000","last_became_active":"2024-04-16T15:35:46.899684+0000","last_became_peered":"2024-04-16T15:35:46.899684+0000","last_unstale":"2024-04-16T15:35:56.980683+0000","last_undegraded":"2024-04-16T15:35:56.980683+0000","last_fullsized":"2024-04-16T15:35:56.980683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084387+0000","last_change":"2024-04-16T15:35:51.940461+0000","last_active":"2024-04-16T15:35:55.084387+0000","last_peered":"2024-04-16T15:35:55.084387+0000","last_clean":"2024-04-16T15:35:55.084387+0000","last_became_active":"2024-04-16T15:35:51.940074+0000","last_became_peered":"2024-04-16T15:35:51.940074+0000","last_unstale":"2024-04-16T15:35:55.084387+0000","last_undegraded":"2024-04-16T15:35:55.084387+0000","last_fullsized":"2024-04-16T15:35:55.084387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931115+0000","last_change":"2024-04-16T15:35:47.914523+0000","last_active":"2024-04-16T15:35:53.931115+0000","last_peered":"2024-04-16T15:35:53.931115+0000","last_clean":"2024-04-16T15:35:53.931115+0000","last_became_active":"2024-04-16T15:35:47.914263+0000","last_became_peered":"2024-04-16T15:35:47.914263+0000","last_unstale":"2024-04-16T15:35:53.931115+0000","last_undegraded":"2024-04-16T15:35:53.931115+0000","last_fullsized":"2024-04-16T15:35:53.931115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:49.648392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082701+0000","last_change":"2024-04-16T15:35:46.902816+0000","last_active":"2024-04-16T15:35:55.082701+0000","last_peered":"2024-04-16T15:35:55.082701+0000","last_clean":"2024-04-16T15:35:55.082701+0000","last_became_active":"2024-04-16T15:35:46.901873+0000","last_became_peered":"2024-04-16T15:35:46.901873+0000","last_unstale":"2024-04-16T15:35:55.082701+0000","last_undegraded":"2024-04-16T15:35:55.082701+0000","last_fullsized":"2024-04-16T15:35:55.082701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930687+0000","last_change":"2024-04-16T15:35:51.945111+0000","last_active":"2024-04-16T15:35:53.930687+0000","last_peered":"2024-04-16T15:35:53.930687+0000","last_clean":"2024-04-16T15:35:53.930687+0000","last_became_active":"2024-04-16T15:35:51.944177+0000","last_became_peered":"2024-04-16T15:35:51.944177+0000","last_unstale":"2024-04-16T15:35:53.930687+0000","last_undegraded":"2024-04-16T15:35:53.930687+0000","last_fullsized":"2024-04-16T15:35:53.930687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083788+0000","last_change":"2024-04-16T15:35:47.920026+0000","last_active":"2024-04-16T15:35:55.083788+0000","last_peered":"2024-04-16T15:35:55.083788+0000","last_clean":"2024-04-16T15:35:55.083788+0000","last_became_active":"2024-04-16T15:35:47.919754+0000","last_became_peered":"2024-04-16T15:35:47.919754+0000","last_unstale":"2024-04-16T15:35:55.083788+0000","last_undegraded":"2024-04-16T15:35:55.083788+0000","last_fullsized":"2024-04-16T15:35:55.083788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929875+0000","last_change":"2024-04-16T15:35:46.901151+0000","last_active":"2024-04-16T15:35:53.929875+0000","last_peered":"2024-04-16T15:35:53.929875+0000","last_clean":"2024-04-16T15:35:53.929875+0000","last_became_active":"2024-04-16T15:35:46.900666+0000","last_became_peered":"2024-04-16T15:35:46.900666+0000","last_unstale":"2024-04-16T15:35:53.929875+0000","last_undegraded":"2024-04-16T15:35:53.929875+0000","last_fullsized":"2024-04-16T15:35:53.929875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927908+0000","last_change":"2024-04-16T15:35:51.942012+0000","last_active":"2024-04-16T15:35:53.927908+0000","last_peered":"2024-04-16T15:35:53.927908+0000","last_clean":"2024-04-16T15:35:53.927908+0000","last_became_active":"2024-04-16T15:35:51.941666+0000","last_became_peered":"2024-04-16T15:35:51.941666+0000","last_unstale":"2024-04-16T15:35:53.927908+0000","last_undegraded":"2024-04-16T15:35:53.927908+0000","last_fullsized":"2024-04-16T15:35:53.927908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:07.372834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929764+0000","last_change":"2024-04-16T15:35:47.916230+0000","last_active":"2024-04-16T15:35:53.929764+0000","last_peered":"2024-04-16T15:35:53.929764+0000","last_clean":"2024-04-16T15:35:53.929764+0000","last_became_active":"2024-04-16T15:35:47.915930+0000","last_became_peered":"2024-04-16T15:35:47.915930+0000","last_unstale":"2024-04-16T15:35:53.929764+0000","last_undegraded":"2024-04-16T15:35:53.929764+0000","last_fullsized":"2024-04-16T15:35:53.929764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369463+0000","last_change":"2024-04-16T15:35:46.899249+0000","last_active":"2024-04-16T15:35:54.369463+0000","last_peered":"2024-04-16T15:35:54.369463+0000","last_clean":"2024-04-16T15:35:54.369463+0000","last_became_active":"2024-04-16T15:35:46.898904+0000","last_became_peered":"2024-04-16T15:35:46.898904+0000","last_unstale":"2024-04-16T15:35:54.369463+0000","last_undegraded":"2024-04-16T15:35:54.369463+0000","last_fullsized":"2024-04-16T15:35:54.369463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928158+0000","last_change":"2024-04-16T15:35:52.664770+0000","last_active":"2024-04-16T15:35:53.928158+0000","last_peered":"2024-04-16T15:35:53.928158+0000","last_clean":"2024-04-16T15:35:53.928158+0000","last_became_active":"2024-04-16T15:35:52.664405+0000","last_became_peered":"2024-04-16T15:35:52.664405+0000","last_unstale":"2024-04-16T15:35:53.928158+0000","last_undegraded":"2024-04-16T15:35:53.928158+0000","last_fullsized":"2024-04-16T15:35:53.928158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:44.943582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083145+0000","last_change":"2024-04-16T15:35:52.664928+0000","last_active":"2024-04-16T15:35:55.083145+0000","last_peered":"2024-04-16T15:35:55.083145+0000","last_clean":"2024-04-16T15:35:55.083145+0000","last_became_active":"2024-04-16T15:35:52.664390+0000","last_became_peered":"2024-04-16T15:35:52.664390+0000","last_unstale":"2024-04-16T15:35:55.083145+0000","last_undegraded":"2024-04-16T15:35:55.083145+0000","last_fullsized":"2024-04-16T15:35:55.083145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083042+0000","last_change":"2024-04-16T15:35:47.913302+0000","last_active":"2024-04-16T15:35:55.083042+0000","last_peered":"2024-04-16T15:35:55.083042+0000","last_clean":"2024-04-16T15:35:55.083042+0000","last_became_active":"2024-04-16T15:35:47.912246+0000","last_became_peered":"2024-04-16T15:35:47.912246+0000","last_unstale":"2024-04-16T15:35:55.083042+0000","last_undegraded":"2024-04-16T15:35:55.083042+0000","last_fullsized":"2024-04-16T15:35:55.083042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929579+0000","last_change":"2024-04-16T15:35:46.895206+0000","last_active":"2024-04-16T15:35:53.929579+0000","last_peered":"2024-04-16T15:35:53.929579+0000","last_clean":"2024-04-16T15:35:53.929579+0000","last_became_active":"2024-04-16T15:35:46.894912+0000","last_became_peered":"2024-04-16T15:35:46.894912+0000","last_unstale":"2024-04-16T15:35:53.929579+0000","last_undegraded":"2024-04-16T15:35:53.929579+0000","last_fullsized":"2024-04-16T15:35:53.929579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369422+0000","last_change":"2024-04-16T15:35:51.941806+0000","last_active":"2024-04-16T15:35:54.369422+0000","last_peered":"2024-04-16T15:35:54.369422+0000","last_clean":"2024-04-16T15:35:54.369422+0000","last_became_active":"2024-04-16T15:35:51.941433+0000","last_became_peered":"2024-04-16T15:35:51.941433+0000","last_unstale":"2024-04-16T15:35:54.369422+0000","last_undegraded":"2024-04-16T15:35:54.369422+0000","last_fullsized":"2024-04-16T15:35:54.369422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928093+0000","last_change":"2024-04-16T15:35:47.911758+0000","last_active":"2024-04-16T15:35:53.928093+0000","last_peered":"2024-04-16T15:35:53.928093+0000","last_clean":"2024-04-16T15:35:53.928093+0000","last_became_active":"2024-04-16T15:35:47.911245+0000","last_became_peered":"2024-04-16T15:35:47.911245+0000","last_unstale":"2024-04-16T15:35:53.928093+0000","last_undegraded":"2024-04-16T15:35:53.928093+0000","last_fullsized":"2024-04-16T15:35:53.928093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928041+0000","last_change":"2024-04-16T15:35:46.900742+0000","last_active":"2024-04-16T15:35:53.928041+0000","last_peered":"2024-04-16T15:35:53.928041+0000","last_clean":"2024-04-16T15:35:53.928041+0000","last_became_active":"2024-04-16T15:35:46.900416+0000","last_became_peered":"2024-04-16T15:35:46.900416+0000","last_unstale":"2024-04-16T15:35:53.928041+0000","last_undegraded":"2024-04-16T15:35:53.928041+0000","last_fullsized":"2024-04-16T15:35:53.928041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369097+0000","last_change":"2024-04-16T15:35:46.895563+0000","last_active":"2024-04-16T15:35:54.369097+0000","last_peered":"2024-04-16T15:35:54.369097+0000","last_clean":"2024-04-16T15:35:54.369097+0000","last_became_active":"2024-04-16T15:35:46.895267+0000","last_became_peered":"2024-04-16T15:35:46.895267+0000","last_unstale":"2024-04-16T15:35:54.369097+0000","last_undegraded":"2024-04-16T15:35:54.369097+0000","last_fullsized":"2024-04-16T15:35:54.369097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084188+0000","last_change":"2024-04-16T15:35:47.904515+0000","last_active":"2024-04-16T15:35:55.084188+0000","last_peered":"2024-04-16T15:35:55.084188+0000","last_clean":"2024-04-16T15:35:55.084188+0000","last_became_active":"2024-04-16T15:35:47.902329+0000","last_became_peered":"2024-04-16T15:35:47.902329+0000","last_unstale":"2024-04-16T15:35:55.084188+0000","last_undegraded":"2024-04-16T15:35:55.084188+0000","last_fullsized":"2024-04-16T15:35:55.084188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571221+0000","last_change":"2024-04-16T15:35:51.942716+0000","last_active":"2024-04-16T15:35:54.571221+0000","last_peered":"2024-04-16T15:35:54.571221+0000","last_clean":"2024-04-16T15:35:54.571221+0000","last_became_active":"2024-04-16T15:35:51.942306+0000","last_became_peered":"2024-04-16T15:35:51.942306+0000","last_unstale":"2024-04-16T15:35:54.571221+0000","last_undegraded":"2024-04-16T15:35:54.571221+0000","last_fullsized":"2024-04-16T15:35:54.571221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:21.643419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928089+0000","last_change":"2024-04-16T15:35:46.903607+0000","last_active":"2024-04-16T15:35:53.928089+0000","last_peered":"2024-04-16T15:35:53.928089+0000","last_clean":"2024-04-16T15:35:53.928089+0000","last_became_active":"2024-04-16T15:35:46.903329+0000","last_became_peered":"2024-04-16T15:35:46.903329+0000","last_unstale":"2024-04-16T15:35:53.928089+0000","last_undegraded":"2024-04-16T15:35:53.928089+0000","last_fullsized":"2024-04-16T15:35:53.928089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.903874+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.903605+0000","last_became_peered":"2024-04-16T15:35:47.903605+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:34.270943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928371+0000","last_change":"2024-04-16T15:35:51.941375+0000","last_active":"2024-04-16T15:35:53.928371+0000","last_peered":"2024-04-16T15:35:53.928371+0000","last_clean":"2024-04-16T15:35:53.928371+0000","last_became_active":"2024-04-16T15:35:51.940976+0000","last_became_peered":"2024-04-16T15:35:51.940976+0000","last_unstale":"2024-04-16T15:35:53.928371+0000","last_undegraded":"2024-04-16T15:35:53.928371+0000","last_fullsized":"2024-04-16T15:35:53.928371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:26.365805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368749+0000","last_change":"2024-04-16T15:35:47.911340+0000","last_active":"2024-04-16T15:35:54.368749+0000","last_peered":"2024-04-16T15:35:54.368749+0000","last_clean":"2024-04-16T15:35:54.368749+0000","last_became_active":"2024-04-16T15:35:47.910024+0000","last_became_peered":"2024-04-16T15:35:47.910024+0000","last_unstale":"2024-04-16T15:35:54.368749+0000","last_undegraded":"2024-04-16T15:35:54.368749+0000","last_fullsized":"2024-04-16T15:35:54.368749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570957+0000","last_change":"2024-04-16T15:35:47.921417+0000","last_active":"2024-04-16T15:35:54.570957+0000","last_peered":"2024-04-16T15:35:54.570957+0000","last_clean":"2024-04-16T15:35:54.570957+0000","last_became_active":"2024-04-16T15:35:47.921049+0000","last_became_peered":"2024-04-16T15:35:47.921049+0000","last_unstale":"2024-04-16T15:35:54.570957+0000","last_undegraded":"2024-04-16T15:35:54.570957+0000","last_fullsized":"2024-04-16T15:35:54.570957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.921766+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.921491+0000","last_became_peered":"2024-04-16T15:35:47.921491+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084075+0000","last_change":"2024-04-16T15:35:47.913693+0000","last_active":"2024-04-16T15:35:55.084075+0000","last_peered":"2024-04-16T15:35:55.084075+0000","last_clean":"2024-04-16T15:35:55.084075+0000","last_became_active":"2024-04-16T15:35:47.912712+0000","last_became_peered":"2024-04-16T15:35:47.912712+0000","last_unstale":"2024-04-16T15:35:55.084075+0000","last_undegraded":"2024-04-16T15:35:55.084075+0000","last_fullsized":"2024-04-16T15:35:55.084075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928318+0000","last_change":"2024-04-16T15:35:47.910738+0000","last_active":"2024-04-16T15:35:53.928318+0000","last_peered":"2024-04-16T15:35:53.928318+0000","last_clean":"2024-04-16T15:35:53.928318+0000","last_became_active":"2024-04-16T15:35:47.910305+0000","last_became_peered":"2024-04-16T15:35:47.910305+0000","last_unstale":"2024-04-16T15:35:53.928318+0000","last_undegraded":"2024-04-16T15:35:53.928318+0000","last_fullsized":"2024-04-16T15:35:53.928318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082815+0000","last_change":"2024-04-16T15:35:47.912617+0000","last_active":"2024-04-16T15:35:55.082815+0000","last_peered":"2024-04-16T15:35:55.082815+0000","last_clean":"2024-04-16T15:35:55.082815+0000","last_became_active":"2024-04-16T15:35:47.912319+0000","last_became_peered":"2024-04-16T15:35:47.912319+0000","last_unstale":"2024-04-16T15:35:55.082815+0000","last_undegraded":"2024-04-16T15:35:55.082815+0000","last_fullsized":"2024-04-16T15:35:55.082815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369503+0000","last_change":"2024-04-16T15:35:47.914226+0000","last_active":"2024-04-16T15:35:54.369503+0000","last_peered":"2024-04-16T15:35:54.369503+0000","last_clean":"2024-04-16T15:35:54.369503+0000","last_became_active":"2024-04-16T15:35:47.913944+0000","last_became_peered":"2024-04-16T15:35:47.913944+0000","last_unstale":"2024-04-16T15:35:54.369503+0000","last_undegraded":"2024-04-16T15:35:54.369503+0000","last_fullsized":"2024-04-16T15:35:54.369503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928560+0000","last_change":"2024-04-16T15:35:47.910810+0000","last_active":"2024-04-16T15:35:53.928560+0000","last_peered":"2024-04-16T15:35:53.928560+0000","last_clean":"2024-04-16T15:35:53.928560+0000","last_became_active":"2024-04-16T15:35:47.910509+0000","last_became_peered":"2024-04-16T15:35:47.910509+0000","last_unstale":"2024-04-16T15:35:53.928560+0000","last_undegraded":"2024-04-16T15:35:53.928560+0000","last_fullsized":"2024-04-16T15:35:53.928560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929472+0000","last_change":"2024-04-16T15:35:47.921447+0000","last_active":"2024-04-16T15:35:53.929472+0000","last_peered":"2024-04-16T15:35:53.929472+0000","last_clean":"2024-04-16T15:35:53.929472+0000","last_became_active":"2024-04-16T15:35:47.921165+0000","last_became_peered":"2024-04-16T15:35:47.921165+0000","last_unstale":"2024-04-16T15:35:53.929472+0000","last_undegraded":"2024-04-16T15:35:53.929472+0000","last_fullsized":"2024-04-16T15:35:53.929472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927957+0000","last_change":"2024-04-16T15:35:47.909329+0000","last_active":"2024-04-16T15:35:53.927957+0000","last_peered":"2024-04-16T15:35:53.927957+0000","last_clean":"2024-04-16T15:35:53.927957+0000","last_became_active":"2024-04-16T15:35:47.908921+0000","last_became_peered":"2024-04-16T15:35:47.908921+0000","last_unstale":"2024-04-16T15:35:53.927957+0000","last_undegraded":"2024-04-16T15:35:53.927957+0000","last_fullsized":"2024-04-16T15:35:53.927957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930611+0000","last_change":"2024-04-16T15:35:47.916529+0000","last_active":"2024-04-16T15:35:53.930611+0000","last_peered":"2024-04-16T15:35:53.930611+0000","last_clean":"2024-04-16T15:35:53.930611+0000","last_became_active":"2024-04-16T15:35:47.916272+0000","last_became_peered":"2024-04-16T15:35:47.916272+0000","last_unstale":"2024-04-16T15:35:53.930611+0000","last_undegraded":"2024-04-16T15:35:53.930611+0000","last_fullsized":"2024-04-16T15:35:53.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083999+0000","last_change":"2024-04-16T15:35:47.916637+0000","last_active":"2024-04-16T15:35:55.083999+0000","last_peered":"2024-04-16T15:35:55.083999+0000","last_clean":"2024-04-16T15:35:55.083999+0000","last_became_active":"2024-04-16T15:35:47.915756+0000","last_became_peered":"2024-04-16T15:35:47.915756+0000","last_unstale":"2024-04-16T15:35:55.083999+0000","last_undegraded":"2024-04-16T15:35:55.083999+0000","last_fullsized":"2024-04-16T15:35:55.083999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369168+0000","last_change":"2024-04-16T15:35:47.905523+0000","last_active":"2024-04-16T15:35:54.369168+0000","last_peered":"2024-04-16T15:35:54.369168+0000","last_clean":"2024-04-16T15:35:54.369168+0000","last_became_active":"2024-04-16T15:35:47.905101+0000","last_became_peered":"2024-04-16T15:35:47.905101+0000","last_unstale":"2024-04-16T15:35:54.369168+0000","last_undegraded":"2024-04-16T15:35:54.369168+0000","last_fullsized":"2024-04-16T15:35:54.369168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083700+0000","last_change":"2024-04-16T15:35:47.917168+0000","last_active":"2024-04-16T15:35:55.083700+0000","last_peered":"2024-04-16T15:35:55.083700+0000","last_clean":"2024-04-16T15:35:55.083700+0000","last_became_active":"2024-04-16T15:35:47.914760+0000","last_became_peered":"2024-04-16T15:35:47.914760+0000","last_unstale":"2024-04-16T15:35:55.083700+0000","last_undegraded":"2024-04-16T15:35:55.083700+0000","last_fullsized":"2024-04-16T15:35:55.083700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:58.573474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571311+0000","last_change":"2024-04-16T15:35:47.906661+0000","last_active":"2024-04-16T15:35:54.571311+0000","last_peered":"2024-04-16T15:35:54.571311+0000","last_clean":"2024-04-16T15:35:54.571311+0000","last_became_active":"2024-04-16T15:35:47.906376+0000","last_became_peered":"2024-04-16T15:35:47.906376+0000","last_unstale":"2024-04-16T15:35:54.571311+0000","last_undegraded":"2024-04-16T15:35:54.571311+0000","last_fullsized":"2024-04-16T15:35:54.571311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930697+0000","last_change":"2024-04-16T15:35:47.918857+0000","last_active":"2024-04-16T15:35:53.930697+0000","last_peered":"2024-04-16T15:35:53.930697+0000","last_clean":"2024-04-16T15:35:53.930697+0000","last_became_active":"2024-04-16T15:35:47.918601+0000","last_became_peered":"2024-04-16T15:35:47.918601+0000","last_unstale":"2024-04-16T15:35:53.930697+0000","last_undegraded":"2024-04-16T15:35:53.930697+0000","last_fullsized":"2024-04-16T15:35:53.930697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929331+0000","last_change":"2024-04-16T15:35:47.903123+0000","last_active":"2024-04-16T15:35:53.929331+0000","last_peered":"2024-04-16T15:35:53.929331+0000","last_clean":"2024-04-16T15:35:53.929331+0000","last_became_active":"2024-04-16T15:35:47.902519+0000","last_became_peered":"2024-04-16T15:35:47.902519+0000","last_unstale":"2024-04-16T15:35:53.929331+0000","last_undegraded":"2024-04-16T15:35:53.929331+0000","last_fullsized":"2024-04-16T15:35:53.929331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:47.906920+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:47.906647+0000","last_became_peered":"2024-04-16T15:35:47.906647+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083651+0000","last_change":"2024-04-16T15:35:47.903897+0000","last_active":"2024-04-16T15:35:55.083651+0000","last_peered":"2024-04-16T15:35:55.083651+0000","last_clean":"2024-04-16T15:35:55.083651+0000","last_became_active":"2024-04-16T15:35:47.903636+0000","last_became_peered":"2024-04-16T15:35:47.903636+0000","last_unstale":"2024-04-16T15:35:55.083651+0000","last_undegraded":"2024-04-16T15:35:55.083651+0000","last_fullsized":"2024-04-16T15:35:55.083651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:17.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927930+0000","last_change":"2024-04-16T15:35:47.919522+0000","last_active":"2024-04-16T15:35:53.927930+0000","last_peered":"2024-04-16T15:35:53.927930+0000","last_clean":"2024-04-16T15:35:53.927930+0000","last_became_active":"2024-04-16T15:35:47.919224+0000","last_became_peered":"2024-04-16T15:35:47.919224+0000","last_unstale":"2024-04-16T15:35:53.927930+0000","last_undegraded":"2024-04-16T15:35:53.927930+0000","last_fullsized":"2024-04-16T15:35:53.927930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931084+0000","last_change":"2024-04-16T15:35:47.904535+0000","last_active":"2024-04-16T15:35:53.931084+0000","last_peered":"2024-04-16T15:35:53.931084+0000","last_clean":"2024-04-16T15:35:53.931084+0000","last_became_active":"2024-04-16T15:35:47.904263+0000","last_became_peered":"2024-04-16T15:35:47.904263+0000","last_unstale":"2024-04-16T15:35:53.931084+0000","last_undegraded":"2024-04-16T15:35:53.931084+0000","last_fullsized":"2024-04-16T15:35:53.931084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369248+0000","last_change":"2024-04-16T15:35:47.908367+0000","last_active":"2024-04-16T15:35:54.369248+0000","last_peered":"2024-04-16T15:35:54.369248+0000","last_clean":"2024-04-16T15:35:54.369248+0000","last_became_active":"2024-04-16T15:35:47.908073+0000","last_became_peered":"2024-04-16T15:35:47.908073+0000","last_unstale":"2024-04-16T15:35:54.369248+0000","last_undegraded":"2024-04-16T15:35:54.369248+0000","last_fullsized":"2024-04-16T15:35:54.369248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369451+0000","last_change":"2024-04-16T15:35:47.907751+0000","last_active":"2024-04-16T15:35:54.369451+0000","last_peered":"2024-04-16T15:35:54.369451+0000","last_clean":"2024-04-16T15:35:54.369451+0000","last_became_active":"2024-04-16T15:35:47.907492+0000","last_became_peered":"2024-04-16T15:35:47.907492+0000","last_unstale":"2024-04-16T15:35:54.369451+0000","last_undegraded":"2024-04-16T15:35:54.369451+0000","last_fullsized":"2024-04-16T15:35:54.369451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083822+0000","last_change":"2024-04-16T15:35:47.922537+0000","last_active":"2024-04-16T15:35:55.083822+0000","last_peered":"2024-04-16T15:35:55.083822+0000","last_clean":"2024-04-16T15:35:55.083822+0000","last_became_active":"2024-04-16T15:35:47.922261+0000","last_became_peered":"2024-04-16T15:35:47.922261+0000","last_unstale":"2024-04-16T15:35:55.083822+0000","last_undegraded":"2024-04-16T15:35:55.083822+0000","last_fullsized":"2024-04-16T15:35:55.083822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927732+0000","last_change":"2024-04-16T15:35:47.921897+0000","last_active":"2024-04-16T15:35:53.927732+0000","last_peered":"2024-04-16T15:35:53.927732+0000","last_clean":"2024-04-16T15:35:53.927732+0000","last_became_active":"2024-04-16T15:35:47.921646+0000","last_became_peered":"2024-04-16T15:35:47.921646+0000","last_unstale":"2024-04-16T15:35:53.927732+0000","last_undegraded":"2024-04-16T15:35:53.927732+0000","last_fullsized":"2024-04-16T15:35:53.927732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083179+0000","last_change":"2024-04-16T15:35:47.920391+0000","last_active":"2024-04-16T15:35:55.083179+0000","last_peered":"2024-04-16T15:35:55.083179+0000","last_clean":"2024-04-16T15:35:55.083179+0000","last_became_active":"2024-04-16T15:35:47.920071+0000","last_became_peered":"2024-04-16T15:35:47.920071+0000","last_unstale":"2024-04-16T15:35:55.083179+0000","last_undegraded":"2024-04-16T15:35:55.083179+0000","last_fullsized":"2024-04-16T15:35:55.083179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930585+0000","last_change":"2024-04-16T15:35:47.903213+0000","last_active":"2024-04-16T15:35:53.930585+0000","last_peered":"2024-04-16T15:35:53.930585+0000","last_clean":"2024-04-16T15:35:53.930585+0000","last_became_active":"2024-04-16T15:35:47.902785+0000","last_became_peered":"2024-04-16T15:35:47.902785+0000","last_unstale":"2024-04-16T15:35:53.930585+0000","last_undegraded":"2024-04-16T15:35:53.930585+0000","last_fullsized":"2024-04-16T15:35:53.930585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083264+0000","last_change":"2024-04-16T15:35:47.914772+0000","last_active":"2024-04-16T15:35:55.083264+0000","last_peered":"2024-04-16T15:35:55.083264+0000","last_clean":"2024-04-16T15:35:55.083264+0000","last_became_active":"2024-04-16T15:35:47.913751+0000","last_became_peered":"2024-04-16T15:35:47.913751+0000","last_unstale":"2024-04-16T15:35:55.083264+0000","last_undegraded":"2024-04-16T15:35:55.083264+0000","last_fullsized":"2024-04-16T15:35:55.083264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930257+0000","last_change":"2024-04-16T15:35:47.914826+0000","last_active":"2024-04-16T15:35:53.930257+0000","last_peered":"2024-04-16T15:35:53.930257+0000","last_clean":"2024-04-16T15:35:53.930257+0000","last_became_active":"2024-04-16T15:35:47.913014+0000","last_became_peered":"2024-04-16T15:35:47.913014+0000","last_unstale":"2024-04-16T15:35:53.930257+0000","last_undegraded":"2024-04-16T15:35:53.930257+0000","last_fullsized":"2024-04-16T15:35:53.930257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083035+0000","last_change":"2024-04-16T15:35:47.907911+0000","last_active":"2024-04-16T15:35:55.083035+0000","last_peered":"2024-04-16T15:35:55.083035+0000","last_clean":"2024-04-16T15:35:55.083035+0000","last_became_active":"2024-04-16T15:35:47.907655+0000","last_became_peered":"2024-04-16T15:35:47.907655+0000","last_unstale":"2024-04-16T15:35:55.083035+0000","last_undegraded":"2024-04-16T15:35:55.083035+0000","last_fullsized":"2024-04-16T15:35:55.083035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083534+0000","last_change":"2024-04-16T15:35:47.907719+0000","last_active":"2024-04-16T15:35:55.083534+0000","last_peered":"2024-04-16T15:35:55.083534+0000","last_clean":"2024-04-16T15:35:55.083534+0000","last_became_active":"2024-04-16T15:35:47.907381+0000","last_became_peered":"2024-04-16T15:35:47.907381+0000","last_unstale":"2024-04-16T15:35:55.083534+0000","last_undegraded":"2024-04-16T15:35:55.083534+0000","last_fullsized":"2024-04-16T15:35:55.083534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083718+0000","last_change":"2024-04-16T15:35:47.913767+0000","last_active":"2024-04-16T15:35:55.083718+0000","last_peered":"2024-04-16T15:35:55.083718+0000","last_clean":"2024-04-16T15:35:55.083718+0000","last_became_active":"2024-04-16T15:35:47.913475+0000","last_became_peered":"2024-04-16T15:35:47.913475+0000","last_unstale":"2024-04-16T15:35:55.083718+0000","last_undegraded":"2024-04-16T15:35:55.083718+0000","last_fullsized":"2024-04-16T15:35:55.083718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:36:04.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:36:05.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.084+0000 7f25f7104640 1 Processor -- start 2024-04-16T15:36:05.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.084+0000 7f25f7104640 1 -- start start 2024-04-16T15:36:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.084+0000 7f25f7104640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015c0f0 0x7f25f00b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.084+0000 7f25f7104640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25f00ce460 0x7f25f00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f7104640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f00afbe0 con 0x7f25f0071eb0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f7104640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f25f00b57a0 con 0x7f25f00ce460 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f7104640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f25f00afec0 con 0x7f25f015c0f0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f4ea0640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f25f0071eb0 0x7f25f0072290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33850/0 (socket says 172.21.15.80:33850) 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f4ea0640 1 -- 172.21.15.80:0/1467670346 learned_addr learned my addr 172.21.15.80:0/1467670346 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f56a1640 1 --2- 172.21.15.80:0/1467670346 >> v2:172.21.15.80:3300/0 conn(0x7f25f00ce460 0x7f25f00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25effff640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015c0f0 0x7f25f00b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25ef7fe640 1 -- 172.21.15.80:0/1467670346 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860422328 0 0) 0x7f25f00afbe0 con 0x7f25f0071eb0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25ef7fe640 1 -- 172.21.15.80:0/1467670346 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25dc003520 con 0x7f25f0071eb0 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f56a1640 1 -- 172.21.15.80:0/1467670346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015c0f0 msgr2=0x7f25f00b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f56a1640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015c0f0 0x7f25f00b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f56a1640 1 -- 172.21.15.80:0/1467670346 >> v1:172.21.15.80:6789/0 conn(0x7f25f0071eb0 legacy=0x7f25f0072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.085+0000 7f25f56a1640 1 -- 172.21.15.80:0/1467670346 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00b5430 con 0x7f25f00ce460 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f56a1640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f00ce460 0x7f25f00b5c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25d80097a0 tx=0x7f25d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0c5ddadb9a8ead server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25ef7fe640 1 -- 172.21.15.80:0/1467670346 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80315a0 con 0x7f25f00ce460 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25ef7fe640 1 -- 172.21.15.80:0/1467670346 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d8037070 con 0x7f25f00ce460 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25ef7fe640 1 -- 172.21.15.80:0/1467670346 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8031940 con 0x7f25f00ce460 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 -- 172.21.15.80:0/1467670346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f00ce460 msgr2=0x7f25f00b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f00ce460 0x7f25f00b5c30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25d80097a0 tx=0x7f25d802b840 comp rx=0 tx=0).stop 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 -- 172.21.15.80:0/1467670346 shutdown_connections 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f00ce460 0x7f25f00b5c30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 --2- 172.21.15.80:0/1467670346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f015c0f0 0x7f25f00b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 -- 172.21.15.80:0/1467670346 >> 172.21.15.80:0/1467670346 conn(0x7f25f00b2940 msgr2=0x7f25f006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 -- 172.21.15.80:0/1467670346 shutdown_connections 2024-04-16T15:36:05.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.086+0000 7f25f7104640 1 -- 172.21.15.80:0/1467670346 wait complete. 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 Processor -- start 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 -- start start 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f00ce460 0x7f25f0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 0x7f25f01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f25f00b3b50 con 0x7f25f0071eb0 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f25f00ce8d0 con 0x7f25f015c0f0 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.088+0000 7f25f7104640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f25f01f6630 con 0x7f25f00ce460 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34584/0 (socket says 172.21.15.80:34584) 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 -- 172.21.15.80:0/234876035 learned_addr learned my addr 172.21.15.80:0/234876035 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f56a1640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 0x7f25f01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25effff640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f00ce460 0x7f25f0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 -- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f00ce460 msgr2=0x7f25f0157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f00ce460 0x7f25f0157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 -- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 msgr2=0x7f25f01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 0x7f25f01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 -- 172.21.15.80:0/234876035 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f01f5a40 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f56a1640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 0x7f25f01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f4ea0640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c390 tx=0x7f25e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8017070 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8005ce0 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01f5d00 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e80072f0 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.089+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01f62c0 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.090+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f0068a40 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.091+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25e801a070 con 0x7f25f0071eb0 2024-04-16T15:36:05.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.091+0000 7f25ed7fa640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 0x7f25d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.091+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25e808b2b0 con 0x7f25f0071eb0 2024-04-16T15:36:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.091+0000 7f25effff640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 0x7f25d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.091+0000 7f25effff640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 0x7f25d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25f00aee50 tx=0x7f25e000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.095+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25e80593a0 con 0x7f25f0071eb0 2024-04-16T15:36:05.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.269+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25f00cd8f0 con 0x7f25d006c8f0 2024-04-16T15:36:05.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.277+0000 7f25ed7fa640 1 -- 172.21.15.80:0/234876035 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f25f00cd8f0 con 0x7f25d006c8f0 2024-04-16T15:36:05.279 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:05.280 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 msgr2=0x7f25d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 0x7f25d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f25f00aee50 tx=0x7f25e000b040 comp rx=0 tx=0).stop 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 msgr2=0x7f25f0149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c390 tx=0x7f25e800c850 comp rx=0 tx=0).stop 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 shutdown_connections 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25f015c0f0 0x7f25f01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f25d006c8f0 0x7f25d006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f25f00ce460 0x7f25f0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 --2- 172.21.15.80:0/234876035 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25f0071eb0 0x7f25f0149060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 >> 172.21.15.80:0/234876035 conn(0x7f25f00b2940 msgr2=0x7f25f00b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 shutdown_connections 2024-04-16T15:36:05.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.280+0000 7f25f7104640 1 -- 172.21.15.80:0/234876035 wait complete. 2024-04-16T15:36:05.290 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-16T15:36:05.161211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219468,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755252,"statfs":{"total":773094113280,"available":772869378048,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.233268"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083878+0000","last_change":"2024-04-16T15:35:46.903839+0000","last_active":"2024-04-16T15:35:55.083878+0000","last_peered":"2024-04-16T15:35:55.083878+0000","last_clean":"2024-04-16T15:35:55.083878+0000","last_became_active":"2024-04-16T15:35:46.903559+0000","last_became_peered":"2024-04-16T15:35:46.903559+0000","last_unstale":"2024-04-16T15:35:55.083878+0000","last_undegraded":"2024-04-16T15:35:55.083878+0000","last_fullsized":"2024-04-16T15:35:55.083878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928439+0000","last_change":"2024-04-16T15:35:47.906302+0000","last_active":"2024-04-16T15:35:53.928439+0000","last_peered":"2024-04-16T15:35:53.928439+0000","last_clean":"2024-04-16T15:35:53.928439+0000","last_became_active":"2024-04-16T15:35:47.905445+0000","last_became_peered":"2024-04-16T15:35:47.905445+0000","last_unstale":"2024-04-16T15:35:53.928439+0000","last_undegraded":"2024-04-16T15:35:53.928439+0000","last_fullsized":"2024-04-16T15:35:53.928439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927788+0000","last_change":"2024-04-16T15:35:52.665449+0000","last_active":"2024-04-16T15:35:53.927788+0000","last_peered":"2024-04-16T15:35:53.927788+0000","last_clean":"2024-04-16T15:35:53.927788+0000","last_became_active":"2024-04-16T15:35:52.665084+0000","last_became_peered":"2024-04-16T15:35:52.665084+0000","last_unstale":"2024-04-16T15:35:53.927788+0000","last_undegraded":"2024-04-16T15:35:53.927788+0000","last_fullsized":"2024-04-16T15:35:53.927788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:19:37.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928611+0000","last_change":"2024-04-16T15:35:46.898739+0000","last_active":"2024-04-16T15:35:53.928611+0000","last_peered":"2024-04-16T15:35:53.928611+0000","last_clean":"2024-04-16T15:35:53.928611+0000","last_became_active":"2024-04-16T15:35:46.898423+0000","last_became_peered":"2024-04-16T15:35:46.898423+0000","last_unstale":"2024-04-16T15:35:53.928611+0000","last_undegraded":"2024-04-16T15:35:53.928611+0000","last_fullsized":"2024-04-16T15:35:53.928611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083665+0000","last_change":"2024-04-16T15:35:47.907617+0000","last_active":"2024-04-16T15:35:55.083665+0000","last_peered":"2024-04-16T15:35:55.083665+0000","last_clean":"2024-04-16T15:35:55.083665+0000","last_became_active":"2024-04-16T15:35:47.907273+0000","last_became_peered":"2024-04-16T15:35:47.907273+0000","last_unstale":"2024-04-16T15:35:55.083665+0000","last_undegraded":"2024-04-16T15:35:55.083665+0000","last_fullsized":"2024-04-16T15:35:55.083665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:55.452016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930079+0000","last_change":"2024-04-16T15:35:51.944987+0000","last_active":"2024-04-16T15:35:53.930079+0000","last_peered":"2024-04-16T15:35:53.930079+0000","last_clean":"2024-04-16T15:35:53.930079+0000","last_became_active":"2024-04-16T15:35:51.944345+0000","last_became_peered":"2024-04-16T15:35:51.944345+0000","last_unstale":"2024-04-16T15:35:53.930079+0000","last_undegraded":"2024-04-16T15:35:53.930079+0000","last_fullsized":"2024-04-16T15:35:53.930079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082829+0000","last_change":"2024-04-16T15:35:46.902233+0000","last_active":"2024-04-16T15:35:55.082829+0000","last_peered":"2024-04-16T15:35:55.082829+0000","last_clean":"2024-04-16T15:35:55.082829+0000","last_became_active":"2024-04-16T15:35:46.901940+0000","last_became_peered":"2024-04-16T15:35:46.901940+0000","last_unstale":"2024-04-16T15:35:55.082829+0000","last_undegraded":"2024-04-16T15:35:55.082829+0000","last_fullsized":"2024-04-16T15:35:55.082829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930367+0000","last_change":"2024-04-16T15:35:47.898146+0000","last_active":"2024-04-16T15:35:53.930367+0000","last_peered":"2024-04-16T15:35:53.930367+0000","last_clean":"2024-04-16T15:35:53.930367+0000","last_became_active":"2024-04-16T15:35:47.897840+0000","last_became_peered":"2024-04-16T15:35:47.897840+0000","last_unstale":"2024-04-16T15:35:53.930367+0000","last_undegraded":"2024-04-16T15:35:53.930367+0000","last_fullsized":"2024-04-16T15:35:53.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930469+0000","last_change":"2024-04-16T15:35:51.945269+0000","last_active":"2024-04-16T15:35:53.930469+0000","last_peered":"2024-04-16T15:35:53.930469+0000","last_clean":"2024-04-16T15:35:53.930469+0000","last_became_active":"2024-04-16T15:35:51.943815+0000","last_became_peered":"2024-04-16T15:35:51.943815+0000","last_unstale":"2024-04-16T15:35:53.930469+0000","last_undegraded":"2024-04-16T15:35:53.930469+0000","last_fullsized":"2024-04-16T15:35:53.930469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082796+0000","last_change":"2024-04-16T15:35:46.901105+0000","last_active":"2024-04-16T15:35:55.082796+0000","last_peered":"2024-04-16T15:35:55.082796+0000","last_clean":"2024-04-16T15:35:55.082796+0000","last_became_active":"2024-04-16T15:35:46.900800+0000","last_became_peered":"2024-04-16T15:35:46.900800+0000","last_unstale":"2024-04-16T15:35:55.082796+0000","last_undegraded":"2024-04-16T15:35:55.082796+0000","last_fullsized":"2024-04-16T15:35:55.082796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:11.448206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930964+0000","last_change":"2024-04-16T15:35:47.897967+0000","last_active":"2024-04-16T15:35:53.930964+0000","last_peered":"2024-04-16T15:35:53.930964+0000","last_clean":"2024-04-16T15:35:53.930964+0000","last_became_active":"2024-04-16T15:35:47.897689+0000","last_became_peered":"2024-04-16T15:35:47.897689+0000","last_unstale":"2024-04-16T15:35:53.930964+0000","last_undegraded":"2024-04-16T15:35:53.930964+0000","last_fullsized":"2024-04-16T15:35:53.930964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930582+0000","last_change":"2024-04-16T15:35:51.945075+0000","last_active":"2024-04-16T15:35:53.930582+0000","last_peered":"2024-04-16T15:35:53.930582+0000","last_clean":"2024-04-16T15:35:53.930582+0000","last_became_active":"2024-04-16T15:35:51.944674+0000","last_became_peered":"2024-04-16T15:35:51.944674+0000","last_unstale":"2024-04-16T15:35:53.930582+0000","last_undegraded":"2024-04-16T15:35:53.930582+0000","last_fullsized":"2024-04-16T15:35:53.930582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368841+0000","last_change":"2024-04-16T15:35:47.906053+0000","last_active":"2024-04-16T15:35:54.368841+0000","last_peered":"2024-04-16T15:35:54.368841+0000","last_clean":"2024-04-16T15:35:54.368841+0000","last_became_active":"2024-04-16T15:35:47.905735+0000","last_became_peered":"2024-04-16T15:35:47.905735+0000","last_unstale":"2024-04-16T15:35:54.368841+0000","last_undegraded":"2024-04-16T15:35:54.368841+0000","last_fullsized":"2024-04-16T15:35:54.368841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082789+0000","last_change":"2024-04-16T15:35:46.903005+0000","last_active":"2024-04-16T15:35:55.082789+0000","last_peered":"2024-04-16T15:35:55.082789+0000","last_clean":"2024-04-16T15:35:55.082789+0000","last_became_active":"2024-04-16T15:35:46.902690+0000","last_became_peered":"2024-04-16T15:35:46.902690+0000","last_unstale":"2024-04-16T15:35:55.082789+0000","last_undegraded":"2024-04-16T15:35:55.082789+0000","last_fullsized":"2024-04-16T15:35:55.082789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931392+0000","last_change":"2024-04-16T15:35:51.944672+0000","last_active":"2024-04-16T15:35:53.931392+0000","last_peered":"2024-04-16T15:35:53.931392+0000","last_clean":"2024-04-16T15:35:53.931392+0000","last_became_active":"2024-04-16T15:35:51.943902+0000","last_became_peered":"2024-04-16T15:35:51.943902+0000","last_unstale":"2024-04-16T15:35:53.931392+0000","last_undegraded":"2024-04-16T15:35:53.931392+0000","last_fullsized":"2024-04-16T15:35:53.931392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927970+0000","last_change":"2024-04-16T15:35:47.911396+0000","last_active":"2024-04-16T15:35:53.927970+0000","last_peered":"2024-04-16T15:35:53.927970+0000","last_clean":"2024-04-16T15:35:53.927970+0000","last_became_active":"2024-04-16T15:35:47.910994+0000","last_became_peered":"2024-04-16T15:35:47.910994+0000","last_unstale":"2024-04-16T15:35:53.927970+0000","last_undegraded":"2024-04-16T15:35:53.927970+0000","last_fullsized":"2024-04-16T15:35:53.927970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084084+0000","last_change":"2024-04-16T15:35:46.900976+0000","last_active":"2024-04-16T15:35:55.084084+0000","last_peered":"2024-04-16T15:35:55.084084+0000","last_clean":"2024-04-16T15:35:55.084084+0000","last_became_active":"2024-04-16T15:35:46.900725+0000","last_became_peered":"2024-04-16T15:35:46.900725+0000","last_unstale":"2024-04-16T15:35:55.084084+0000","last_undegraded":"2024-04-16T15:35:55.084084+0000","last_fullsized":"2024-04-16T15:35:55.084084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931016+0000","last_change":"2024-04-16T15:35:51.941220+0000","last_active":"2024-04-16T15:35:53.931016+0000","last_peered":"2024-04-16T15:35:53.931016+0000","last_clean":"2024-04-16T15:35:53.931016+0000","last_became_active":"2024-04-16T15:35:51.940585+0000","last_became_peered":"2024-04-16T15:35:51.940585+0000","last_unstale":"2024-04-16T15:35:53.931016+0000","last_undegraded":"2024-04-16T15:35:53.931016+0000","last_fullsized":"2024-04-16T15:35:53.931016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927961+0000","last_change":"2024-04-16T15:35:47.911281+0000","last_active":"2024-04-16T15:35:53.927961+0000","last_peered":"2024-04-16T15:35:53.927961+0000","last_clean":"2024-04-16T15:35:53.927961+0000","last_became_active":"2024-04-16T15:35:47.910748+0000","last_became_peered":"2024-04-16T15:35:47.910748+0000","last_unstale":"2024-04-16T15:35:53.927961+0000","last_undegraded":"2024-04-16T15:35:53.927961+0000","last_fullsized":"2024-04-16T15:35:53.927961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083203+0000","last_change":"2024-04-16T15:35:46.902533+0000","last_active":"2024-04-16T15:35:55.083203+0000","last_peered":"2024-04-16T15:35:55.083203+0000","last_clean":"2024-04-16T15:35:55.083203+0000","last_became_active":"2024-04-16T15:35:46.902221+0000","last_became_peered":"2024-04-16T15:35:46.902221+0000","last_unstale":"2024-04-16T15:35:55.083203+0000","last_undegraded":"2024-04-16T15:35:55.083203+0000","last_fullsized":"2024-04-16T15:35:55.083203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083349+0000","last_change":"2024-04-16T15:35:52.664607+0000","last_active":"2024-04-16T15:35:55.083349+0000","last_peered":"2024-04-16T15:35:55.083349+0000","last_clean":"2024-04-16T15:35:55.083349+0000","last_became_active":"2024-04-16T15:35:52.664234+0000","last_became_peered":"2024-04-16T15:35:52.664234+0000","last_unstale":"2024-04-16T15:35:55.083349+0000","last_undegraded":"2024-04-16T15:35:55.083349+0000","last_fullsized":"2024-04-16T15:35:55.083349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930192+0000","last_change":"2024-04-16T15:35:47.913469+0000","last_active":"2024-04-16T15:35:53.930192+0000","last_peered":"2024-04-16T15:35:53.930192+0000","last_clean":"2024-04-16T15:35:53.930192+0000","last_became_active":"2024-04-16T15:35:47.912952+0000","last_became_peered":"2024-04-16T15:35:47.912952+0000","last_unstale":"2024-04-16T15:35:53.930192+0000","last_undegraded":"2024-04-16T15:35:53.930192+0000","last_fullsized":"2024-04-16T15:35:53.930192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:12.452242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083012+0000","last_change":"2024-04-16T15:35:46.903630+0000","last_active":"2024-04-16T15:35:55.083012+0000","last_peered":"2024-04-16T15:35:55.083012+0000","last_clean":"2024-04-16T15:35:55.083012+0000","last_became_active":"2024-04-16T15:35:46.903282+0000","last_became_peered":"2024-04-16T15:35:46.903282+0000","last_unstale":"2024-04-16T15:35:55.083012+0000","last_undegraded":"2024-04-16T15:35:55.083012+0000","last_fullsized":"2024-04-16T15:35:55.083012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930012+0000","last_change":"2024-04-16T15:35:51.944348+0000","last_active":"2024-04-16T15:35:53.930012+0000","last_peered":"2024-04-16T15:35:53.930012+0000","last_clean":"2024-04-16T15:35:53.930012+0000","last_became_active":"2024-04-16T15:35:51.943917+0000","last_became_peered":"2024-04-16T15:35:51.943917+0000","last_unstale":"2024-04-16T15:35:53.930012+0000","last_undegraded":"2024-04-16T15:35:53.930012+0000","last_fullsized":"2024-04-16T15:35:53.930012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083778+0000","last_change":"2024-04-16T15:35:47.909155+0000","last_active":"2024-04-16T15:35:55.083778+0000","last_peered":"2024-04-16T15:35:55.083778+0000","last_clean":"2024-04-16T15:35:55.083778+0000","last_became_active":"2024-04-16T15:35:47.908864+0000","last_became_peered":"2024-04-16T15:35:47.908864+0000","last_unstale":"2024-04-16T15:35:55.083778+0000","last_undegraded":"2024-04-16T15:35:55.083778+0000","last_fullsized":"2024-04-16T15:35:55.083778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369537+0000","last_change":"2024-04-16T15:35:46.899721+0000","last_active":"2024-04-16T15:35:54.369537+0000","last_peered":"2024-04-16T15:35:54.369537+0000","last_clean":"2024-04-16T15:35:54.369537+0000","last_became_active":"2024-04-16T15:35:46.899479+0000","last_became_peered":"2024-04-16T15:35:46.899479+0000","last_unstale":"2024-04-16T15:35:54.369537+0000","last_undegraded":"2024-04-16T15:35:54.369537+0000","last_fullsized":"2024-04-16T15:35:54.369537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929961+0000","last_change":"2024-04-16T15:35:52.664780+0000","last_active":"2024-04-16T15:35:53.929961+0000","last_peered":"2024-04-16T15:35:53.929961+0000","last_clean":"2024-04-16T15:35:53.929961+0000","last_became_active":"2024-04-16T15:35:52.664358+0000","last_became_peered":"2024-04-16T15:35:52.664358+0000","last_unstale":"2024-04-16T15:35:53.929961+0000","last_undegraded":"2024-04-16T15:35:53.929961+0000","last_fullsized":"2024-04-16T15:35:53.929961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928626+0000","last_change":"2024-04-16T15:35:47.919497+0000","last_active":"2024-04-16T15:35:53.928626+0000","last_peered":"2024-04-16T15:35:53.928626+0000","last_clean":"2024-04-16T15:35:53.928626+0000","last_became_active":"2024-04-16T15:35:47.919212+0000","last_became_peered":"2024-04-16T15:35:47.919212+0000","last_unstale":"2024-04-16T15:35:53.928626+0000","last_undegraded":"2024-04-16T15:35:53.928626+0000","last_fullsized":"2024-04-16T15:35:53.928626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082805+0000","last_change":"2024-04-16T15:35:46.900937+0000","last_active":"2024-04-16T15:35:55.082805+0000","last_peered":"2024-04-16T15:35:55.082805+0000","last_clean":"2024-04-16T15:35:55.082805+0000","last_became_active":"2024-04-16T15:35:46.900654+0000","last_became_peered":"2024-04-16T15:35:46.900654+0000","last_unstale":"2024-04-16T15:35:55.082805+0000","last_undegraded":"2024-04-16T15:35:55.082805+0000","last_fullsized":"2024-04-16T15:35:55.082805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927710+0000","last_change":"2024-04-16T15:35:52.665635+0000","last_active":"2024-04-16T15:35:53.927710+0000","last_peered":"2024-04-16T15:35:53.927710+0000","last_clean":"2024-04-16T15:35:53.927710+0000","last_became_active":"2024-04-16T15:35:52.665117+0000","last_became_peered":"2024-04-16T15:35:52.665117+0000","last_unstale":"2024-04-16T15:35:53.927710+0000","last_undegraded":"2024-04-16T15:35:53.927710+0000","last_fullsized":"2024-04-16T15:35:53.927710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:14.451474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084034+0000","last_change":"2024-04-16T15:35:47.911904+0000","last_active":"2024-04-16T15:35:55.084034+0000","last_peered":"2024-04-16T15:35:55.084034+0000","last_clean":"2024-04-16T15:35:55.084034+0000","last_became_active":"2024-04-16T15:35:47.911640+0000","last_became_peered":"2024-04-16T15:35:47.911640+0000","last_unstale":"2024-04-16T15:35:55.084034+0000","last_undegraded":"2024-04-16T15:35:55.084034+0000","last_fullsized":"2024-04-16T15:35:55.084034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083711+0000","last_change":"2024-04-16T15:35:46.903622+0000","last_active":"2024-04-16T15:35:55.083711+0000","last_peered":"2024-04-16T15:35:55.083711+0000","last_clean":"2024-04-16T15:35:55.083711+0000","last_became_active":"2024-04-16T15:35:46.903301+0000","last_became_peered":"2024-04-16T15:35:46.903301+0000","last_unstale":"2024-04-16T15:35:55.083711+0000","last_undegraded":"2024-04-16T15:35:55.083711+0000","last_fullsized":"2024-04-16T15:35:55.083711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083996+0000","last_change":"2024-04-16T15:35:52.662090+0000","last_active":"2024-04-16T15:35:55.083996+0000","last_peered":"2024-04-16T15:35:55.083996+0000","last_clean":"2024-04-16T15:35:55.083996+0000","last_became_active":"2024-04-16T15:35:52.661689+0000","last_became_peered":"2024-04-16T15:35:52.661689+0000","last_unstale":"2024-04-16T15:35:55.083996+0000","last_undegraded":"2024-04-16T15:35:55.083996+0000","last_fullsized":"2024-04-16T15:35:55.083996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931070+0000","last_change":"2024-04-16T15:35:47.912680+0000","last_active":"2024-04-16T15:35:53.931070+0000","last_peered":"2024-04-16T15:35:53.931070+0000","last_clean":"2024-04-16T15:35:53.931070+0000","last_became_active":"2024-04-16T15:35:47.912362+0000","last_became_peered":"2024-04-16T15:35:47.912362+0000","last_unstale":"2024-04-16T15:35:53.931070+0000","last_undegraded":"2024-04-16T15:35:53.931070+0000","last_fullsized":"2024-04-16T15:35:53.931070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084115+0000","last_change":"2024-04-16T15:35:46.902183+0000","last_active":"2024-04-16T15:35:55.084115+0000","last_peered":"2024-04-16T15:35:55.084115+0000","last_clean":"2024-04-16T15:35:55.084115+0000","last_became_active":"2024-04-16T15:35:46.901974+0000","last_became_peered":"2024-04-16T15:35:46.901974+0000","last_unstale":"2024-04-16T15:35:55.084115+0000","last_undegraded":"2024-04-16T15:35:55.084115+0000","last_fullsized":"2024-04-16T15:35:55.084115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084296+0000","last_change":"2024-04-16T15:35:51.944263+0000","last_active":"2024-04-16T15:35:55.084296+0000","last_peered":"2024-04-16T15:35:55.084296+0000","last_clean":"2024-04-16T15:35:55.084296+0000","last_became_active":"2024-04-16T15:35:51.943863+0000","last_became_peered":"2024-04-16T15:35:51.943863+0000","last_unstale":"2024-04-16T15:35:55.084296+0000","last_undegraded":"2024-04-16T15:35:55.084296+0000","last_fullsized":"2024-04-16T15:35:55.084296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930852+0000","last_change":"2024-04-16T15:35:47.904118+0000","last_active":"2024-04-16T15:35:53.930852+0000","last_peered":"2024-04-16T15:35:53.930852+0000","last_clean":"2024-04-16T15:35:53.930852+0000","last_became_active":"2024-04-16T15:35:47.903698+0000","last_became_peered":"2024-04-16T15:35:47.903698+0000","last_unstale":"2024-04-16T15:35:53.930852+0000","last_undegraded":"2024-04-16T15:35:53.930852+0000","last_fullsized":"2024-04-16T15:35:53.930852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930850+0000","last_change":"2024-04-16T15:35:46.902362+0000","last_active":"2024-04-16T15:35:53.930850+0000","last_peered":"2024-04-16T15:35:53.930850+0000","last_clean":"2024-04-16T15:35:53.930850+0000","last_became_active":"2024-04-16T15:35:46.902062+0000","last_became_peered":"2024-04-16T15:35:46.902062+0000","last_unstale":"2024-04-16T15:35:53.930850+0000","last_undegraded":"2024-04-16T15:35:53.930850+0000","last_fullsized":"2024-04-16T15:35:53.930850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083986+0000","last_change":"2024-04-16T15:35:51.947084+0000","last_active":"2024-04-16T15:35:55.083986+0000","last_peered":"2024-04-16T15:35:55.083986+0000","last_clean":"2024-04-16T15:35:55.083986+0000","last_became_active":"2024-04-16T15:35:51.946724+0000","last_became_peered":"2024-04-16T15:35:51.946724+0000","last_unstale":"2024-04-16T15:35:55.083986+0000","last_undegraded":"2024-04-16T15:35:55.083986+0000","last_fullsized":"2024-04-16T15:35:55.083986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083003+0000","last_change":"2024-04-16T15:35:47.912577+0000","last_active":"2024-04-16T15:35:55.083003+0000","last_peered":"2024-04-16T15:35:55.083003+0000","last_clean":"2024-04-16T15:35:55.083003+0000","last_became_active":"2024-04-16T15:35:47.911408+0000","last_became_peered":"2024-04-16T15:35:47.911408+0000","last_unstale":"2024-04-16T15:35:55.083003+0000","last_undegraded":"2024-04-16T15:35:55.083003+0000","last_fullsized":"2024-04-16T15:35:55.083003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571080+0000","last_change":"2024-04-16T15:35:46.894699+0000","last_active":"2024-04-16T15:35:54.571080+0000","last_peered":"2024-04-16T15:35:54.571080+0000","last_clean":"2024-04-16T15:35:54.571080+0000","last_became_active":"2024-04-16T15:35:46.894408+0000","last_became_peered":"2024-04-16T15:35:46.894408+0000","last_unstale":"2024-04-16T15:35:54.571080+0000","last_undegraded":"2024-04-16T15:35:54.571080+0000","last_fullsized":"2024-04-16T15:35:54.571080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083498+0000","last_change":"2024-04-16T15:35:51.941063+0000","last_active":"2024-04-16T15:35:55.083498+0000","last_peered":"2024-04-16T15:35:55.083498+0000","last_clean":"2024-04-16T15:35:55.083498+0000","last_became_active":"2024-04-16T15:35:51.940669+0000","last_became_peered":"2024-04-16T15:35:51.940669+0000","last_unstale":"2024-04-16T15:35:55.083498+0000","last_undegraded":"2024-04-16T15:35:55.083498+0000","last_fullsized":"2024-04-16T15:35:55.083498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083196+0000","last_change":"2024-04-16T15:35:47.904932+0000","last_active":"2024-04-16T15:35:55.083196+0000","last_peered":"2024-04-16T15:35:55.083196+0000","last_clean":"2024-04-16T15:35:55.083196+0000","last_became_active":"2024-04-16T15:35:47.902287+0000","last_became_peered":"2024-04-16T15:35:47.902287+0000","last_unstale":"2024-04-16T15:35:55.083196+0000","last_undegraded":"2024-04-16T15:35:55.083196+0000","last_fullsized":"2024-04-16T15:35:55.083196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:46.901553+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:46.901306+0000","last_became_peered":"2024-04-16T15:35:46.901306+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083417+0000","last_change":"2024-04-16T15:35:52.664769+0000","last_active":"2024-04-16T15:35:55.083417+0000","last_peered":"2024-04-16T15:35:55.083417+0000","last_clean":"2024-04-16T15:35:55.083417+0000","last_became_active":"2024-04-16T15:35:52.664412+0000","last_became_peered":"2024-04-16T15:35:52.664412+0000","last_unstale":"2024-04-16T15:35:55.083417+0000","last_undegraded":"2024-04-16T15:35:55.083417+0000","last_fullsized":"2024-04-16T15:35:55.083417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927849+0000","last_change":"2024-04-16T15:35:47.922561+0000","last_active":"2024-04-16T15:35:53.927849+0000","last_peered":"2024-04-16T15:35:53.927849+0000","last_clean":"2024-04-16T15:35:53.927849+0000","last_became_active":"2024-04-16T15:35:47.922290+0000","last_became_peered":"2024-04-16T15:35:47.922290+0000","last_unstale":"2024-04-16T15:35:53.927849+0000","last_undegraded":"2024-04-16T15:35:53.927849+0000","last_fullsized":"2024-04-16T15:35:53.927849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930657+0000","last_change":"2024-04-16T15:35:46.896323+0000","last_active":"2024-04-16T15:35:53.930657+0000","last_peered":"2024-04-16T15:35:53.930657+0000","last_clean":"2024-04-16T15:35:53.930657+0000","last_became_active":"2024-04-16T15:35:46.895810+0000","last_became_peered":"2024-04-16T15:35:46.895810+0000","last_unstale":"2024-04-16T15:35:53.930657+0000","last_undegraded":"2024-04-16T15:35:53.930657+0000","last_fullsized":"2024-04-16T15:35:53.930657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083251+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:35:55.083251+0000","last_peered":"2024-04-16T15:35:55.083251+0000","last_clean":"2024-04-16T15:35:55.083251+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:35:55.083251+0000","last_undegraded":"2024-04-16T15:35:55.083251+0000","last_fullsized":"2024-04-16T15:35:55.083251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369307+0000","last_change":"2024-04-16T15:35:52.664786+0000","last_active":"2024-04-16T15:35:54.369307+0000","last_peered":"2024-04-16T15:35:54.369307+0000","last_clean":"2024-04-16T15:35:54.369307+0000","last_became_active":"2024-04-16T15:35:52.664391+0000","last_became_peered":"2024-04-16T15:35:52.664391+0000","last_unstale":"2024-04-16T15:35:54.369307+0000","last_undegraded":"2024-04-16T15:35:54.369307+0000","last_fullsized":"2024-04-16T15:35:54.369307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083545+0000","last_change":"2024-04-16T15:35:47.922117+0000","last_active":"2024-04-16T15:35:55.083545+0000","last_peered":"2024-04-16T15:35:55.083545+0000","last_clean":"2024-04-16T15:35:55.083545+0000","last_became_active":"2024-04-16T15:35:47.921710+0000","last_became_peered":"2024-04-16T15:35:47.921710+0000","last_unstale":"2024-04-16T15:35:55.083545+0000","last_undegraded":"2024-04-16T15:35:55.083545+0000","last_fullsized":"2024-04-16T15:35:55.083545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571271+0000","last_change":"2024-04-16T15:35:46.896754+0000","last_active":"2024-04-16T15:35:54.571271+0000","last_peered":"2024-04-16T15:35:54.571271+0000","last_clean":"2024-04-16T15:35:54.571271+0000","last_became_active":"2024-04-16T15:35:46.896444+0000","last_became_peered":"2024-04-16T15:35:46.896444+0000","last_unstale":"2024-04-16T15:35:54.571271+0000","last_undegraded":"2024-04-16T15:35:54.571271+0000","last_fullsized":"2024-04-16T15:35:54.571271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368973+0000","last_change":"2024-04-16T15:35:52.662295+0000","last_active":"2024-04-16T15:35:54.368973+0000","last_peered":"2024-04-16T15:35:54.368973+0000","last_clean":"2024-04-16T15:35:54.368973+0000","last_became_active":"2024-04-16T15:35:52.661789+0000","last_became_peered":"2024-04-16T15:35:52.661789+0000","last_unstale":"2024-04-16T15:35:54.368973+0000","last_undegraded":"2024-04-16T15:35:54.368973+0000","last_fullsized":"2024-04-16T15:35:54.368973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930470+0000","last_change":"2024-04-16T15:35:47.915448+0000","last_active":"2024-04-16T15:35:53.930470+0000","last_peered":"2024-04-16T15:35:53.930470+0000","last_clean":"2024-04-16T15:35:53.930470+0000","last_became_active":"2024-04-16T15:35:47.915151+0000","last_became_peered":"2024-04-16T15:35:47.915151+0000","last_unstale":"2024-04-16T15:35:53.930470+0000","last_undegraded":"2024-04-16T15:35:53.930470+0000","last_fullsized":"2024-04-16T15:35:53.930470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082565+0000","last_change":"2024-04-16T15:35:46.897447+0000","last_active":"2024-04-16T15:35:55.082565+0000","last_peered":"2024-04-16T15:35:55.082565+0000","last_clean":"2024-04-16T15:35:55.082565+0000","last_became_active":"2024-04-16T15:35:46.897179+0000","last_became_peered":"2024-04-16T15:35:46.897179+0000","last_unstale":"2024-04-16T15:35:55.082565+0000","last_undegraded":"2024-04-16T15:35:55.082565+0000","last_fullsized":"2024-04-16T15:35:55.082565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084143+0000","last_change":"2024-04-16T15:35:51.944235+0000","last_active":"2024-04-16T15:35:55.084143+0000","last_peered":"2024-04-16T15:35:55.084143+0000","last_clean":"2024-04-16T15:35:55.084143+0000","last_became_active":"2024-04-16T15:35:51.943896+0000","last_became_peered":"2024-04-16T15:35:51.943896+0000","last_unstale":"2024-04-16T15:35:55.084143+0000","last_undegraded":"2024-04-16T15:35:55.084143+0000","last_fullsized":"2024-04-16T15:35:55.084143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083827+0000","last_change":"2024-04-16T15:35:47.918103+0000","last_active":"2024-04-16T15:35:55.083827+0000","last_peered":"2024-04-16T15:35:55.083827+0000","last_clean":"2024-04-16T15:35:55.083827+0000","last_became_active":"2024-04-16T15:35:47.917822+0000","last_became_peered":"2024-04-16T15:35:47.917822+0000","last_unstale":"2024-04-16T15:35:55.083827+0000","last_undegraded":"2024-04-16T15:35:55.083827+0000","last_fullsized":"2024-04-16T15:35:55.083827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:17.070863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571348+0000","last_change":"2024-04-16T15:35:46.894341+0000","last_active":"2024-04-16T15:35:54.571348+0000","last_peered":"2024-04-16T15:35:54.571348+0000","last_clean":"2024-04-16T15:35:54.571348+0000","last_became_active":"2024-04-16T15:35:46.894073+0000","last_became_peered":"2024-04-16T15:35:46.894073+0000","last_unstale":"2024-04-16T15:35:54.571348+0000","last_undegraded":"2024-04-16T15:35:54.571348+0000","last_fullsized":"2024-04-16T15:35:54.571348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929370+0000","last_change":"2024-04-16T15:35:52.662624+0000","last_active":"2024-04-16T15:35:53.929370+0000","last_peered":"2024-04-16T15:35:53.929370+0000","last_clean":"2024-04-16T15:35:53.929370+0000","last_became_active":"2024-04-16T15:35:52.661957+0000","last_became_peered":"2024-04-16T15:35:52.661957+0000","last_unstale":"2024-04-16T15:35:53.929370+0000","last_undegraded":"2024-04-16T15:35:53.929370+0000","last_fullsized":"2024-04-16T15:35:53.929370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083699+0000","last_change":"2024-04-16T15:35:47.918195+0000","last_active":"2024-04-16T15:35:55.083699+0000","last_peered":"2024-04-16T15:35:55.083699+0000","last_clean":"2024-04-16T15:35:55.083699+0000","last_became_active":"2024-04-16T15:35:47.917803+0000","last_became_peered":"2024-04-16T15:35:47.917803+0000","last_unstale":"2024-04-16T15:35:55.083699+0000","last_undegraded":"2024-04-16T15:35:55.083699+0000","last_fullsized":"2024-04-16T15:35:55.083699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930244+0000","last_change":"2024-04-16T15:35:46.899018+0000","last_active":"2024-04-16T15:35:53.930244+0000","last_peered":"2024-04-16T15:35:53.930244+0000","last_clean":"2024-04-16T15:35:53.930244+0000","last_became_active":"2024-04-16T15:35:46.898729+0000","last_became_peered":"2024-04-16T15:35:46.898729+0000","last_unstale":"2024-04-16T15:35:53.930244+0000","last_undegraded":"2024-04-16T15:35:53.930244+0000","last_fullsized":"2024-04-16T15:35:53.930244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929608+0000","last_change":"2024-04-16T15:35:51.941144+0000","last_active":"2024-04-16T15:35:53.929608+0000","last_peered":"2024-04-16T15:35:53.929608+0000","last_clean":"2024-04-16T15:35:53.929608+0000","last_became_active":"2024-04-16T15:35:51.940597+0000","last_became_peered":"2024-04-16T15:35:51.940597+0000","last_unstale":"2024-04-16T15:35:53.929608+0000","last_undegraded":"2024-04-16T15:35:53.929608+0000","last_fullsized":"2024-04-16T15:35:53.929608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:41.324458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083262+0000","last_change":"2024-04-16T15:35:47.914496+0000","last_active":"2024-04-16T15:35:55.083262+0000","last_peered":"2024-04-16T15:35:55.083262+0000","last_clean":"2024-04-16T15:35:55.083262+0000","last_became_active":"2024-04-16T15:35:47.913786+0000","last_became_peered":"2024-04-16T15:35:47.913786+0000","last_unstale":"2024-04-16T15:35:55.083262+0000","last_undegraded":"2024-04-16T15:35:55.083262+0000","last_fullsized":"2024-04-16T15:35:55.083262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570927+0000","last_change":"2024-04-16T15:35:46.897628+0000","last_active":"2024-04-16T15:35:54.570927+0000","last_peered":"2024-04-16T15:35:54.570927+0000","last_clean":"2024-04-16T15:35:54.570927+0000","last_became_active":"2024-04-16T15:35:46.897367+0000","last_became_peered":"2024-04-16T15:35:46.897367+0000","last_unstale":"2024-04-16T15:35:54.570927+0000","last_undegraded":"2024-04-16T15:35:54.570927+0000","last_fullsized":"2024-04-16T15:35:54.570927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083283+0000","last_change":"2024-04-16T15:35:51.945992+0000","last_active":"2024-04-16T15:35:55.083283+0000","last_peered":"2024-04-16T15:35:55.083283+0000","last_clean":"2024-04-16T15:35:55.083283+0000","last_became_active":"2024-04-16T15:35:51.945596+0000","last_became_peered":"2024-04-16T15:35:51.945596+0000","last_unstale":"2024-04-16T15:35:55.083283+0000","last_undegraded":"2024-04-16T15:35:55.083283+0000","last_fullsized":"2024-04-16T15:35:55.083283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368868+0000","last_change":"2024-04-16T15:35:47.910686+0000","last_active":"2024-04-16T15:35:54.368868+0000","last_peered":"2024-04-16T15:35:54.368868+0000","last_clean":"2024-04-16T15:35:54.368868+0000","last_became_active":"2024-04-16T15:35:47.910289+0000","last_became_peered":"2024-04-16T15:35:47.910289+0000","last_unstale":"2024-04-16T15:35:54.368868+0000","last_undegraded":"2024-04-16T15:35:54.368868+0000","last_fullsized":"2024-04-16T15:35:54.368868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368949+0000","last_change":"2024-04-16T15:35:46.899316+0000","last_active":"2024-04-16T15:35:54.368949+0000","last_peered":"2024-04-16T15:35:54.368949+0000","last_clean":"2024-04-16T15:35:54.368949+0000","last_became_active":"2024-04-16T15:35:46.899031+0000","last_became_peered":"2024-04-16T15:35:46.899031+0000","last_unstale":"2024-04-16T15:35:54.368949+0000","last_undegraded":"2024-04-16T15:35:54.368949+0000","last_fullsized":"2024-04-16T15:35:54.368949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928588+0000","last_change":"2024-04-16T15:35:52.665294+0000","last_active":"2024-04-16T15:35:53.928588+0000","last_peered":"2024-04-16T15:35:53.928588+0000","last_clean":"2024-04-16T15:35:53.928588+0000","last_became_active":"2024-04-16T15:35:52.664948+0000","last_became_peered":"2024-04-16T15:35:52.664948+0000","last_unstale":"2024-04-16T15:35:53.928588+0000","last_undegraded":"2024-04-16T15:35:53.928588+0000","last_fullsized":"2024-04-16T15:35:53.928588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:52.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083368+0000","last_change":"2024-04-16T15:35:47.921106+0000","last_active":"2024-04-16T15:35:55.083368+0000","last_peered":"2024-04-16T15:35:55.083368+0000","last_clean":"2024-04-16T15:35:55.083368+0000","last_became_active":"2024-04-16T15:35:47.920831+0000","last_became_peered":"2024-04-16T15:35:47.920831+0000","last_unstale":"2024-04-16T15:35:55.083368+0000","last_undegraded":"2024-04-16T15:35:55.083368+0000","last_fullsized":"2024-04-16T15:35:55.083368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930813+0000","last_change":"2024-04-16T15:35:46.894785+0000","last_active":"2024-04-16T15:35:53.930813+0000","last_peered":"2024-04-16T15:35:53.930813+0000","last_clean":"2024-04-16T15:35:53.930813+0000","last_became_active":"2024-04-16T15:35:46.894416+0000","last_became_peered":"2024-04-16T15:35:46.894416+0000","last_unstale":"2024-04-16T15:35:53.930813+0000","last_undegraded":"2024-04-16T15:35:53.930813+0000","last_fullsized":"2024-04-16T15:35:53.930813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928344+0000","last_change":"2024-04-16T15:35:52.662123+0000","last_active":"2024-04-16T15:35:53.928344+0000","last_peered":"2024-04-16T15:35:53.928344+0000","last_clean":"2024-04-16T15:35:53.928344+0000","last_became_active":"2024-04-16T15:35:52.661758+0000","last_became_peered":"2024-04-16T15:35:52.661758+0000","last_unstale":"2024-04-16T15:35:53.928344+0000","last_undegraded":"2024-04-16T15:35:53.928344+0000","last_fullsized":"2024-04-16T15:35:53.928344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:12.922280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083720+0000","last_change":"2024-04-16T15:35:47.916216+0000","last_active":"2024-04-16T15:35:55.083720+0000","last_peered":"2024-04-16T15:35:55.083720+0000","last_clean":"2024-04-16T15:35:55.083720+0000","last_became_active":"2024-04-16T15:35:47.915566+0000","last_became_peered":"2024-04-16T15:35:47.915566+0000","last_unstale":"2024-04-16T15:35:55.083720+0000","last_undegraded":"2024-04-16T15:35:55.083720+0000","last_fullsized":"2024-04-16T15:35:55.083720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082527+0000","last_change":"2024-04-16T15:35:46.897293+0000","last_active":"2024-04-16T15:35:55.082527+0000","last_peered":"2024-04-16T15:35:55.082527+0000","last_clean":"2024-04-16T15:35:55.082527+0000","last_became_active":"2024-04-16T15:35:46.897006+0000","last_became_peered":"2024-04-16T15:35:46.897006+0000","last_unstale":"2024-04-16T15:35:55.082527+0000","last_undegraded":"2024-04-16T15:35:55.082527+0000","last_fullsized":"2024-04-16T15:35:55.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931065+0000","last_change":"2024-04-16T15:35:52.664883+0000","last_active":"2024-04-16T15:35:53.931065+0000","last_peered":"2024-04-16T15:35:53.931065+0000","last_clean":"2024-04-16T15:35:53.931065+0000","last_became_active":"2024-04-16T15:35:52.664454+0000","last_became_peered":"2024-04-16T15:35:52.664454+0000","last_unstale":"2024-04-16T15:35:53.931065+0000","last_undegraded":"2024-04-16T15:35:53.931065+0000","last_fullsized":"2024-04-16T15:35:53.931065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083452+0000","last_change":"2024-04-16T15:35:47.922333+0000","last_active":"2024-04-16T15:35:55.083452+0000","last_peered":"2024-04-16T15:35:55.083452+0000","last_clean":"2024-04-16T15:35:55.083452+0000","last_became_active":"2024-04-16T15:35:47.922051+0000","last_became_peered":"2024-04-16T15:35:47.922051+0000","last_unstale":"2024-04-16T15:35:55.083452+0000","last_undegraded":"2024-04-16T15:35:55.083452+0000","last_fullsized":"2024-04-16T15:35:55.083452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:56.980683+0000","last_change":"2024-04-16T15:35:46.899953+0000","last_active":"2024-04-16T15:35:56.980683+0000","last_peered":"2024-04-16T15:35:56.980683+0000","last_clean":"2024-04-16T15:35:56.980683+0000","last_became_active":"2024-04-16T15:35:46.899684+0000","last_became_peered":"2024-04-16T15:35:46.899684+0000","last_unstale":"2024-04-16T15:35:56.980683+0000","last_undegraded":"2024-04-16T15:35:56.980683+0000","last_fullsized":"2024-04-16T15:35:56.980683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084387+0000","last_change":"2024-04-16T15:35:51.940461+0000","last_active":"2024-04-16T15:35:55.084387+0000","last_peered":"2024-04-16T15:35:55.084387+0000","last_clean":"2024-04-16T15:35:55.084387+0000","last_became_active":"2024-04-16T15:35:51.940074+0000","last_became_peered":"2024-04-16T15:35:51.940074+0000","last_unstale":"2024-04-16T15:35:55.084387+0000","last_undegraded":"2024-04-16T15:35:55.084387+0000","last_fullsized":"2024-04-16T15:35:55.084387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931115+0000","last_change":"2024-04-16T15:35:47.914523+0000","last_active":"2024-04-16T15:35:53.931115+0000","last_peered":"2024-04-16T15:35:53.931115+0000","last_clean":"2024-04-16T15:35:53.931115+0000","last_became_active":"2024-04-16T15:35:47.914263+0000","last_became_peered":"2024-04-16T15:35:47.914263+0000","last_unstale":"2024-04-16T15:35:53.931115+0000","last_undegraded":"2024-04-16T15:35:53.931115+0000","last_fullsized":"2024-04-16T15:35:53.931115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:49.648392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082701+0000","last_change":"2024-04-16T15:35:46.902816+0000","last_active":"2024-04-16T15:35:55.082701+0000","last_peered":"2024-04-16T15:35:55.082701+0000","last_clean":"2024-04-16T15:35:55.082701+0000","last_became_active":"2024-04-16T15:35:46.901873+0000","last_became_peered":"2024-04-16T15:35:46.901873+0000","last_unstale":"2024-04-16T15:35:55.082701+0000","last_undegraded":"2024-04-16T15:35:55.082701+0000","last_fullsized":"2024-04-16T15:35:55.082701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930687+0000","last_change":"2024-04-16T15:35:51.945111+0000","last_active":"2024-04-16T15:35:53.930687+0000","last_peered":"2024-04-16T15:35:53.930687+0000","last_clean":"2024-04-16T15:35:53.930687+0000","last_became_active":"2024-04-16T15:35:51.944177+0000","last_became_peered":"2024-04-16T15:35:51.944177+0000","last_unstale":"2024-04-16T15:35:53.930687+0000","last_undegraded":"2024-04-16T15:35:53.930687+0000","last_fullsized":"2024-04-16T15:35:53.930687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083788+0000","last_change":"2024-04-16T15:35:47.920026+0000","last_active":"2024-04-16T15:35:55.083788+0000","last_peered":"2024-04-16T15:35:55.083788+0000","last_clean":"2024-04-16T15:35:55.083788+0000","last_became_active":"2024-04-16T15:35:47.919754+0000","last_became_peered":"2024-04-16T15:35:47.919754+0000","last_unstale":"2024-04-16T15:35:55.083788+0000","last_undegraded":"2024-04-16T15:35:55.083788+0000","last_fullsized":"2024-04-16T15:35:55.083788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929875+0000","last_change":"2024-04-16T15:35:46.901151+0000","last_active":"2024-04-16T15:35:53.929875+0000","last_peered":"2024-04-16T15:35:53.929875+0000","last_clean":"2024-04-16T15:35:53.929875+0000","last_became_active":"2024-04-16T15:35:46.900666+0000","last_became_peered":"2024-04-16T15:35:46.900666+0000","last_unstale":"2024-04-16T15:35:53.929875+0000","last_undegraded":"2024-04-16T15:35:53.929875+0000","last_fullsized":"2024-04-16T15:35:53.929875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927908+0000","last_change":"2024-04-16T15:35:51.942012+0000","last_active":"2024-04-16T15:35:53.927908+0000","last_peered":"2024-04-16T15:35:53.927908+0000","last_clean":"2024-04-16T15:35:53.927908+0000","last_became_active":"2024-04-16T15:35:51.941666+0000","last_became_peered":"2024-04-16T15:35:51.941666+0000","last_unstale":"2024-04-16T15:35:53.927908+0000","last_undegraded":"2024-04-16T15:35:53.927908+0000","last_fullsized":"2024-04-16T15:35:53.927908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:07.372834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929764+0000","last_change":"2024-04-16T15:35:47.916230+0000","last_active":"2024-04-16T15:35:53.929764+0000","last_peered":"2024-04-16T15:35:53.929764+0000","last_clean":"2024-04-16T15:35:53.929764+0000","last_became_active":"2024-04-16T15:35:47.915930+0000","last_became_peered":"2024-04-16T15:35:47.915930+0000","last_unstale":"2024-04-16T15:35:53.929764+0000","last_undegraded":"2024-04-16T15:35:53.929764+0000","last_fullsized":"2024-04-16T15:35:53.929764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369463+0000","last_change":"2024-04-16T15:35:46.899249+0000","last_active":"2024-04-16T15:35:54.369463+0000","last_peered":"2024-04-16T15:35:54.369463+0000","last_clean":"2024-04-16T15:35:54.369463+0000","last_became_active":"2024-04-16T15:35:46.898904+0000","last_became_peered":"2024-04-16T15:35:46.898904+0000","last_unstale":"2024-04-16T15:35:54.369463+0000","last_undegraded":"2024-04-16T15:35:54.369463+0000","last_fullsized":"2024-04-16T15:35:54.369463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928158+0000","last_change":"2024-04-16T15:35:52.664770+0000","last_active":"2024-04-16T15:35:53.928158+0000","last_peered":"2024-04-16T15:35:53.928158+0000","last_clean":"2024-04-16T15:35:53.928158+0000","last_became_active":"2024-04-16T15:35:52.664405+0000","last_became_peered":"2024-04-16T15:35:52.664405+0000","last_unstale":"2024-04-16T15:35:53.928158+0000","last_undegraded":"2024-04-16T15:35:53.928158+0000","last_fullsized":"2024-04-16T15:35:53.928158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:44.943582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083145+0000","last_change":"2024-04-16T15:35:52.664928+0000","last_active":"2024-04-16T15:35:55.083145+0000","last_peered":"2024-04-16T15:35:55.083145+0000","last_clean":"2024-04-16T15:35:55.083145+0000","last_became_active":"2024-04-16T15:35:52.664390+0000","last_became_peered":"2024-04-16T15:35:52.664390+0000","last_unstale":"2024-04-16T15:35:55.083145+0000","last_undegraded":"2024-04-16T15:35:55.083145+0000","last_fullsized":"2024-04-16T15:35:55.083145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083042+0000","last_change":"2024-04-16T15:35:47.913302+0000","last_active":"2024-04-16T15:35:55.083042+0000","last_peered":"2024-04-16T15:35:55.083042+0000","last_clean":"2024-04-16T15:35:55.083042+0000","last_became_active":"2024-04-16T15:35:47.912246+0000","last_became_peered":"2024-04-16T15:35:47.912246+0000","last_unstale":"2024-04-16T15:35:55.083042+0000","last_undegraded":"2024-04-16T15:35:55.083042+0000","last_fullsized":"2024-04-16T15:35:55.083042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929579+0000","last_change":"2024-04-16T15:35:46.895206+0000","last_active":"2024-04-16T15:35:53.929579+0000","last_peered":"2024-04-16T15:35:53.929579+0000","last_clean":"2024-04-16T15:35:53.929579+0000","last_became_active":"2024-04-16T15:35:46.894912+0000","last_became_peered":"2024-04-16T15:35:46.894912+0000","last_unstale":"2024-04-16T15:35:53.929579+0000","last_undegraded":"2024-04-16T15:35:53.929579+0000","last_fullsized":"2024-04-16T15:35:53.929579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369422+0000","last_change":"2024-04-16T15:35:51.941806+0000","last_active":"2024-04-16T15:35:54.369422+0000","last_peered":"2024-04-16T15:35:54.369422+0000","last_clean":"2024-04-16T15:35:54.369422+0000","last_became_active":"2024-04-16T15:35:51.941433+0000","last_became_peered":"2024-04-16T15:35:51.941433+0000","last_unstale":"2024-04-16T15:35:54.369422+0000","last_undegraded":"2024-04-16T15:35:54.369422+0000","last_fullsized":"2024-04-16T15:35:54.369422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928093+0000","last_change":"2024-04-16T15:35:47.911758+0000","last_active":"2024-04-16T15:35:53.928093+0000","last_peered":"2024-04-16T15:35:53.928093+0000","last_clean":"2024-04-16T15:35:53.928093+0000","last_became_active":"2024-04-16T15:35:47.911245+0000","last_became_peered":"2024-04-16T15:35:47.911245+0000","last_unstale":"2024-04-16T15:35:53.928093+0000","last_undegraded":"2024-04-16T15:35:53.928093+0000","last_fullsized":"2024-04-16T15:35:53.928093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928041+0000","last_change":"2024-04-16T15:35:46.900742+0000","last_active":"2024-04-16T15:35:53.928041+0000","last_peered":"2024-04-16T15:35:53.928041+0000","last_clean":"2024-04-16T15:35:53.928041+0000","last_became_active":"2024-04-16T15:35:46.900416+0000","last_became_peered":"2024-04-16T15:35:46.900416+0000","last_unstale":"2024-04-16T15:35:53.928041+0000","last_undegraded":"2024-04-16T15:35:53.928041+0000","last_fullsized":"2024-04-16T15:35:53.928041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369097+0000","last_change":"2024-04-16T15:35:46.895563+0000","last_active":"2024-04-16T15:35:54.369097+0000","last_peered":"2024-04-16T15:35:54.369097+0000","last_clean":"2024-04-16T15:35:54.369097+0000","last_became_active":"2024-04-16T15:35:46.895267+0000","last_became_peered":"2024-04-16T15:35:46.895267+0000","last_unstale":"2024-04-16T15:35:54.369097+0000","last_undegraded":"2024-04-16T15:35:54.369097+0000","last_fullsized":"2024-04-16T15:35:54.369097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084188+0000","last_change":"2024-04-16T15:35:47.904515+0000","last_active":"2024-04-16T15:35:55.084188+0000","last_peered":"2024-04-16T15:35:55.084188+0000","last_clean":"2024-04-16T15:35:55.084188+0000","last_became_active":"2024-04-16T15:35:47.902329+0000","last_became_peered":"2024-04-16T15:35:47.902329+0000","last_unstale":"2024-04-16T15:35:55.084188+0000","last_undegraded":"2024-04-16T15:35:55.084188+0000","last_fullsized":"2024-04-16T15:35:55.084188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571221+0000","last_change":"2024-04-16T15:35:51.942716+0000","last_active":"2024-04-16T15:35:54.571221+0000","last_peered":"2024-04-16T15:35:54.571221+0000","last_clean":"2024-04-16T15:35:54.571221+0000","last_became_active":"2024-04-16T15:35:51.942306+0000","last_became_peered":"2024-04-16T15:35:51.942306+0000","last_unstale":"2024-04-16T15:35:54.571221+0000","last_undegraded":"2024-04-16T15:35:54.571221+0000","last_fullsized":"2024-04-16T15:35:54.571221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:21.643419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928089+0000","last_change":"2024-04-16T15:35:46.903607+0000","last_active":"2024-04-16T15:35:53.928089+0000","last_peered":"2024-04-16T15:35:53.928089+0000","last_clean":"2024-04-16T15:35:53.928089+0000","last_became_active":"2024-04-16T15:35:46.903329+0000","last_became_peered":"2024-04-16T15:35:46.903329+0000","last_unstale":"2024-04-16T15:35:53.928089+0000","last_undegraded":"2024-04-16T15:35:53.928089+0000","last_fullsized":"2024-04-16T15:35:53.928089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.903874+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.903605+0000","last_became_peered":"2024-04-16T15:35:47.903605+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:34.270943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928371+0000","last_change":"2024-04-16T15:35:51.941375+0000","last_active":"2024-04-16T15:35:53.928371+0000","last_peered":"2024-04-16T15:35:53.928371+0000","last_clean":"2024-04-16T15:35:53.928371+0000","last_became_active":"2024-04-16T15:35:51.940976+0000","last_became_peered":"2024-04-16T15:35:51.940976+0000","last_unstale":"2024-04-16T15:35:53.928371+0000","last_undegraded":"2024-04-16T15:35:53.928371+0000","last_fullsized":"2024-04-16T15:35:53.928371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:26.365805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368749+0000","last_change":"2024-04-16T15:35:47.911340+0000","last_active":"2024-04-16T15:35:54.368749+0000","last_peered":"2024-04-16T15:35:54.368749+0000","last_clean":"2024-04-16T15:35:54.368749+0000","last_became_active":"2024-04-16T15:35:47.910024+0000","last_became_peered":"2024-04-16T15:35:47.910024+0000","last_unstale":"2024-04-16T15:35:54.368749+0000","last_undegraded":"2024-04-16T15:35:54.368749+0000","last_fullsized":"2024-04-16T15:35:54.368749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570957+0000","last_change":"2024-04-16T15:35:47.921417+0000","last_active":"2024-04-16T15:35:54.570957+0000","last_peered":"2024-04-16T15:35:54.570957+0000","last_clean":"2024-04-16T15:35:54.570957+0000","last_became_active":"2024-04-16T15:35:47.921049+0000","last_became_peered":"2024-04-16T15:35:47.921049+0000","last_unstale":"2024-04-16T15:35:54.570957+0000","last_undegraded":"2024-04-16T15:35:54.570957+0000","last_fullsized":"2024-04-16T15:35:54.570957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.921766+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.921491+0000","last_became_peered":"2024-04-16T15:35:47.921491+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084075+0000","last_change":"2024-04-16T15:35:47.913693+0000","last_active":"2024-04-16T15:35:55.084075+0000","last_peered":"2024-04-16T15:35:55.084075+0000","last_clean":"2024-04-16T15:35:55.084075+0000","last_became_active":"2024-04-16T15:35:47.912712+0000","last_became_peered":"2024-04-16T15:35:47.912712+0000","last_unstale":"2024-04-16T15:35:55.084075+0000","last_undegraded":"2024-04-16T15:35:55.084075+0000","last_fullsized":"2024-04-16T15:35:55.084075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928318+0000","last_change":"2024-04-16T15:35:47.910738+0000","last_active":"2024-04-16T15:35:53.928318+0000","last_peered":"2024-04-16T15:35:53.928318+0000","last_clean":"2024-04-16T15:35:53.928318+0000","last_became_active":"2024-04-16T15:35:47.910305+0000","last_became_peered":"2024-04-16T15:35:47.910305+0000","last_unstale":"2024-04-16T15:35:53.928318+0000","last_undegraded":"2024-04-16T15:35:53.928318+0000","last_fullsized":"2024-04-16T15:35:53.928318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082815+0000","last_change":"2024-04-16T15:35:47.912617+0000","last_active":"2024-04-16T15:35:55.082815+0000","last_peered":"2024-04-16T15:35:55.082815+0000","last_clean":"2024-04-16T15:35:55.082815+0000","last_became_active":"2024-04-16T15:35:47.912319+0000","last_became_peered":"2024-04-16T15:35:47.912319+0000","last_unstale":"2024-04-16T15:35:55.082815+0000","last_undegraded":"2024-04-16T15:35:55.082815+0000","last_fullsized":"2024-04-16T15:35:55.082815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369503+0000","last_change":"2024-04-16T15:35:47.914226+0000","last_active":"2024-04-16T15:35:54.369503+0000","last_peered":"2024-04-16T15:35:54.369503+0000","last_clean":"2024-04-16T15:35:54.369503+0000","last_became_active":"2024-04-16T15:35:47.913944+0000","last_became_peered":"2024-04-16T15:35:47.913944+0000","last_unstale":"2024-04-16T15:35:54.369503+0000","last_undegraded":"2024-04-16T15:35:54.369503+0000","last_fullsized":"2024-04-16T15:35:54.369503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928560+0000","last_change":"2024-04-16T15:35:47.910810+0000","last_active":"2024-04-16T15:35:53.928560+0000","last_peered":"2024-04-16T15:35:53.928560+0000","last_clean":"2024-04-16T15:35:53.928560+0000","last_became_active":"2024-04-16T15:35:47.910509+0000","last_became_peered":"2024-04-16T15:35:47.910509+0000","last_unstale":"2024-04-16T15:35:53.928560+0000","last_undegraded":"2024-04-16T15:35:53.928560+0000","last_fullsized":"2024-04-16T15:35:53.928560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929472+0000","last_change":"2024-04-16T15:35:47.921447+0000","last_active":"2024-04-16T15:35:53.929472+0000","last_peered":"2024-04-16T15:35:53.929472+0000","last_clean":"2024-04-16T15:35:53.929472+0000","last_became_active":"2024-04-16T15:35:47.921165+0000","last_became_peered":"2024-04-16T15:35:47.921165+0000","last_unstale":"2024-04-16T15:35:53.929472+0000","last_undegraded":"2024-04-16T15:35:53.929472+0000","last_fullsized":"2024-04-16T15:35:53.929472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927957+0000","last_change":"2024-04-16T15:35:47.909329+0000","last_active":"2024-04-16T15:35:53.927957+0000","last_peered":"2024-04-16T15:35:53.927957+0000","last_clean":"2024-04-16T15:35:53.927957+0000","last_became_active":"2024-04-16T15:35:47.908921+0000","last_became_peered":"2024-04-16T15:35:47.908921+0000","last_unstale":"2024-04-16T15:35:53.927957+0000","last_undegraded":"2024-04-16T15:35:53.927957+0000","last_fullsized":"2024-04-16T15:35:53.927957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930611+0000","last_change":"2024-04-16T15:35:47.916529+0000","last_active":"2024-04-16T15:35:53.930611+0000","last_peered":"2024-04-16T15:35:53.930611+0000","last_clean":"2024-04-16T15:35:53.930611+0000","last_became_active":"2024-04-16T15:35:47.916272+0000","last_became_peered":"2024-04-16T15:35:47.916272+0000","last_unstale":"2024-04-16T15:35:53.930611+0000","last_undegraded":"2024-04-16T15:35:53.930611+0000","last_fullsized":"2024-04-16T15:35:53.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083999+0000","last_change":"2024-04-16T15:35:47.916637+0000","last_active":"2024-04-16T15:35:55.083999+0000","last_peered":"2024-04-16T15:35:55.083999+0000","last_clean":"2024-04-16T15:35:55.083999+0000","last_became_active":"2024-04-16T15:35:47.915756+0000","last_became_peered":"2024-04-16T15:35:47.915756+0000","last_unstale":"2024-04-16T15:35:55.083999+0000","last_undegraded":"2024-04-16T15:35:55.083999+0000","last_fullsized":"2024-04-16T15:35:55.083999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369168+0000","last_change":"2024-04-16T15:35:47.905523+0000","last_active":"2024-04-16T15:35:54.369168+0000","last_peered":"2024-04-16T15:35:54.369168+0000","last_clean":"2024-04-16T15:35:54.369168+0000","last_became_active":"2024-04-16T15:35:47.905101+0000","last_became_peered":"2024-04-16T15:35:47.905101+0000","last_unstale":"2024-04-16T15:35:54.369168+0000","last_undegraded":"2024-04-16T15:35:54.369168+0000","last_fullsized":"2024-04-16T15:35:54.369168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083700+0000","last_change":"2024-04-16T15:35:47.917168+0000","last_active":"2024-04-16T15:35:55.083700+0000","last_peered":"2024-04-16T15:35:55.083700+0000","last_clean":"2024-04-16T15:35:55.083700+0000","last_became_active":"2024-04-16T15:35:47.914760+0000","last_became_peered":"2024-04-16T15:35:47.914760+0000","last_unstale":"2024-04-16T15:35:55.083700+0000","last_undegraded":"2024-04-16T15:35:55.083700+0000","last_fullsized":"2024-04-16T15:35:55.083700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:58.573474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571311+0000","last_change":"2024-04-16T15:35:47.906661+0000","last_active":"2024-04-16T15:35:54.571311+0000","last_peered":"2024-04-16T15:35:54.571311+0000","last_clean":"2024-04-16T15:35:54.571311+0000","last_became_active":"2024-04-16T15:35:47.906376+0000","last_became_peered":"2024-04-16T15:35:47.906376+0000","last_unstale":"2024-04-16T15:35:54.571311+0000","last_undegraded":"2024-04-16T15:35:54.571311+0000","last_fullsized":"2024-04-16T15:35:54.571311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930697+0000","last_change":"2024-04-16T15:35:47.918857+0000","last_active":"2024-04-16T15:35:53.930697+0000","last_peered":"2024-04-16T15:35:53.930697+0000","last_clean":"2024-04-16T15:35:53.930697+0000","last_became_active":"2024-04-16T15:35:47.918601+0000","last_became_peered":"2024-04-16T15:35:47.918601+0000","last_unstale":"2024-04-16T15:35:53.930697+0000","last_undegraded":"2024-04-16T15:35:53.930697+0000","last_fullsized":"2024-04-16T15:35:53.930697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929331+0000","last_change":"2024-04-16T15:35:47.903123+0000","last_active":"2024-04-16T15:35:53.929331+0000","last_peered":"2024-04-16T15:35:53.929331+0000","last_clean":"2024-04-16T15:35:53.929331+0000","last_became_active":"2024-04-16T15:35:47.902519+0000","last_became_peered":"2024-04-16T15:35:47.902519+0000","last_unstale":"2024-04-16T15:35:53.929331+0000","last_undegraded":"2024-04-16T15:35:53.929331+0000","last_fullsized":"2024-04-16T15:35:53.929331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:47.906920+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:47.906647+0000","last_became_peered":"2024-04-16T15:35:47.906647+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083651+0000","last_change":"2024-04-16T15:35:47.903897+0000","last_active":"2024-04-16T15:35:55.083651+0000","last_peered":"2024-04-16T15:35:55.083651+0000","last_clean":"2024-04-16T15:35:55.083651+0000","last_became_active":"2024-04-16T15:35:47.903636+0000","last_became_peered":"2024-04-16T15:35:47.903636+0000","last_unstale":"2024-04-16T15:35:55.083651+0000","last_undegraded":"2024-04-16T15:35:55.083651+0000","last_fullsized":"2024-04-16T15:35:55.083651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:17.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927930+0000","last_change":"2024-04-16T15:35:47.919522+0000","last_active":"2024-04-16T15:35:53.927930+0000","last_peered":"2024-04-16T15:35:53.927930+0000","last_clean":"2024-04-16T15:35:53.927930+0000","last_became_active":"2024-04-16T15:35:47.919224+0000","last_became_peered":"2024-04-16T15:35:47.919224+0000","last_unstale":"2024-04-16T15:35:53.927930+0000","last_undegraded":"2024-04-16T15:35:53.927930+0000","last_fullsized":"2024-04-16T15:35:53.927930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931084+0000","last_change":"2024-04-16T15:35:47.904535+0000","last_active":"2024-04-16T15:35:53.931084+0000","last_peered":"2024-04-16T15:35:53.931084+0000","last_clean":"2024-04-16T15:35:53.931084+0000","last_became_active":"2024-04-16T15:35:47.904263+0000","last_became_peered":"2024-04-16T15:35:47.904263+0000","last_unstale":"2024-04-16T15:35:53.931084+0000","last_undegraded":"2024-04-16T15:35:53.931084+0000","last_fullsized":"2024-04-16T15:35:53.931084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369248+0000","last_change":"2024-04-16T15:35:47.908367+0000","last_active":"2024-04-16T15:35:54.369248+0000","last_peered":"2024-04-16T15:35:54.369248+0000","last_clean":"2024-04-16T15:35:54.369248+0000","last_became_active":"2024-04-16T15:35:47.908073+0000","last_became_peered":"2024-04-16T15:35:47.908073+0000","last_unstale":"2024-04-16T15:35:54.369248+0000","last_undegraded":"2024-04-16T15:35:54.369248+0000","last_fullsized":"2024-04-16T15:35:54.369248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369451+0000","last_change":"2024-04-16T15:35:47.907751+0000","last_active":"2024-04-16T15:35:54.369451+0000","last_peered":"2024-04-16T15:35:54.369451+0000","last_clean":"2024-04-16T15:35:54.369451+0000","last_became_active":"2024-04-16T15:35:47.907492+0000","last_became_peered":"2024-04-16T15:35:47.907492+0000","last_unstale":"2024-04-16T15:35:54.369451+0000","last_undegraded":"2024-04-16T15:35:54.369451+0000","last_fullsized":"2024-04-16T15:35:54.369451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083822+0000","last_change":"2024-04-16T15:35:47.922537+0000","last_active":"2024-04-16T15:35:55.083822+0000","last_peered":"2024-04-16T15:35:55.083822+0000","last_clean":"2024-04-16T15:35:55.083822+0000","last_became_active":"2024-04-16T15:35:47.922261+0000","last_became_peered":"2024-04-16T15:35:47.922261+0000","last_unstale":"2024-04-16T15:35:55.083822+0000","last_undegraded":"2024-04-16T15:35:55.083822+0000","last_fullsized":"2024-04-16T15:35:55.083822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927732+0000","last_change":"2024-04-16T15:35:47.921897+0000","last_active":"2024-04-16T15:35:53.927732+0000","last_peered":"2024-04-16T15:35:53.927732+0000","last_clean":"2024-04-16T15:35:53.927732+0000","last_became_active":"2024-04-16T15:35:47.921646+0000","last_became_peered":"2024-04-16T15:35:47.921646+0000","last_unstale":"2024-04-16T15:35:53.927732+0000","last_undegraded":"2024-04-16T15:35:53.927732+0000","last_fullsized":"2024-04-16T15:35:53.927732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083179+0000","last_change":"2024-04-16T15:35:47.920391+0000","last_active":"2024-04-16T15:35:55.083179+0000","last_peered":"2024-04-16T15:35:55.083179+0000","last_clean":"2024-04-16T15:35:55.083179+0000","last_became_active":"2024-04-16T15:35:47.920071+0000","last_became_peered":"2024-04-16T15:35:47.920071+0000","last_unstale":"2024-04-16T15:35:55.083179+0000","last_undegraded":"2024-04-16T15:35:55.083179+0000","last_fullsized":"2024-04-16T15:35:55.083179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930585+0000","last_change":"2024-04-16T15:35:47.903213+0000","last_active":"2024-04-16T15:35:53.930585+0000","last_peered":"2024-04-16T15:35:53.930585+0000","last_clean":"2024-04-16T15:35:53.930585+0000","last_became_active":"2024-04-16T15:35:47.902785+0000","last_became_peered":"2024-04-16T15:35:47.902785+0000","last_unstale":"2024-04-16T15:35:53.930585+0000","last_undegraded":"2024-04-16T15:35:53.930585+0000","last_fullsized":"2024-04-16T15:35:53.930585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083264+0000","last_change":"2024-04-16T15:35:47.914772+0000","last_active":"2024-04-16T15:35:55.083264+0000","last_peered":"2024-04-16T15:35:55.083264+0000","last_clean":"2024-04-16T15:35:55.083264+0000","last_became_active":"2024-04-16T15:35:47.913751+0000","last_became_peered":"2024-04-16T15:35:47.913751+0000","last_unstale":"2024-04-16T15:35:55.083264+0000","last_undegraded":"2024-04-16T15:35:55.083264+0000","last_fullsized":"2024-04-16T15:35:55.083264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930257+0000","last_change":"2024-04-16T15:35:47.914826+0000","last_active":"2024-04-16T15:35:53.930257+0000","last_peered":"2024-04-16T15:35:53.930257+0000","last_clean":"2024-04-16T15:35:53.930257+0000","last_became_active":"2024-04-16T15:35:47.913014+0000","last_became_peered":"2024-04-16T15:35:47.913014+0000","last_unstale":"2024-04-16T15:35:53.930257+0000","last_undegraded":"2024-04-16T15:35:53.930257+0000","last_fullsized":"2024-04-16T15:35:53.930257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083035+0000","last_change":"2024-04-16T15:35:47.907911+0000","last_active":"2024-04-16T15:35:55.083035+0000","last_peered":"2024-04-16T15:35:55.083035+0000","last_clean":"2024-04-16T15:35:55.083035+0000","last_became_active":"2024-04-16T15:35:47.907655+0000","last_became_peered":"2024-04-16T15:35:47.907655+0000","last_unstale":"2024-04-16T15:35:55.083035+0000","last_undegraded":"2024-04-16T15:35:55.083035+0000","last_fullsized":"2024-04-16T15:35:55.083035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083534+0000","last_change":"2024-04-16T15:35:47.907719+0000","last_active":"2024-04-16T15:35:55.083534+0000","last_peered":"2024-04-16T15:35:55.083534+0000","last_clean":"2024-04-16T15:35:55.083534+0000","last_became_active":"2024-04-16T15:35:47.907381+0000","last_became_peered":"2024-04-16T15:35:47.907381+0000","last_unstale":"2024-04-16T15:35:55.083534+0000","last_undegraded":"2024-04-16T15:35:55.083534+0000","last_fullsized":"2024-04-16T15:35:55.083534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083718+0000","last_change":"2024-04-16T15:35:47.913767+0000","last_active":"2024-04-16T15:35:55.083718+0000","last_peered":"2024-04-16T15:35:55.083718+0000","last_clean":"2024-04-16T15:35:55.083718+0000","last_became_active":"2024-04-16T15:35:47.913475+0000","last_became_peered":"2024-04-16T15:35:47.913475+0000","last_unstale":"2024-04-16T15:35:55.083718+0000","last_undegraded":"2024-04-16T15:35:55.083718+0000","last_fullsized":"2024-04-16T15:35:55.083718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:36:05.296 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T15:36:05.296 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T15:36:05.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T15:36:05.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T15:36:05.297 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T15:36:05.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 Processor -- start 2024-04-16T15:36:05.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 -- start start 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 0x7fd11415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 0x7fd114163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1140cfbf0 con 0x7fd1140d1450 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd114162900 con 0x7fd11415ef80 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.436+0000 7fd11adba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd114162ec0 con 0x7fd1140cf780 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd118b56640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd1140d1450 0x7fd1140d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33864/0 (socket says 172.21.15.80:33864) 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd118b56640 1 -- 172.21.15.80:0/3996424545 learned_addr learned my addr 172.21.15.80:0/3996424545 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd113fff640 1 --2- 172.21.15.80:0/3996424545 >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 0x7fd11415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd119357640 1 --2- 172.21.15.80:0/3996424545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 0x7fd114163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd1137fe640 1 -- 172.21.15.80:0/3996424545 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519219050 0 0) 0x7fd1140cfbf0 con 0x7fd1140d1450 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd1137fe640 1 -- 172.21.15.80:0/3996424545 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd100003520 con 0x7fd1140d1450 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd119357640 1 -- 172.21.15.80:0/3996424545 >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 msgr2=0x7fd11415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:05.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd119357640 1 --2- 172.21.15.80:0/3996424545 >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 0x7fd11415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd119357640 1 -- 172.21.15.80:0/3996424545 >> v1:172.21.15.80:6789/0 conn(0x7fd1140d1450 legacy=0x7fd1140d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd119357640 1 -- 172.21.15.80:0/3996424545 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1140cfeb0 con 0x7fd1140cf780 2024-04-16T15:36:05.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.437+0000 7fd113fff640 1 --2- 172.21.15.80:0/3996424545 >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 0x7fd11415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd119357640 1 --2- 172.21.15.80:0/3996424545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 0x7fd114163350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097a0 tx=0x7fd0fc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef781372aaacfe5e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd1137fe640 1 -- 172.21.15.80:0/3996424545 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0315a0 con 0x7fd1140cf780 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd1137fe640 1 -- 172.21.15.80:0/3996424545 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc037070 con 0x7fd1140cf780 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd1137fe640 1 -- 172.21.15.80:0/3996424545 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc031940 con 0x7fd1140cf780 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd11adba640 1 -- 172.21.15.80:0/3996424545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 msgr2=0x7fd114163350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.438+0000 7fd11adba640 1 --2- 172.21.15.80:0/3996424545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 0x7fd114163350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0097a0 tx=0x7fd0fc02b840 comp rx=0 tx=0).stop 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 -- 172.21.15.80:0/3996424545 shutdown_connections 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 --2- 172.21.15.80:0/3996424545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd1140cf780 0x7fd114163350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 --2- 172.21.15.80:0/3996424545 >> v2:172.21.15.87:3300/0 conn(0x7fd11415ef80 0x7fd11415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 -- 172.21.15.80:0/3996424545 >> 172.21.15.80:0/3996424545 conn(0x7fd11406ce20 msgr2=0x7fd11406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 -- 172.21.15.80:0/3996424545 shutdown_connections 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.439+0000 7fd11adba640 1 -- 172.21.15.80:0/3996424545 wait complete. 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.440+0000 7fd11adba640 1 Processor -- start 2024-04-16T15:36:05.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.440+0000 7fd11adba640 1 -- start start 2024-04-16T15:36:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140cf780 0x7fd1141566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd11415ef80 0x7fd1140cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd114162b50 con 0x7fd1140d1450 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd114163890 con 0x7fd1140cf780 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd1140d2ff0 con 0x7fd11415ef80 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34600/0 (socket says 172.21.15.80:34600) 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 -- 172.21.15.80:0/4049295598 learned_addr learned my addr 172.21.15.80:0/4049295598 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd118b56640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140cf780 0x7fd1141566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd119357640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd11415ef80 0x7fd1140cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 -- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd11415ef80 msgr2=0x7fd1140cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd11415ef80 0x7fd1140cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 -- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140cf780 msgr2=0x7fd1141566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140cf780 0x7fd1141566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 -- 172.21.15.80:0/4049295598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1140ce570 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd113fff640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd10400efc0 tx=0x7fd10400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104018020 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd104014680 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104014a70 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.441+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1141f4fa0 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.442+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1141f5560 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.442+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd114068a40 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.443+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd104005d10 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.443+0000 7fd1117fa640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 0x7fd0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.443+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd10408c820 con 0x7fd1140d1450 2024-04-16T15:36:05.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.443+0000 7fd118b56640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 0x7fd0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.444+0000 7fd118b56640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 0x7fd0f406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd114156e10 tx=0x7fd10c000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.448+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd104022070 con 0x7fd1140d1450 2024-04-16T15:36:05.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.670+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd1140d2920 con 0x7fd1140d1450 2024-04-16T15:36:05.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.673+0000 7fd1117fa640 1 -- 172.21.15.80:0/4049295598 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174137 (secure 0 0 0) 0x7fd104010040 con 0x7fd1140d1450 2024-04-16T15:36:05.673 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 msgr2=0x7fd0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 0x7fd0f406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd114156e10 tx=0x7fd10c000bc0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 msgr2=0x7fd114150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd10400efc0 tx=0x7fd10400c490 comp rx=0 tx=0).stop 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 shutdown_connections 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd0f406c8f0 0x7fd0f406edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd11415ef80 0x7fd1140cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd1140d1450 0x7fd114150930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 --2- 172.21.15.80:0/4049295598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1140cf780 0x7fd1141566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 >> 172.21.15.80:0/4049295598 conn(0x7fd11406ce20 msgr2=0x7fd1140b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 shutdown_connections 2024-04-16T15:36:05.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.676+0000 7fd11adba640 1 -- 172.21.15.80:0/4049295598 wait complete. 2024-04-16T15:36:05.685 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":1620343397},{"type":"v1","addr":"172.21.15.80:6833","nonce":1620343397}]},"active_addr":"172.21.15.80:6833/1620343397","active_change":"2024-04-16T15:35:27.150835+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1010182951}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":3000595109}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2519029742}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1650862194}]}]} 2024-04-16T15:36:05.688 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T15:36:05.688 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T15:36:05.688 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:05.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.794+0000 7f8cc2e4a640 1 Processor -- start 2024-04-16T15:36:05.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 -- start start 2024-04-16T15:36:05.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cbc0ce1e0 0x7f8cbc160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc0cd140 con 0x7f8cbc15c810 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc0cd420 con 0x7f8cbc0ce1e0 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.795+0000 7f8cc2e4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc0cd700 con 0x7f8cbc0d11a0 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cc13e7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8cbc0ce1e0 0x7f8cbc160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58258/0 (socket says 172.21.15.80:58258) 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 -- 172.21.15.80:0/3544731473 learned_addr learned my addr 172.21.15.80:0/3544731473 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 -- 172.21.15.80:0/3544731473 >> v2:172.21.15.87:3300/0 conn(0x7f8cbc0ce1e0 msgr2=0x7f8cbc160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 --2- 172.21.15.80:0/3544731473 >> v2:172.21.15.87:3300/0 conn(0x7f8cbc0ce1e0 0x7f8cbc160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 -- 172.21.15.80:0/3544731473 >> v1:172.21.15.87:6789/0 conn(0x7f8cbc15c810 legacy=0x7f8cbc0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.796+0000 7f8cbbfff640 1 -- 172.21.15.80:0/3544731473 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc0cd9e0 con 0x7f8cbc0d11a0 2024-04-16T15:36:05.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.797+0000 7f8cbbfff640 1 --2- 172.21.15.80:0/3544731473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e50 tx=0x7f8ca402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e24626154dec271 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.797+0000 7f8cbb7fe640 1 -- 172.21.15.80:0/3544731473 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca402cb00 con 0x7f8cbc0d11a0 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.797+0000 7f8cbb7fe640 1 -- 172.21.15.80:0/3544731473 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca402cca0 con 0x7f8cbc0d11a0 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.797+0000 7f8cbb7fe640 1 -- 172.21.15.80:0/3544731473 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4034610 con 0x7f8cbc0d11a0 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/3544731473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 msgr2=0x7f8cbc1603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/3544731473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e50 tx=0x7f8ca402bf60 comp rx=0 tx=0).stop 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/3544731473 shutdown_connections 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/3544731473 >> v2:172.21.15.87:3300/0 conn(0x7f8cbc0ce1e0 0x7f8cbc160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/3544731473 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0d11a0 0x7f8cbc1603e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/3544731473 >> 172.21.15.80:0/3544731473 conn(0x7f8cbc0d2500 msgr2=0x7f8cbc0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/3544731473 shutdown_connections 2024-04-16T15:36:05.797 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.798+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/3544731473 wait complete. 2024-04-16T15:36:05.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.799+0000 7f8cc2e4a640 1 Processor -- start 2024-04-16T15:36:05.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.799+0000 7f8cc2e4a640 1 -- start start 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cbc0ce1e0 0x7f8cbc1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 0x7f8cbc0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc15cbf0 con 0x7f8cbc15c810 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1611a0 con 0x7f8cbc0ce1e0 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc0b1ea0 con 0x7f8cbc0c9b10 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34614/0 (socket says 172.21.15.80:34614) 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 -- 172.21.15.80:0/895414556 learned_addr learned my addr 172.21.15.80:0/895414556 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc0be6640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cbc0ce1e0 0x7f8cbc1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc13e7640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 0x7f8cbc0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 -- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 msgr2=0x7f8cbc0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 0x7f8cbc0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 -- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cbc0ce1e0 msgr2=0x7f8cbc1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cbc0ce1e0 0x7f8cbc1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 -- 172.21.15.80:0/895414556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc0c7c20 con 0x7f8cbc15c810 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc13e7640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 0x7f8cbc0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cbbfff640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009f70 tx=0x7f8ca4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4043020 con 0x7f8cbc15c810 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca402ce50 con 0x7f8cbc15c810 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.800+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc0c7f00 con 0x7f8cbc15c810 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.801+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4009510 con 0x7f8cbc15c810 2024-04-16T15:36:05.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.801+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc0c84c0 con 0x7f8cbc15c810 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.802+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc069150 con 0x7f8cbc15c810 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.802+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ca4046020 con 0x7f8cbc15c810 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.802+0000 7f8cb97fa640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 0x7f8c9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.803+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ca40ae440 con 0x7f8cbc15c810 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.803+0000 7f8cc0be6640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 0x7f8c9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:05.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.803+0000 7f8cc0be6640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 0x7f8c9c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cac007fd0 tx=0x7f8cac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:05.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.807+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ca404d030 con 0x7f8cbc15c810 2024-04-16T15:36:05.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.982+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cbc0c9ef0 con 0x7f8cbc15c810 2024-04-16T15:36:05.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.983+0000 7f8cb97fa640 1 -- 172.21.15.80:0/895414556 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f8ca403c350 con 0x7f8cbc15c810 2024-04-16T15:36:05.981 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:05.982 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:05.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 msgr2=0x7f8c9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.983 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 0x7f8c9c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cac007fd0 tx=0x7f8cac009040 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 msgr2=0x7f8cbc0c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009f70 tx=0x7f8ca4004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 shutdown_connections 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8c9c06c8f0 0x7f8c9c06edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8cbc0c9b10 0x7f8cbc0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8cbc15c810 0x7f8cbc0c95d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 --2- 172.21.15.80:0/895414556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8cbc0ce1e0 0x7f8cbc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 >> 172.21.15.80:0/895414556 conn(0x7f8cbc0d2500 msgr2=0x7f8cbc0717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 shutdown_connections 2024-04-16T15:36:05.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:05.985+0000 7f8cc2e4a640 1 -- 172.21.15.80:0/895414556 wait complete. 2024-04-16T15:36:05.994 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T15:36:05.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:06.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.100+0000 7f0c44732640 1 Processor -- start 2024-04-16T15:36:06.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.100+0000 7f0c44732640 1 -- start start 2024-04-16T15:36:06.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c44732640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c3c15e780 0x7f0c3c0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c44732640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0c3c0d26d0 0x7f0c3c0b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c44732640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c3c0b7ce0 con 0x7f0c3c0cf360 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c44732640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3c0b7fc0 con 0x7f0c3c15e780 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c44732640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3c0b82a0 con 0x7f0c3c0d26d0 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c3c15e780 0x7f0c3c0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c3c15e780 0x7f0c3c0b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34622/0 (socket says 172.21.15.80:34622) 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 -- 172.21.15.80:0/1736211094 learned_addr learned my addr 172.21.15.80:0/1736211094 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 -- 172.21.15.80:0/1736211094 >> v2:172.21.15.87:3300/0 conn(0x7f0c3c0d26d0 msgr2=0x7f0c3c0b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1736211094 >> v2:172.21.15.87:3300/0 conn(0x7f0c3c0d26d0 0x7f0c3c0b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 -- 172.21.15.80:0/1736211094 >> v1:172.21.15.87:6789/0 conn(0x7f0c3c0cf360 legacy=0x7f0c3c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.101+0000 7f0c424ce640 1 -- 172.21.15.80:0/1736211094 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c0b8580 con 0x7f0c3c15e780 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1736211094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c0b7700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0d2460 tx=0x7f0c3802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4adde58f30d3b5f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c414cc640 1 -- 172.21.15.80:0/1736211094 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3802cb20 con 0x7f0c3c15e780 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c414cc640 1 -- 172.21.15.80:0/1736211094 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3802ccc0 con 0x7f0c3c15e780 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c414cc640 1 -- 172.21.15.80:0/1736211094 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38034610 con 0x7f0c3c15e780 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c44732640 1 -- 172.21.15.80:0/1736211094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 msgr2=0x7f0c3c0b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.102+0000 7f0c44732640 1 --2- 172.21.15.80:0/1736211094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c0b7700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0d2460 tx=0x7f0c3802bf80 comp rx=0 tx=0).stop 2024-04-16T15:36:06.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 -- 172.21.15.80:0/1736211094 shutdown_connections 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 --2- 172.21.15.80:0/1736211094 >> v2:172.21.15.87:3300/0 conn(0x7f0c3c0d26d0 0x7f0c3c0b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 --2- 172.21.15.80:0/1736211094 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c0b7700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 -- 172.21.15.80:0/1736211094 >> 172.21.15.80:0/1736211094 conn(0x7f0c3c0734f0 msgr2=0x7f0c3c073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 -- 172.21.15.80:0/1736211094 shutdown_connections 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.103+0000 7f0c44732640 1 -- 172.21.15.80:0/1736211094 wait complete. 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 Processor -- start 2024-04-16T15:36:06.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 -- start start 2024-04-16T15:36:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 0x7f0c3c1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c3c0d26d0 0x7f0c3c0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c0ba4a0 con 0x7f0c3c15e780 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.104+0000 7f0c44732640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c15eb60 con 0x7f0c3c0cf360 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c44732640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3c0ba620 con 0x7f0c3c0d26d0 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34636/0 (socket says 172.21.15.80:34636) 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 -- 172.21.15.80:0/1602841619 learned_addr learned my addr 172.21.15.80:0/1602841619 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 0x7f0c3c1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c41ccd640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c3c0d26d0 0x7f0c3c0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 -- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c3c0d26d0 msgr2=0x7f0c3c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c3c0d26d0 0x7f0c3c0cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 -- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 msgr2=0x7f0c3c1f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 0x7f0c3c1f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 -- 172.21.15.80:0/1602841619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c1f8760 con 0x7f0c3c15e780 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 0x7f0c3c1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:06.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c42ccf640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c3c0 tx=0x7f0c3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34017070 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c340035f0 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340039e0 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c0d3f90 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.105+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c0d4830 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.106+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c068a40 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.107+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c34003b80 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.107+0000 7f0c32ffd640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 0x7f0c2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.107+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c3408b210 con 0x7f0c3c15e780 2024-04-16T15:36:06.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.107+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 0x7f0c2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.108+0000 7f0c424ce640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 0x7f0c2006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c38035000 tx=0x7f0c38030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.111+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c3c1f8760 con 0x7f0c3c15e780 2024-04-16T15:36:06.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.289+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c3c06d5c0 con 0x7f0c3c15e780 2024-04-16T15:36:06.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.291+0000 7f0c32ffd640 1 -- 172.21.15.80:0/1602841619 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f0c34059280 con 0x7f0c3c15e780 2024-04-16T15:36:06.289 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:06.289 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:06.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 msgr2=0x7f0c2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 0x7f0c2006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c38035000 tx=0x7f0c38030000 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 msgr2=0x7f0c3c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c3c0 tx=0x7f0c3400c880 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 shutdown_connections 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c3c15e780 0x7f0c3c14d590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c2006c8f0 0x7f0c2006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c3c0d26d0 0x7f0c3c0cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 --2- 172.21.15.80:0/1602841619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c3c0cf360 0x7f0c3c1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 >> 172.21.15.80:0/1602841619 conn(0x7f0c3c0734f0 msgr2=0x7f0c3c15d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 shutdown_connections 2024-04-16T15:36:06.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.293+0000 7f0c44732640 1 -- 172.21.15.80:0/1602841619 wait complete. 2024-04-16T15:36:06.303 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T15:36:06.303 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T15:36:06.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T15:36:06.304 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T15:36:06.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T15:36:06.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T15:36:06.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T15:36:06.306 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T15:36:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.490+0000 7feff044a640 1 Processor -- start 2024-04-16T15:36:06.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.490+0000 7feff044a640 1 -- start start 2024-04-16T15:36:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.491+0000 7f506359e640 1 Processor -- start 2024-04-16T15:36:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.491+0000 7f506359e640 1 -- start start 2024-04-16T15:36:06.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.492+0000 7f39f9aeb640 1 Processor -- start 2024-04-16T15:36:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.492+0000 7f39f9aeb640 1 -- start start 2024-04-16T15:36:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.492+0000 7f34e353f640 1 Processor -- start 2024-04-16T15:36:06.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f39f9aeb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40aeb70 0x7f39f40c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f506359e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f505c0e44f0 0x7f505c038190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f506359e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c033fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f506359e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c007630 con 0x7f505c0344e0 2024-04-16T15:36:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f506359e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f505c0386d0 con 0x7f505c0e44f0 2024-04-16T15:36:06.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f506359e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f505c054f20 con 0x7f505c007e30 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f39f9aeb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39f40c3600 0x7f39f40cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f39f9aeb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f4162ff0 con 0x7f39f40cf4b0 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f39f9aeb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f39f40afa70 con 0x7f39f40c3600 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f39f9aeb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f39f40c3a60 con 0x7f39f40aeb70 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39f40c3600 0x7f39f40cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39f40c3600 0x7f39f40cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39362/0 (socket says 172.21.15.80:39362) 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 -- 172.21.15.80:0/1038974146 learned_addr learned my addr 172.21.15.80:0/1038974146 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f37fe640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40aeb70 0x7f39f40c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f34e353f640 1 -- start start 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f5062d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f505c0344e0 0x7f505c0e4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33880/0 (socket says 172.21.15.80:33880) 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f5062d9d640 1 -- 172.21.15.80:0/4275637678 learned_addr learned my addr 172.21.15.80:0/4275637678 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.493+0000 7f5061d9b640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c033fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f506259c640 1 --2- 172.21.15.80:0/4275637678 >> v2:172.21.15.80:3300/0 conn(0x7f505c0e44f0 0x7f505c038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f506259c640 1 -- 172.21.15.80:0/4275637678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 msgr2=0x7f505c033fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f506259c640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c033fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f506259c640 1 -- 172.21.15.80:0/4275637678 >> v1:172.21.15.80:6789/0 conn(0x7f505c0344e0 legacy=0x7f505c0e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f506259c640 1 -- 172.21.15.80:0/4275637678 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0e48d0 con 0x7f505c0e44f0 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f34e353f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34dc163e60 0x7f34dc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f34e353f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc1633e0 con 0x7f34dc0723f0 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f34e353f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34dc1673e0 con 0x7f34dc0cff30 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f34e353f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f34dc072860 con 0x7f34dc163e60 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7f34e12db640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f34dc0cff30 0x7f34dc166990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44462/0 (socket says 172.21.15.80:44462) 2024-04-16T15:36:06.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7f34e12db640 1 -- 172.21.15.80:0/3969176182 learned_addr learned my addr 172.21.15.80:0/3969176182 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 -- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40aeb70 msgr2=0x7f39f40c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40aeb70 0x7f39f40c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 -- 172.21.15.80:0/1038974146 >> v1:172.21.15.80:6789/0 conn(0x7f39f40cf4b0 legacy=0x7f39f40cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.494+0000 7f39f2ffd640 1 -- 172.21.15.80:0/1038974146 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40cf940 con 0x7f39f40c3600 2024-04-16T15:36:06.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7f39f2ffd640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 0x7f39f40cef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009870 tx=0x7f39e402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8959a09e915761 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7f34e0ada640 1 --2- 172.21.15.80:0/3969176182 >> v2:172.21.15.87:3300/0 conn(0x7f34dc163e60 0x7f34dc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331745524 0 0) 0x7f34dc1673e0 con 0x7f34dc0cff30 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c8003520 con 0x7f34dc0cff30 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 817962067 0 0) 0x7f34c8003520 con 0x7f34dc0cff30 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 >> v2:172.21.15.87:3300/0 conn(0x7f34dc163e60 msgr2=0x7f34dc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 --2- 172.21.15.80:0/3969176182 >> v2:172.21.15.87:3300/0 conn(0x7f34dc163e60 0x7f34dc071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 >> v1:172.21.15.80:6789/0 conn(0x7f34dc0723f0 legacy=0x7f34dc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc1676c0 con 0x7f34dc0cff30 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f34d40019f0 con 0x7f34dc0cff30 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 >> v1:172.21.15.87:6789/0 conn(0x7f34dc0cff30 legacy=0x7f34dc166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c8003a00 0x7f34c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c8004800 0x7f34c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c8005290 0x7f34c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc072860 con 0x7f34c8003a00 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34c800c1e0 con 0x7f34c8004800 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34c800c3e0 con 0x7f34c8005290 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f39f27fc640 1 -- 172.21.15.80:0/1038974146 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4035020 con 0x7f39f40c3600 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f39f27fc640 1 -- 172.21.15.80:0/1038974146 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4031870 con 0x7f39f40c3600 2024-04-16T15:36:06.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7f39f27fc640 1 -- 172.21.15.80:0/1038974146 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4031c80 con 0x7f39f40c3600 2024-04-16T15:36:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7feff044a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fefe0033d70 0x7fefe0006f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7feff044a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fefe0050040 0x7fefe0037c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7feff044a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe00536b0 con 0x7fefe00074d0 2024-04-16T15:36:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c8003a00 0x7f34c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7feff044a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fefe0053990 con 0x7fefe0033d70 2024-04-16T15:36:06.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f506259c640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c038190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50580097a0 tx=0x7f505802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db0fe88e76a712e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7feff044a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fefe0053c70 con 0x7fefe0050040 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefed9e5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fefe00074d0 0x7fefe004f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44478/0 (socket says 172.21.15.80:44478) 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefed9e5640 1 -- 172.21.15.80:0/1537130115 learned_addr learned my addr 172.21.15.80:0/1537130115 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefee9e7640 1 --2- 172.21.15.80:0/1537130115 >> v2:172.21.15.87:3300/0 conn(0x7fefe0050040 0x7fefe0037c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefee9e7640 1 -- 172.21.15.80:0/1537130115 >> v2:172.21.15.80:3300/0 conn(0x7fefe0033d70 msgr2=0x7fefe0006f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefee9e7640 1 --2- 172.21.15.80:0/1537130115 >> v2:172.21.15.80:3300/0 conn(0x7fefe0033d70 0x7fefe0006f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefee9e7640 1 -- 172.21.15.80:0/1537130115 >> v1:172.21.15.87:6789/0 conn(0x7fefe00074d0 legacy=0x7fefe004f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.495+0000 7fefee9e7640 1 -- 172.21.15.80:0/1537130115 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe0053f50 con 0x7fefe0050040 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f506159a640 1 -- 172.21.15.80:0/4275637678 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580317c0 con 0x7f505c0e44f0 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f506159a640 1 -- 172.21.15.80:0/4275637678 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058037070 con 0x7f505c0e44f0 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f506159a640 1 -- 172.21.15.80:0/4275637678 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058031bc0 con 0x7f505c0e44f0 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 -- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c8005290 msgr2=0x7f34c800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c8005290 0x7f34c800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 -- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c8004800 msgr2=0x7f34c8004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c8004800 0x7f34c8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.497+0000 7f34e12db640 1 -- 172.21.15.80:0/3969176182 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c8003520 con 0x7f34c8003a00 2024-04-16T15:36:06.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.498+0000 7f506359e640 1 -- 172.21.15.80:0/4275637678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 msgr2=0x7f505c038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.498+0000 7f506359e640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c038190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50580097a0 tx=0x7f505802b860 comp rx=0 tx=0).stop 2024-04-16T15:36:06.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.496+0000 7fefee9e7640 1 --2- 172.21.15.80:0/1537130115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe0050040 0x7fefe0037c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefe806b4a0 tx=0x7fefe80b82c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406ee73b6064dab server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.498+0000 7f34e12db640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c8003a00 0x7f34c8003e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34d400a7d0 tx=0x7f34c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec08547bfda7a417 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.498+0000 7f506359e640 1 -- 172.21.15.80:0/4275637678 shutdown_connections 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f506359e640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c033fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f506359e640 1 --2- 172.21.15.80:0/4275637678 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c038190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f506359e640 1 -- 172.21.15.80:0/4275637678 >> 172.21.15.80:0/4275637678 conn(0x7f505c055340 msgr2=0x7f505c055750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d400a3f0 con 0x7f34c8003a00 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4034630 con 0x7f34c8003a00 2024-04-16T15:36:06.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7f34d3fff640 1 -- 172.21.15.80:0/3969176182 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4034aa0 con 0x7f34c8003a00 2024-04-16T15:36:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7fefed1e4640 1 -- 172.21.15.80:0/1537130115 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe80c5070 con 0x7fefe0050040 2024-04-16T15:36:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.499+0000 7fefed1e4640 1 -- 172.21.15.80:0/1537130115 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe80c0640 con 0x7fefe0050040 2024-04-16T15:36:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7f34e353f640 1 -- 172.21.15.80:0/3969176182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c8003a00 msgr2=0x7f34c8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7f34e353f640 1 --2- 172.21.15.80:0/3969176182 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c8003a00 0x7f34c8003e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34d400a7d0 tx=0x7f34c8005830 comp rx=0 tx=0).stop 2024-04-16T15:36:06.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7f506359e640 1 -- 172.21.15.80:0/4275637678 shutdown_connections 2024-04-16T15:36:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 -- 172.21.15.80:0/1537130115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe0050040 msgr2=0x7fefe0037c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7fefed1e4640 1 -- 172.21.15.80:0/1537130115 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe80c0a70 con 0x7fefe0050040 2024-04-16T15:36:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 --2- 172.21.15.80:0/1537130115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe0050040 0x7fefe0037c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefe806b4a0 tx=0x7fefe80b82c0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7f506359e640 1 -- 172.21.15.80:0/4275637678 wait complete. 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 -- 172.21.15.80:0/1537130115 shutdown_connections 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 --2- 172.21.15.80:0/1537130115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe0050040 0x7fefe0037c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 --2- 172.21.15.80:0/1537130115 >> v2:172.21.15.80:3300/0 conn(0x7fefe0033d70 0x7fefe0006f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 -- 172.21.15.80:0/1537130115 >> 172.21.15.80:0/1537130115 conn(0x7fefe0009fe0 msgr2=0x7fefe000a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 -- 172.21.15.80:0/1537130115 shutdown_connections 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.500+0000 7feff044a640 1 -- 172.21.15.80:0/1537130115 wait complete. 2024-04-16T15:36:06.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.501+0000 7f34e1adc640 1 -- 172.21.15.80:0/3969176182 reap_dead start 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.501+0000 7f34e353f640 1 -- 172.21.15.80:0/3969176182 shutdown_connections 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.501+0000 7f34e353f640 1 -- 172.21.15.80:0/3969176182 >> 172.21.15.80:0/3969176182 conn(0x7f34dc0b2940 msgr2=0x7f34dc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7f506359e640 1 Processor -- start 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7f506359e640 1 -- start start 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7f34e353f640 1 -- 172.21.15.80:0/3969176182 shutdown_connections 2024-04-16T15:36:06.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7feff044a640 1 Processor -- start 2024-04-16T15:36:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7feff044a640 1 -- start start 2024-04-16T15:36:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.502+0000 7f34e353f640 1 -- 172.21.15.80:0/3969176182 wait complete. 2024-04-16T15:36:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.503+0000 7feff044a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 0x7fefe0048700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.503+0000 7f34e353f640 1 Processor -- start 2024-04-16T15:36:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.503+0000 7f506359e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.503+0000 7f506359e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c0344e0 0x7f505c0d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.503+0000 7f34e353f640 1 -- start start 2024-04-16T15:36:06.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7feff044a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe0033d70 0x7fefe004e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f506359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c054070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7fefee1e6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 0x7fefe0048700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7fefee1e6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 0x7fefe0048700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58310/0 (socket says 172.21.15.80:58310) 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7fefee1e6640 1 -- 172.21.15.80:0/2671921179 learned_addr learned my addr 172.21.15.80:0/2671921179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7fefed9e5640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe0033d70 0x7fefe004e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7feff044a640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00dcb30 0x7fefe00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 -- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 msgr2=0x7f39f40cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 0x7f39f40cef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009870 tx=0x7f39e402b910 comp rx=0 tx=0).stop 2024-04-16T15:36:06.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0034150 con 0x7fefe0033d70 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f5062d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c054070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f5062d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c054070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34710/0 (socket says 172.21.15.80:34710) 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f5062d9d640 1 -- 172.21.15.80:0/4214984673 learned_addr learned my addr 172.21.15.80:0/4214984673 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f5061d9b640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c0344e0 0x7f505c0d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f506359e640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f505c03b000 con 0x7f505c0e44f0 2024-04-16T15:36:06.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f506359e640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f505c03ad20 con 0x7f505c0344e0 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 -- 172.21.15.80:0/1038974146 shutdown_connections 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 0x7f39f40cef70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/1038974146 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40aeb70 0x7f39f40c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f39f9aeb640 1 -- 172.21.15.80:0/1038974146 >> 172.21.15.80:0/1038974146 conn(0x7f39f40d00f0 msgr2=0x7f39f40d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7fefee9e7640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00dcb30 0x7fefe00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0054510 con 0x7fefe00dcb30 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fefe0038190 con 0x7fefe00074d0 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f506359e640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f505c038950 con 0x7f505c007e30 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34dc0ac010 0x7f34dc15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34dc0ac3f0 0x7f34dc150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 0x7f34dc150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc163940 con 0x7f34dc0af130 2024-04-16T15:36:06.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1642c0 con 0x7f34dc0ac3f0 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 -- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00dcb30 msgr2=0x7fefe00387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fefe00dcb30 0x7fefe00387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 -- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe0033d70 msgr2=0x7fefe004e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fefe0033d70 0x7fefe004e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe004d3f0 con 0x7fefe00074d0 2024-04-16T15:36:06.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e353f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34dc1670a0 con 0x7f34dc0ac010 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.504+0000 7f506259c640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e1adc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 0x7f34dc150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e1adc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 0x7f34dc150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34712/0 (socket says 172.21.15.80:34712) 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e1adc640 1 -- 172.21.15.80:0/3922465976 learned_addr learned my addr 172.21.15.80:0/3922465976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f34e12db640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34dc0ac010 0x7f34dc15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7fefee1e6640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 0x7fefe0048700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fefd800b440 tx=0x7fefd800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8015020 con 0x7fefe00074d0 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e0ada640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34dc0ac3f0 0x7f34dc150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e1adc640 1 -- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34dc0ac010 msgr2=0x7f34dc15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e1adc640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34dc0ac010 0x7f34dc15e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e1adc640 1 -- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34dc0ac3f0 msgr2=0x7f34dc150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e1adc640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34dc0ac3f0 0x7f34dc150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f34e1adc640 1 -- 172.21.15.80:0/3922465976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc150cb0 con 0x7f34dc0af130 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f39f9aeb640 1 -- 172.21.15.80:0/1038974146 shutdown_connections 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.505+0000 7f39f9aeb640 1 -- 172.21.15.80:0/1038974146 wait complete. 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f506259c640 1 -- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c0344e0 msgr2=0x7f505c0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f506259c640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505c0344e0 0x7f505c0d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f506259c640 1 -- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 msgr2=0x7f505c054070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f506259c640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f505c0e44f0 0x7f505c054070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7f506259c640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0cfdf0 con 0x7f505c007e30 2024-04-16T15:36:06.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f34e1adc640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 0x7f34dc150770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f34dc070080 tx=0x7f34d800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe004d6d0 con 0x7fefe00074d0 2024-04-16T15:36:06.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.506+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe00e8650 con 0x7fefe00074d0 2024-04-16T15:36:06.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f506259c640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c0cc950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5058033000 tx=0x7f50580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058032650 con 0x7f505c007e30 2024-04-16T15:36:06.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f506359e640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c0cf830 con 0x7f505c007e30 2024-04-16T15:36:06.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8007230 con 0x7f34dc0af130 2024-04-16T15:36:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f506359e640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c04d6f0 con 0x7f505c007e30 2024-04-16T15:36:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.508+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50580327f0 con 0x7f505c007e30 2024-04-16T15:36:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f34e353f640 1 -- 172.21.15.80:0/3922465976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc15e8e0 con 0x7f34dc0af130 2024-04-16T15:36:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.508+0000 7f34e353f640 1 -- 172.21.15.80:0/3922465976 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc15ee90 con 0x7f34dc0af130 2024-04-16T15:36:06.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058032650 con 0x7f505c007e30 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5048001030 con 0x7f505c007e30 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f39f9aeb640 1 Processor -- start 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.507+0000 7f39f9aeb640 1 -- start start 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 0x7f39f40c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 0x7f39f40c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 0x7f39f40c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34718/0 (socket says 172.21.15.80:34718) 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f37fe640 1 -- 172.21.15.80:0/3928668542 learned_addr learned my addr 172.21.15.80:0/3928668542 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 0x7f39f4161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40cf4b0 0x7f39f40c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406ddc0 con 0x7f39f40aeb70 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406dae0 con 0x7f39f40c3600 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.509+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f39f406e0a0 con 0x7f39f40cf4b0 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f39f37fe640 1 -- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40cf4b0 msgr2=0x7f39f40c94c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f39f37fe640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39f40cf4b0 0x7f39f40c94c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f39f37fe640 1 -- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 msgr2=0x7f39f4161460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f39f37fe640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39f40c3600 0x7f39f4161460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f39f37fe640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f4163f20 con 0x7f39f40aeb70 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefe00052f0 con 0x7fefe00074d0 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd8011890 con 0x7fefe00074d0 2024-04-16T15:36:06.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8011c80 con 0x7fefe00074d0 2024-04-16T15:36:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d80073d0 con 0x7f34dc0af130 2024-04-16T15:36:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.510+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8004790 con 0x7f34dc0af130 2024-04-16T15:36:06.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.511+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefd8018020 con 0x7fefe00074d0 2024-04-16T15:36:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.512+0000 7f3e59cd9640 1 Processor -- start 2024-04-16T15:36:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.512+0000 7f3e59cd9640 1 -- start start 2024-04-16T15:36:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.512+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34d8004930 con 0x7f34dc0af130 2024-04-16T15:36:06.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7f34d1ffb640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34c006c9f0 0x7f34c006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7f3e59cd9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0e0050 0x7f3e4c00b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7f3e537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0e0050 0x7f3e4c00b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f34d808b4a0 con 0x7f34dc0af130 2024-04-16T15:36:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e537fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e4c0e0050 0x7f3e4c00b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34734/0 (socket says 172.21.15.80:34734) 2024-04-16T15:36:06.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e537fe640 1 -- 172.21.15.80:0/1716138040 learned_addr learned my addr 172.21.15.80:0/1716138040 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f34e12db640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34c006c9f0 0x7f34c006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/1716138040 >> v2:172.21.15.87:3300/0 conn(0x7f3e4c03b000 0x7f3e4c007c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50580329a0 con 0x7f505c007e30 2024-04-16T15:36:06.529 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f5052ffd640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f504406ccf0 0x7f504406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4c00cb60 con 0x7f3e4c008f80 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c00b740 con 0x7f3e4c0e0050 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c056600 con 0x7f3e4c03b000 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f5061d9b640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f504406ccf0 0x7f504406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5058032450 con 0x7f505c007e30 2024-04-16T15:36:06.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f34e353f640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f34dc15f090 0x7f34dc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f3e537fe640 1 -- 172.21.15.80:0/1716138040 >> v2:172.21.15.87:3300/0 conn(0x7f3e4c03b000 msgr2=0x7f3e4c007c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T15:36:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f3e537fe640 1 --2- 172.21.15.80:0/1716138040 >> v2:172.21.15.87:3300/0 conn(0x7f3e4c03b000 0x7f3e4c007c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7fefdeffd640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fefcc06c9c0 0x7fefcc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.513+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fefd808be20 con 0x7fefe00074d0 2024-04-16T15:36:06.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f3e537fe640 1 -- 172.21.15.80:0/1716138040 >> v1:172.21.15.80:6789/0 conn(0x7f3e4c008f80 legacy=0x7f3e4c03a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7fefed9e5640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fefcc06c9c0 0x7fefcc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7fefdeffd640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7fefcc076140 0x7fefcc078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefd800de50 con 0x7fefcc076140 2024-04-16T15:36:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fefd808e480 con 0x7fefe00074d0 2024-04-16T15:36:06.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f3e537fe640 1 -- 172.21.15.80:0/1716138040 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c0568e0 con 0x7f3e4c0e0050 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f5052ffd640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5044076fb0 0x7f5044079450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5044079b20 con 0x7f5044076fb0 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50580778d0 con 0x7f505c007e30 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f5062d9d640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5044076fb0 0x7f5044079450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.514+0000 7f39f37fe640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 0x7f39f40c7bd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00efa0 tx=0x7f39ec00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec018020 con 0x7f39f40aeb70 2024-04-16T15:36:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f4164200 con 0x7f39f40aeb70 2024-04-16T15:36:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f41647c0 con 0x7f39f40aeb70 2024-04-16T15:36:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.516+0000 7f3e537fe640 1 --2- 172.21.15.80:0/1716138040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c00b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c01f650 tx=0x7f3e4802bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba6b7266ded687c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7fefee9e7640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7fefcc076140 0x7fefcc078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.516+0000 7f5062d9d640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5044076fb0 0x7f5044079450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.516+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec014480 con 0x7f39f40aeb70 2024-04-16T15:36:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.517+0000 7f5061d9b640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f504406ccf0 0x7f504406f1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f505c050db0 tx=0x7f5054009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.517+0000 7fefed9e5640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fefcc06c9c0 0x7fefcc06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefe004b610 tx=0x7fefe4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.517+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== osd.0 v2:172.21.15.80:6824/802352542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5044079b20 con 0x7f5044076fb0 2024-04-16T15:36:06.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7fefee9e7640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7fefcc076140 0x7fefcc078580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.515+0000 7f34e353f640 1 -- 172.21.15.80:0/3922465976 --> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34dc166440 con 0x7f34dc15f090 2024-04-16T15:36:06.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.516+0000 7f34e0ada640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f34dc15f090 0x7f34dc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec014850 con 0x7f39f40aeb70 2024-04-16T15:36:06.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f39d9ffb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39d4001030 con 0x7f39f40aeb70 2024-04-16T15:36:06.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f34e0ada640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f34dc15f090 0x7f34dc15f470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f34e12db640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34c006c9f0 0x7f34c006eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f34d4034000 tx=0x7f34d402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.519+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39ec005d10 con 0x7f39f40aeb70 2024-04-16T15:36:06.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.519+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== osd.7 v2:172.21.15.87:6816/4163376620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fefd800de50 con 0x7fefcc076140 2024-04-16T15:36:06.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f3e527fc640 1 -- 172.21.15.80:0/1716138040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48039070 con 0x7f3e4c0e0050 2024-04-16T15:36:06.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f3e527fc640 1 -- 172.21.15.80:0/1716138040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4802c730 con 0x7f3e4c0e0050 2024-04-16T15:36:06.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.518+0000 7f3e527fc640 1 -- 172.21.15.80:0/1716138040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4802cae0 con 0x7f3e4c0e0050 2024-04-16T15:36:06.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.520+0000 7f39dbfff640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39e006c9c0 0x7f39e006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.519+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== osd.1 v2:172.21.15.80:6800/1467041108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34dc166440 con 0x7f34dc15f090 2024-04-16T15:36:06.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.520+0000 7fae0779d640 1 Processor -- start 2024-04-16T15:36:06.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.520+0000 7f39f2ffd640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39e006c9c0 0x7f39e006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.520+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f39ec08ca00 con 0x7f39f40aeb70 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.520+0000 7fae0779d640 1 -- start start 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7fae0779d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae0006cd90 0x7fae000b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7fae0779d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae000b5060 0x7fae000ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7fae05539640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fae0006c9b0 0x7fae0006fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33930/0 (socket says 172.21.15.80:33930) 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.521+0000 7fd453fff640 1 Processor -- start 2024-04-16T15:36:06.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7fd453fff640 1 -- start start 2024-04-16T15:36:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.521+0000 7f39f2ffd640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39e006c9c0 0x7f39e006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39e4036000 tx=0x7f39e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7f39dbfff640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7f39e0076140 0x7f39e0078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39ec00be50 con 0x7f39e0076140 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f39ec0912a0 con 0x7f39f40aeb70 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.522+0000 7f39f3fff640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7f39e0076140 0x7f39e0078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7f39f3fff640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7f39e0076140 0x7f39e0078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae04d38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae0006cd90 0x7fae000b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae0779d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0006f0e0 con 0x7fae0006c9b0 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae0779d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fae000b5590 con 0x7fae000b5060 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae0779d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fae0006f3c0 con 0x7fae0006cd90 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae05d3a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae000b5060 0x7fae000ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae05d3a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fae000b5060 0x7fae000ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34744/0 (socket says 172.21.15.80:34744) 2024-04-16T15:36:06.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fae05d3a640 1 -- 172.21.15.80:0/2931700333 learned_addr learned my addr 172.21.15.80:0/2931700333 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd453fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4540d0da0 0x7fd45406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd453fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd45416eed0 0x7fd45416f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd453fff640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4540b3b70 con 0x7fd4540991d0 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd453fff640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540b3e50 con 0x7fd4540d0da0 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd453fff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540ad170 con 0x7fd45416eed0 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd4537fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd4540991d0 0x7fd454099640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33940/0 (socket says 172.21.15.80:33940) 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd4537fe640 1 -- 172.21.15.80:0/2147267034 learned_addr learned my addr 172.21.15.80:0/2147267034 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0e0050 msgr2=0x7f3e4c00b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/1716138040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c00b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c01f650 tx=0x7f3e4802bb90 comp rx=0 tx=0).stop 2024-04-16T15:36:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.523+0000 7fd4527fc640 1 --2- 172.21.15.80:0/2147267034 >> v2:172.21.15.87:3300/0 conn(0x7fd45416eed0 0x7fd45416f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fd452ffd640 1 --2- 172.21.15.80:0/2147267034 >> v2:172.21.15.80:3300/0 conn(0x7fd4540d0da0 0x7fd45406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fd4527fc640 1 -- 172.21.15.80:0/2147267034 >> v2:172.21.15.80:3300/0 conn(0x7fd4540d0da0 msgr2=0x7fd45406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fd4527fc640 1 --2- 172.21.15.80:0/2147267034 >> v2:172.21.15.80:3300/0 conn(0x7fd4540d0da0 0x7fd45406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fd4527fc640 1 -- 172.21.15.80:0/2147267034 >> v1:172.21.15.80:6789/0 conn(0x7fd4540991d0 legacy=0x7fd454099640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fd4527fc640 1 -- 172.21.15.80:0/2147267034 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540ad450 con 0x7fd45416eed0 2024-04-16T15:36:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== osd.3 v2:172.21.15.80:6811/1569227451 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39ec00be50 con 0x7f39e0076140 2024-04-16T15:36:06.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fae05d3a640 1 -- 172.21.15.80:0/2931700333 >> v2:172.21.15.87:3300/0 conn(0x7fae0006cd90 msgr2=0x7fae000b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.525+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 shutdown_connections 2024-04-16T15:36:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.525+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/1716138040 >> v2:172.21.15.87:3300/0 conn(0x7f3e4c03b000 0x7f3e4c007c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.525+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/1716138040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c00b200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.525+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 >> 172.21.15.80:0/1716138040 conn(0x7f3e4c01efa0 msgr2=0x7f3e4c055c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fae05d3a640 1 --2- 172.21.15.80:0/2931700333 >> v2:172.21.15.87:3300/0 conn(0x7fae0006cd90 0x7fae000b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fae05d3a640 1 -- 172.21.15.80:0/2931700333 >> v1:172.21.15.80:6789/0 conn(0x7fae0006c9b0 legacy=0x7fae0006fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.524+0000 7fae05d3a640 1 -- 172.21.15.80:0/2931700333 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0006f6a0 con 0x7fae000b5060 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.525+0000 7fd4527fc640 1 --2- 172.21.15.80:0/2147267034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45416eed0 0x7fd45416f350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4540b5230 tx=0x7fd44802dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf11e549038406fe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.526+0000 7fd451ffb640 1 -- 172.21.15.80:0/2147267034 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44803b070 con 0x7fd45416eed0 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.526+0000 7fd451ffb640 1 -- 172.21.15.80:0/2147267034 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44802ea40 con 0x7fd45416eed0 2024-04-16T15:36:06.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.526+0000 7fd451ffb640 1 -- 172.21.15.80:0/2147267034 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44802ee10 con 0x7fd45416eed0 2024-04-16T15:36:06.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.526+0000 7fae05d3a640 1 --2- 172.21.15.80:0/2931700333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae000b5060 0x7fae000ae4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae0006d700 tx=0x7fadf802d0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e061a06cd168211 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.526+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 shutdown_connections 2024-04-16T15:36:06.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7f3e59cd9640 1 -- 172.21.15.80:0/1716138040 wait complete. 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 -- 172.21.15.80:0/2147267034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45416eed0 msgr2=0x7fd45416f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 --2- 172.21.15.80:0/2147267034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45416eed0 0x7fd45416f350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4540b5230 tx=0x7fd44802dc90 comp rx=0 tx=0).stop 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 -- 172.21.15.80:0/2147267034 shutdown_connections 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 --2- 172.21.15.80:0/2147267034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd45416eed0 0x7fd45416f350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 --2- 172.21.15.80:0/2147267034 >> v2:172.21.15.80:3300/0 conn(0x7fd4540d0da0 0x7fd45406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.527+0000 7fd453fff640 1 -- 172.21.15.80:0/2147267034 >> 172.21.15.80:0/2147267034 conn(0x7fd4540b5d80 msgr2=0x7fd454072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.528+0000 7fadf7fff640 1 -- 172.21.15.80:0/2931700333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf802da60 con 0x7fae000b5060 2024-04-16T15:36:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.528+0000 7fadf7fff640 1 -- 172.21.15.80:0/2931700333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf802dc00 con 0x7fae000b5060 2024-04-16T15:36:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.528+0000 7fadf7fff640 1 -- 172.21.15.80:0/2931700333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8008500 con 0x7fae000b5060 2024-04-16T15:36:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.528+0000 7fd453fff640 1 -- 172.21.15.80:0/2147267034 shutdown_connections 2024-04-16T15:36:06.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.528+0000 7fd453fff640 1 -- 172.21.15.80:0/2147267034 wait complete. 2024-04-16T15:36:06.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.529+0000 7f3e59cd9640 1 Processor -- start 2024-04-16T15:36:06.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.529+0000 7f3e59cd9640 1 -- start start 2024-04-16T15:36:06.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.529+0000 7fae0779d640 1 -- 172.21.15.80:0/2931700333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae000b5060 msgr2=0x7fae000ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.530+0000 7fae0779d640 1 --2- 172.21.15.80:0/2931700333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae000b5060 0x7fae000ae4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae0006d700 tx=0x7fadf802d0c0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7f3e59cd9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 0x7f3e4c179070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 0x7f3e4c179070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.552 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.530+0000 7fd453fff640 1 Processor -- start 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.530+0000 7fd453fff640 1 -- start start 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 0x7fd454211740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45416eed0 0x7fd45416dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45416e150 0x7fd4541fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd454099ed0 con 0x7fd45416eed0 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd454099d50 con 0x7fd4540991d0 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd453fff640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540b32d0 con 0x7fd45416e150 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 0x7f3e4c179070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34762/0 (socket says 172.21.15.80:34762) 2024-04-16T15:36:06.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7f3e537fe640 1 -- 172.21.15.80:0/812901718 learned_addr learned my addr 172.21.15.80:0/812901718 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd452ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 0x7fd454211740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd452ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 0x7fd454211740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39486/0 (socket says 172.21.15.80:39486) 2024-04-16T15:36:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.531+0000 7fd452ffd640 1 -- 172.21.15.80:0/1616378355 learned_addr learned my addr 172.21.15.80:0/1616378355 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45416e150 0x7fd4541fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e4c03b000 0x7f3e4c035ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd452ffd640 1 -- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45416e150 msgr2=0x7fd4541fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd452ffd640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd45416e150 0x7fd4541fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd452ffd640 1 -- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45416eed0 msgr2=0x7fd45416dc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd4527fc640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45416eed0 0x7fd45416dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7f3e52ffd640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e4c03b000 0x7f3e4c035ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd452ffd640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45416eed0 0x7fd45416dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd452ffd640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541ff6e0 con 0x7fd4540991d0 2024-04-16T15:36:06.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.532+0000 7fd4527fc640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd45416eed0 0x7fd45416dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:06.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0e0430 con 0x7f3e4c008f80 2024-04-16T15:36:06.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7fd452ffd640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 0x7fd454211740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd44400d830 tx=0x7fd44400dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400b6c0 con 0x7fd4540991d0 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7f3e53fff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0534d0 con 0x7f3e4c0e0050 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c03b640 con 0x7f3e4c03b000 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 -- 172.21.15.80:0/2931700333 shutdown_connections 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 --2- 172.21.15.80:0/2931700333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae000b5060 0x7fae000ae4b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 --2- 172.21.15.80:0/2931700333 >> v2:172.21.15.87:3300/0 conn(0x7fae0006cd90 0x7fae000b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 -- 172.21.15.80:0/2931700333 >> 172.21.15.80:0/2931700333 conn(0x7fae000727d0 msgr2=0x7fae00072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 -- 172.21.15.80:0/2931700333 shutdown_connections 2024-04-16T15:36:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e53fff640 1 -- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e4c03b000 msgr2=0x7f3e4c035ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e53fff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e4c03b000 0x7f3e4c035ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e53fff640 1 -- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 msgr2=0x7f3e4c179070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7fd453fff640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541ff400 con 0x7fd4540991d0 2024-04-16T15:36:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e53fff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 0x7f3e4c179070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e53fff640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c036640 con 0x7f3e4c0e0050 2024-04-16T15:36:06.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7f3e537fe640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e4c008f80 0x7f3e4c179070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.533+0000 7fd453fff640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd454160660 con 0x7fd4540991d0 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444019070 con 0x7fd4540991d0 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.535+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ba60 con 0x7fd4540991d0 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.535+0000 7fd453fff640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd454160a40 con 0x7fd4540991d0 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.536+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd44401e460 con 0x7fd4540991d0 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.534+0000 7fae0779d640 1 -- 172.21.15.80:0/2931700333 wait complete. 2024-04-16T15:36:06.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.536+0000 7fae0779d640 1 Processor -- start 2024-04-16T15:36:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.537+0000 7fd43b7fe640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44006c9c0 0x7fd44006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.536+0000 7fae0779d640 1 -- start start 2024-04-16T15:36:06.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.537+0000 7fd4527fc640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44006c9c0 0x7fd44006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fae0779d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae0006c9b0 0x7fae000cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fae0779d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae0006cd90 0x7fae00150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fae0779d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae000b5060 0x7fae00151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd44408cf00 con 0x7fd4540991d0 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fd43b7fe640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7fd440076140 0x7fd440078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd44400be50 con 0x7fd440076140 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd44408d2f0 con 0x7fd4540991d0 2024-04-16T15:36:06.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7fd440076140 0x7fd440078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7f65b2dc6640 1 Processor -- start 2024-04-16T15:36:06.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7fd4527fc640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44006c9c0 0x7fd44006ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd448038000 tx=0x7fd448032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7fae0779d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fae0006d1d0 con 0x7fae0006cd90 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae05d3a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae000b5060 0x7fae00151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae05d3a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae000b5060 0x7fae00151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58374/0 (socket says 172.21.15.80:58374) 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae05d3a640 1 -- 172.21.15.80:0/2924167003 learned_addr learned my addr 172.21.15.80:0/2924167003 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae00073830 con 0x7fae0006c9b0 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fae000ae5c0 con 0x7fae000b5060 2024-04-16T15:36:06.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fd4537fe640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7fd440076140 0x7fd440078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.538+0000 7f3e53fff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c168650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e54051690 tx=0x7f3e54069520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54074e70 con 0x7f3e4c0e0050 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54075050 con 0x7f3e4c0e0050 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e54075500 con 0x7f3e4c0e0050 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.539+0000 7f65b2dc6640 1 -- start start 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b2dc6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f65a40e75f0 0x7f65a4007660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b2dc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a40589c0 0x7f65a4053530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b2dc6640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a40e79d0 con 0x7f65a4056e90 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b2dc6640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f65a4007ba0 con 0x7f65a40e75f0 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b2dc6640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f65a40065c0 con 0x7f65a40589c0 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c036920 con 0x7f3e4c0e0050 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae05539640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae0006c9b0 0x7fae000cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c036ee0 con 0x7f3e4c0e0050 2024-04-16T15:36:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b25c5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f65a4056e90 0x7f65a403bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44494/0 (socket says 172.21.15.80:44494) 2024-04-16T15:36:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b25c5640 1 -- 172.21.15.80:0/3797900554 learned_addr learned my addr 172.21.15.80:0/3797900554 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7fae04d38640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae0006cd90 0x7fae00150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.540+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3797900554 >> v2:172.21.15.80:3300/0 conn(0x7f65a40e75f0 0x7f65a4007660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== osd.4 v2:172.21.15.87:6800/1581459636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd44400be50 con 0x7fd440076140 2024-04-16T15:36:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b15c3640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a40589c0 0x7f65a4053530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.542+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e4c0363e0 con 0x7f3e4c0e0050 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3797900554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a40589c0 msgr2=0x7f65a4053530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a40589c0 0x7f65a4053530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3797900554 >> v1:172.21.15.87:6789/0 conn(0x7f65a4056e90 legacy=0x7f65a403bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3797900554 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40068a0 con 0x7f65a40e75f0 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.541+0000 7f65b0dc2640 1 -- 172.21.15.80:0/3797900554 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088728169 0 0) 0x7f65a40e79d0 con 0x7f65a4056e90 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.543+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a4007660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0690f0 tx=0x7f65ac0a71e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fe80a0ed674ea server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.543+0000 7f65b0dc2640 1 -- 172.21.15.80:0/3797900554 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0b4070 con 0x7f65a40e75f0 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.543+0000 7f65b0dc2640 1 -- 172.21.15.80:0/3797900554 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac0a7e50 con 0x7f65a40e75f0 2024-04-16T15:36:06.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.543+0000 7f65b0dc2640 1 -- 172.21.15.80:0/3797900554 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0b4070 con 0x7f65a40e75f0 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 -- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae000b5060 msgr2=0x7fae00151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fae000b5060 0x7fae00151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 -- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae0006cd90 msgr2=0x7fae00150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fae0006cd90 0x7fae00150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae001519b0 con 0x7fae0006c9b0 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fae05539640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae0006c9b0 0x7fae000cfa10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000f60 tx=0x7fadfc00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.543+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e54093400 con 0x7f3e4c0e0050 2024-04-16T15:36:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e3ffff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e3806c9c0 0x7f3e3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e54106e00 con 0x7f3e4c0e0050 2024-04-16T15:36:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3797900554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 msgr2=0x7f65a4007660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f65b2dc6640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a4007660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0690f0 tx=0x7f65ac0a71e0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e3ffff640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f3e380760c0 0x7f3e38078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e5408dec0 con 0x7f3e380760c0 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e540d0b20 con 0x7f3e4c0e0050 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0074e0 con 0x7fae0006c9b0 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc007680 con 0x7fae0006c9b0 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.545+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc004a00 con 0x7fae0006c9b0 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.546+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae001e6c20 con 0x7fae0006c9b0 2024-04-16T15:36:06.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.544+0000 7f3e537fe640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e3806c9c0 0x7f3e3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.545+0000 7f3e52ffd640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f3e380760c0 0x7f3e38078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.545+0000 7f3e537fe640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e3806c9c0 0x7f3e3806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009630 tx=0x7f3e48030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.546+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 --> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5048002dd0 con 0x7f5044076fb0 2024-04-16T15:36:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.546+0000 7f3e52ffd640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f3e380760c0 0x7f3e38078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.546+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae001e71e0 con 0x7fae0006c9b0 2024-04-16T15:36:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.546+0000 7f5052ffd640 1 -- 172.21.15.80:0/4214984673 <== osd.0 v2:172.21.15.80:6824/802352542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5048002dd0 con 0x7f5044076fb0 2024-04-16T15:36:06.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== osd.6 v2:172.21.15.87:6824/2634190512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e5408dec0 con 0x7f3e380760c0 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5044076fb0 msgr2=0x7f5044079450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5044076fb0 0x7f5044079450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f504406ccf0 msgr2=0x7f504406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f504406ccf0 0x7f504406f1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f505c050db0 tx=0x7f5054009190 comp rx=0 tx=0).stop 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3797900554 shutdown_connections 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a40589c0 0x7f65a4053530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 --2- 172.21.15.80:0/3797900554 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a4007660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3797900554 >> 172.21.15.80:0/3797900554 conn(0x7f65a4058ee0 msgr2=0x7f65a40592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 msgr2=0x7f505c0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 --2- 172.21.15.80:0/4214984673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f505c007e30 0x7f505c0cc950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5058033000 tx=0x7f50580046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5062d9d640 1 -- 172.21.15.80:0/4214984673 reap_dead start 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 shutdown_connections 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 >> 172.21.15.80:0/4214984673 conn(0x7f505c055340 msgr2=0x7f505c0e28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3797900554 shutdown_connections 2024-04-16T15:36:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae00069150 con 0x7fae0006c9b0 2024-04-16T15:36:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.548+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 shutdown_connections 2024-04-16T15:36:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.548+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 --> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fefe000aa50 con 0x7fefcc076140 2024-04-16T15:36:06.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.548+0000 7f5050ff9640 1 -- 172.21.15.80:0/4214984673 wait complete. 2024-04-16T15:36:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.547+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3797900554 wait complete. 2024-04-16T15:36:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.549+0000 7f65b2dc6640 1 Processor -- start 2024-04-16T15:36:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.549+0000 7f65b2dc6640 1 -- start start 2024-04-16T15:36:06.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7f65b2dc6640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 0x7f65a404f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.549+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadfc01a020 con 0x7fae0006c9b0 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.549+0000 7fadf5ffb640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fade406c9c0 0x7fade406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.550+0000 7fae04d38640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fade406c9c0 0x7fade406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.550+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fadfc08b420 con 0x7fae0006c9b0 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fae04d38640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fade406c9c0 0x7fade406ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae0014e860 tx=0x7fadf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fadf5ffb640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fade4076140 0x7fade4078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadfc01ee50 con 0x7fade4076140 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadfc092050 con 0x7fae0006c9b0 2024-04-16T15:36:06.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fefdeffd640 1 -- 172.21.15.80:0/2671921179 <== osd.7 v2:172.21.15.87:6816/4163376620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fefe000aa50 con 0x7fefcc076140 2024-04-16T15:36:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7fae05d3a640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fade4076140 0x7fade4078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7f65b2dc6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a40589c0 0x7f65a404bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7f65b2dc6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a404ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.551+0000 7f65b1dc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 0x7f65a404f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b1dc4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 0x7f65a404f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58392/0 (socket says 172.21.15.80:58392) 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3428352882 learned_addr learned my addr 172.21.15.80:0/3428352882 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b25c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a404ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b15c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a40589c0 0x7f65a404bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7fefcc076140 msgr2=0x7fefcc078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7fefcc076140 0x7fefcc078580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f65a4007140 con 0x7f65a40e75f0 2024-04-16T15:36:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f65a4006e60 con 0x7f65a40589c0 2024-04-16T15:36:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f65a40061e0 con 0x7f65a4056e90 2024-04-16T15:36:06.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7fae05d3a640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fade4076140 0x7fade4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fefcc06c9c0 msgr2=0x7fefcc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fefcc06c9c0 0x7fefcc06ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefe004b610 tx=0x7fefe4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a40589c0 msgr2=0x7f65a404bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a40589c0 0x7f65a404bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 msgr2=0x7f65a404ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a404ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b1dc4640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a40d1f60 con 0x7f65a4056e90 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b15c3640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f65a40589c0 0x7f65a404bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b25c5640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f65a40e75f0 0x7f65a404ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b1dc4640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 0x7f65a404f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0502b0 tx=0x7f65ac069f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0bf020 con 0x7f65a4056e90 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac0ae860 con 0x7f65a4056e90 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0b4070 con 0x7f65a4056e90 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 msgr2=0x7fefe0048700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7feff044a640 1 --2- 172.21.15.80:0/2671921179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fefe00074d0 0x7fefe0048700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fefd800b440 tx=0x7fefd800b900 comp rx=0 tx=0).stop 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.552+0000 7fefee9e7640 1 -- 172.21.15.80:0/2671921179 reap_dead start 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 shutdown_connections 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 >> 172.21.15.80:0/2671921179 conn(0x7fefe0009fe0 msgr2=0x7fefe00ddb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a40d2240 con 0x7f65a4056e90 2024-04-16T15:36:06.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 shutdown_connections 2024-04-16T15:36:06.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.553+0000 7feff044a640 1 -- 172.21.15.80:0/2671921179 wait complete. 2024-04-16T15:36:06.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.554+0000 7f65b2dc6640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a404c6a0 con 0x7f65a4056e90 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.554+0000 7f34e353f640 1 -- 172.21.15.80:0/3922465976 --> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34dc072040 con 0x7f34dc15f090 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.555+0000 7f34d1ffb640 1 -- 172.21.15.80:0/3922465976 <== osd.1 v2:172.21.15.80:6800/1467041108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f34dc072040 con 0x7f34dc15f090 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f34dc15f090 msgr2=0x7f34dc15f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f34dc15f090 0x7f34dc15f470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34c006c9f0 msgr2=0x7f34c006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34c006c9f0 0x7f34c006eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f34d4034000 tx=0x7f34d402f000 comp rx=0 tx=0).stop 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 msgr2=0x7f34dc150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 --2- 172.21.15.80:0/3922465976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34dc0af130 0x7f34dc150770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f34dc070080 tx=0x7f34d800c760 comp rx=0 tx=0).stop 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34e1adc640 1 -- 172.21.15.80:0/3922465976 reap_dead start 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 shutdown_connections 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 >> 172.21.15.80:0/3922465976 conn(0x7f34dc0b2940 msgr2=0x7f34dc074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 shutdown_connections 2024-04-16T15:36:06.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f34c77fe640 1 -- 172.21.15.80:0/3922465976 wait complete. 2024-04-16T15:36:06.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.554+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== osd.2 v2:172.21.15.80:6808/2167961264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadfc01ee50 con 0x7fade4076140 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65a4005700 con 0x7f65a4056e90 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.556+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65ac0c2020 con 0x7f65a4056e90 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f65a27fc640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f659006c9f0 0x7f659006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65ac129440 con 0x7f65a4056e90 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f65a27fc640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f65900760e0 0x7f6590078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65ac06d980 con 0x7f65900760e0 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.557+0000 7f65b15c3640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f659006c9f0 0x7f659006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.558+0000 7f65b25c5640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f65900760e0 0x7f6590078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.558+0000 7f65b25c5640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f65900760e0 0x7f6590078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.558+0000 7f65b15c3640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f659006c9f0 0x7f659006eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65a40d1e90 tx=0x7f65a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.559+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65ac130050 con 0x7f65a4056e90 2024-04-16T15:36:06.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.559+0000 7f39d9ffb640 1 -- 172.21.15.80:0/3928668542 --> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39d4002dd0 con 0x7f39e0076140 2024-04-16T15:36:06.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.559+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== osd.5 v2:172.21.15.87:6808/968411507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65ac06d980 con 0x7f65900760e0 2024-04-16T15:36:06.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.565+0000 7f39dbfff640 1 -- 172.21.15.80:0/3928668542 <== osd.3 v2:172.21.15.80:6811/1569227451 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39d4002dd0 con 0x7f39e0076140 2024-04-16T15:36:06.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.567+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7f39e0076140 msgr2=0x7f39e0078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.567+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7f39e0076140 0x7f39e0078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.591 INFO:teuthology.orchestra.run.smithi080.stdout:55834574859 2024-04-16T15:36:06.592 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T15:36:06.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39e006c9c0 msgr2=0x7f39e006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39e006c9c0 0x7f39e006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39e4036000 tx=0x7f39e4008030 comp rx=0 tx=0).stop 2024-04-16T15:36:06.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 msgr2=0x7f39f40c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 --2- 172.21.15.80:0/3928668542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39f40aeb70 0x7f39f40c7bd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00efa0 tx=0x7f39ec00c550 comp rx=0 tx=0).stop 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f3fff640 1 -- 172.21.15.80:0/3928668542 reap_dead start 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 shutdown_connections 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.571+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 >> 172.21.15.80:0/3928668542 conn(0x7f39f40d00f0 msgr2=0x7f39f40afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.573+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 shutdown_connections 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.573+0000 7f39f9aeb640 1 -- 172.21.15.80:0/3928668542 wait complete. 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.574+0000 7fd453fff640 1 -- 172.21.15.80:0/1616378355 --> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd45404fd90 con 0x7fd440076140 2024-04-16T15:36:06.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.574+0000 7fd43b7fe640 1 -- 172.21.15.80:0/1616378355 <== osd.4 v2:172.21.15.87:6800/1581459636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd45404fd90 con 0x7fd440076140 2024-04-16T15:36:06.594 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:06.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7fd440076140 msgr2=0x7fd440078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7fd440076140 0x7fd440078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44006c9c0 msgr2=0x7fd44006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44006c9c0 0x7fd44006ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd448038000 tx=0x7fd448032000 comp rx=0 tx=0).stop 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 msgr2=0x7fd454211740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 --2- 172.21.15.80:0/1616378355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4540991d0 0x7fd454211740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd44400d830 tx=0x7fd44400dcf0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4537fe640 1 -- 172.21.15.80:0/1616378355 reap_dead start 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 shutdown_connections 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 >> 172.21.15.80:0/1616378355 conn(0x7fd4540b5d80 msgr2=0x7fd4540b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.575+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 shutdown_connections 2024-04-16T15:36:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.576+0000 7fd4397fa640 1 -- 172.21.15.80:0/1616378355 wait complete. 2024-04-16T15:36:06.597 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:06.597 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T15:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.580+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 --> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae000b44c0 con 0x7fade4076140 2024-04-16T15:36:06.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.581+0000 7fadf5ffb640 1 -- 172.21.15.80:0/2924167003 <== osd.2 v2:172.21.15.80:6808/2167961264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae000b44c0 con 0x7fade4076140 2024-04-16T15:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.581+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fade4076140 msgr2=0x7fade4078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.581+0000 7fae0779d640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fade4076140 0x7fade4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fade406c9c0 msgr2=0x7fade406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fade406c9c0 0x7fade406ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae0014e860 tx=0x7fadf0008040 comp rx=0 tx=0).stop 2024-04-16T15:36:06.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae0006c9b0 msgr2=0x7fae000cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 --2- 172.21.15.80:0/2924167003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae0006c9b0 0x7fae000cfa10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000f60 tx=0x7fadfc00c760 comp rx=0 tx=0).stop 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae05d3a640 1 -- 172.21.15.80:0/2924167003 reap_dead start 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 shutdown_connections 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 >> 172.21.15.80:0/2924167003 conn(0x7fae000727d0 msgr2=0x7fae00067760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 shutdown_connections 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.582+0000 7fae0779d640 1 -- 172.21.15.80:0/2924167003 wait complete. 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.584+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 --> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e4c006460 con 0x7f3e380760c0 2024-04-16T15:36:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.584+0000 7f3e3ffff640 1 -- 172.21.15.80:0/812901718 <== osd.6 v2:172.21.15.87:6824/2634190512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e4c006460 con 0x7f3e380760c0 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f3e380760c0 msgr2=0x7f3e38078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f3e380760c0 0x7f3e38078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e3806c9c0 msgr2=0x7f3e3806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e3806c9c0 0x7f3e3806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009630 tx=0x7f3e48030000 comp rx=0 tx=0).stop 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c0e0050 msgr2=0x7f3e4c168650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 --2- 172.21.15.80:0/812901718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e4c0e0050 0x7f3e4c168650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3e54051690 tx=0x7f3e54069520 comp rx=0 tx=0).stop 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e53fff640 1 -- 172.21.15.80:0/812901718 reap_dead start 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 shutdown_connections 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.585+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 >> 172.21.15.80:0/812901718 conn(0x7f3e4c01efa0 msgr2=0x7f3e4c032890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.586+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 shutdown_connections 2024-04-16T15:36:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.586+0000 7f3e59cd9640 1 -- 172.21.15.80:0/812901718 wait complete. 2024-04-16T15:36:06.603 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:06.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T15:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.588+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 --> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65a400e0f0 con 0x7f65900760e0 2024-04-16T15:36:06.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.589+0000 7f65a27fc640 1 -- 172.21.15.80:0/3428352882 <== osd.5 v2:172.21.15.87:6808/968411507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65a400e0f0 con 0x7f65900760e0 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f65900760e0 msgr2=0x7f6590078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f65900760e0 0x7f6590078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f659006c9f0 msgr2=0x7f659006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f659006c9f0 0x7f659006eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65a40d1e90 tx=0x7f65a8008040 comp rx=0 tx=0).stop 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 msgr2=0x7f65a404f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 --2- 172.21.15.80:0/3428352882 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f65a4056e90 0x7f65a404f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0502b0 tx=0x7f65ac069f50 comp rx=0 tx=0).stop 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f65b25c5640 1 -- 172.21.15.80:0/3428352882 reap_dead start 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 shutdown_connections 2024-04-16T15:36:06.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 >> 172.21.15.80:0/3428352882 conn(0x7f65a4058ee0 msgr2=0x7f65a4059830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 shutdown_connections 2024-04-16T15:36:06.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.590+0000 7f658ffff640 1 -- 172.21.15.80:0/3428352882 wait complete. 2024-04-16T15:36:06.606 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:06.607 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T15:36:06.607 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:06.608 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T15:36:06.608 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:06.609 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T15:36:06.609 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:06.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T15:36:06.828 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.828+0000 7f9311fc8640 1 Processor -- start 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.828+0000 7f9311fc8640 1 -- start start 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f9311fc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15eac0 0x7f930c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f9311fc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f930c15f010 0x7f930c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f9311fc8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930c0ceea0 con 0x7f930c15fbb0 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f9311fc8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f930c0d0300 con 0x7f930c15f010 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f9311fc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f930c15f980 con 0x7f930c15eac0 2024-04-16T15:36:06.829 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7fef8b4c5640 1 Processor -- start 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f930c15f010 0x7f930c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f930c15f010 0x7f930c15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39534/0 (socket says 172.21.15.80:39534) 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930bfff640 1 -- 172.21.15.80:0/3460733775 learned_addr learned my addr 172.21.15.80:0/3460733775 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930b7fe640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15eac0 0x7f930c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930bfff640 1 -- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15eac0 msgr2=0x7f930c0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f930bfff640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15eac0 0x7f930c0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f930bfff640 1 -- 172.21.15.80:0/3460733775 >> v1:172.21.15.80:6789/0 conn(0x7f930c15fbb0 legacy=0x7f930c0cfbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f930bfff640 1 -- 172.21.15.80:0/3460733775 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c0cce00 con 0x7f930c15f010 2024-04-16T15:36:06.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7fef8b4c5640 1 -- start start 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7fef8b4c5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef840ccdb0 0x7fef8415b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7fef8b4c5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 0x7fef840b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef8b4c5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8415bdb0 con 0x7fef8406f030 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef8b4c5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fef840b5110 con 0x7fef840ccdb0 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef8b4c5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fef8406de30 con 0x7fef840b3510 2024-04-16T15:36:06.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7f930bfff640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15f010 0x7f930c15f440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00bb40 tx=0x7f92fc02dfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bccaf0f66c13fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef88a60640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fef8406f030 0x7fef8406e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44508/0 (socket says 172.21.15.80:44508) 2024-04-16T15:36:06.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef88a60640 1 -- 172.21.15.80:0/4131007537 learned_addr learned my addr 172.21.15.80:0/4131007537 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f3e297d5640 1 Processor -- start 2024-04-16T15:36:06.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7f3e297d5640 1 -- start start 2024-04-16T15:36:06.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef89a62640 1 --2- 172.21.15.80:0/4131007537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 0x7fef840b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7f930a7fc640 1 -- 172.21.15.80:0/3460733775 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc03b070 con 0x7f930c15f010 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7f930a7fc640 1 -- 172.21.15.80:0/3460733775 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92fc02ed70 con 0x7f930c15f010 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7f930a7fc640 1 -- 172.21.15.80:0/3460733775 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc036660 con 0x7f930c15f010 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef7bfff640 1 -- 172.21.15.80:0/4131007537 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834811267 0 0) 0x7fef7c001490 con 0x7fef8406f030 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef7bfff640 1 -- 172.21.15.80:0/4131007537 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef70003440 con 0x7fef8406f030 2024-04-16T15:36:06.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.832+0000 7fef89261640 1 --2- 172.21.15.80:0/4131007537 >> v2:172.21.15.87:3300/0 conn(0x7fef840ccdb0 0x7fef8415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7fd4e5df4640 1 Processor -- start 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f0a8dcb1640 1 Processor -- start 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.830+0000 7f0a8dcb1640 1 -- start start 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f0a8dcb1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a8816b5e0 0x7f0a880ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f0a8dcb1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a88071dd0 0x7f0a88072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f0a8dcb1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8806e3d0 con 0x7f0a8806de30 2024-04-16T15:36:06.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f0a8dcb1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8816b9c0 con 0x7f0a88071dd0 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.831+0000 7f0a8dcb1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8806e6b0 con 0x7f0a8816b5e0 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f0a87fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a88071dd0 0x7f0a88072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f0a87fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0a88071dd0 0x7f0a88072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34798/0 (socket says 172.21.15.80:34798) 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f0a87fff640 1 -- 172.21.15.80:0/268126069 learned_addr learned my addr 172.21.15.80:0/268126069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f0a877fe640 1 --2- 172.21.15.80:0/268126069 >> v2:172.21.15.87:3300/0 conn(0x7f0a8816b5e0 0x7f0a880ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f9311fc8640 1 -- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15f010 msgr2=0x7f930c15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f9311fc8640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15f010 0x7f930c15f440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00bb40 tx=0x7f92fc02dfc0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f9311fc8640 1 -- 172.21.15.80:0/3460733775 shutdown_connections 2024-04-16T15:36:06.835 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f9311fc8640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15f010 0x7f930c15f440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f9311fc8640 1 --2- 172.21.15.80:0/3460733775 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15eac0 0x7f930c0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f9311fc8640 1 -- 172.21.15.80:0/3460733775 >> 172.21.15.80:0/3460733775 conn(0x7f930c0b2e00 msgr2=0x7f930c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fef89a62640 1 -- 172.21.15.80:0/4131007537 >> v2:172.21.15.87:3300/0 conn(0x7fef840ccdb0 msgr2=0x7fef8415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fef89a62640 1 --2- 172.21.15.80:0/4131007537 >> v2:172.21.15.87:3300/0 conn(0x7fef840ccdb0 0x7fef8415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fef89a62640 1 -- 172.21.15.80:0/4131007537 >> v1:172.21.15.87:6789/0 conn(0x7fef8406f030 legacy=0x7fef8406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fef89a62640 1 -- 172.21.15.80:0/4131007537 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840b5350 con 0x7fef840b3510 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7fd4e5df4640 1 -- start start 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4e00d0060 0x7fd4e00d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4e00ce570 0x7fd4e015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e00cea20 con 0x7fd4e00ce570 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e00cbf30 con 0x7fd4e00d0060 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7fd4e5df4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e00d0980 con 0x7fd4e015ac30 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58426/0 (socket says 172.21.15.80:58426) 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 -- 172.21.15.80:0/358599666 learned_addr learned my addr 172.21.15.80:0/358599666 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4df7fe640 1 --2- 172.21.15.80:0/358599666 >> v2:172.21.15.87:3300/0 conn(0x7fd4e00d0060 0x7fd4e00d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 -- 172.21.15.80:0/358599666 >> v2:172.21.15.87:3300/0 conn(0x7fd4e00d0060 msgr2=0x7fd4e00d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 --2- 172.21.15.80:0/358599666 >> v2:172.21.15.87:3300/0 conn(0x7fd4e00d0060 0x7fd4e00d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7f9311fc8640 1 -- 172.21.15.80:0/3460733775 shutdown_connections 2024-04-16T15:36:06.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f3e297d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fef89a62640 1 --2- 172.21.15.80:0/4131007537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 0x7fef840b39c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef7400dbc0 tx=0x7fef7402fce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5d5c430333b69c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 -- 172.21.15.80:0/358599666 >> v2:172.21.15.80:3300/0 conn(0x7fd4e00ce570 msgr2=0x7fd4e015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f3e297d5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240b3b30 con 0x7f3e2416eaf0 2024-04-16T15:36:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f3e297d5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240b3e10 con 0x7f3e240735f0 2024-04-16T15:36:06.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.833+0000 7f3e297d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e24099f30 con 0x7f3e240b32d0 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58414/0 (socket says 172.21.15.80:58414) 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 -- 172.21.15.80:0/397864891 learned_addr learned my addr 172.21.15.80:0/397864891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 -- 172.21.15.80:0/397864891 >> v1:172.21.15.87:6789/0 conn(0x7f3e240735f0 legacy=0x7f3e2416ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 -- 172.21.15.80:0/397864891 >> v1:172.21.15.80:6789/0 conn(0x7f3e2416eaf0 legacy=0x7f3e2416c120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f3e28fd4640 1 -- 172.21.15.80:0/397864891 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e24172e10 con 0x7f3e240b32d0 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f0a87fff640 1 -- 172.21.15.80:0/268126069 >> v2:172.21.15.87:3300/0 conn(0x7f0a8816b5e0 msgr2=0x7f0a880ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7f3e28fd4640 1 --2- 172.21.15.80:0/397864891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014a30 tx=0x7f3e1c034a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc7c36da0c1e113 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f3e22ffd640 1 -- 172.21.15.80:0/397864891 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c03c070 con 0x7f3e240b32d0 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f0a87fff640 1 --2- 172.21.15.80:0/268126069 >> v2:172.21.15.87:3300/0 conn(0x7f0a8816b5e0 0x7f0a880ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f0a87fff640 1 -- 172.21.15.80:0/268126069 >> v1:172.21.15.80:6789/0 conn(0x7f0a8806de30 legacy=0x7f0a8806f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.834+0000 7f0a87fff640 1 -- 172.21.15.80:0/268126069 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8806e990 con 0x7f0a88071dd0 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7f0a87fff640 1 --2- 172.21.15.80:0/268126069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a88072260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a8807ad50 tx=0x7f0a8002c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4767218b69fb64aa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f3e22ffd640 1 -- 172.21.15.80:0/397864891 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0114e0 con 0x7f3e240b32d0 2024-04-16T15:36:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 --2- 172.21.15.80:0/358599666 >> v2:172.21.15.80:3300/0 conn(0x7fd4e00ce570 0x7fd4e015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.835+0000 7fd4deffd640 1 -- 172.21.15.80:0/358599666 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e00cb3b0 con 0x7fd4e015ac30 2024-04-16T15:36:06.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f9311fc8640 1 -- 172.21.15.80:0/3460733775 wait complete. 2024-04-16T15:36:06.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f0a867fc640 1 -- 172.21.15.80:0/268126069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80036950 con 0x7f0a88071dd0 2024-04-16T15:36:06.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f0a867fc640 1 -- 172.21.15.80:0/268126069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8003b070 con 0x7f0a88071dd0 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7f0a867fc640 1 -- 172.21.15.80:0/268126069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80036d10 con 0x7f0a88071dd0 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/268126069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 msgr2=0x7f0a88072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 --2- 172.21.15.80:0/268126069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a88072260 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a8807ad50 tx=0x7f0a8002c2d0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 -- 172.21.15.80:0/397864891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 msgr2=0x7f3e241700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 --2- 172.21.15.80:0/397864891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014a30 tx=0x7f3e1c034a80 comp rx=0 tx=0).stop 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 -- 172.21.15.80:0/397864891 shutdown_connections 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 --2- 172.21.15.80:0/397864891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e241700b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 -- 172.21.15.80:0/397864891 >> 172.21.15.80:0/397864891 conn(0x7f3e240b57c0 msgr2=0x7f3e24072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 -- 172.21.15.80:0/397864891 shutdown_connections 2024-04-16T15:36:06.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f3e297d5640 1 -- 172.21.15.80:0/397864891 wait complete. 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7fef7bfff640 1 -- 172.21.15.80:0/4131007537 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74030880 con 0x7fef840b3510 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.836+0000 7fef7bfff640 1 -- 172.21.15.80:0/4131007537 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef74030a20 con 0x7fef840b3510 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7fef8b4c5640 1 -- 172.21.15.80:0/4131007537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 msgr2=0x7fef840b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/4131007537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 0x7fef840b39c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef7400dbc0 tx=0x7fef7402fce0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/268126069 shutdown_connections 2024-04-16T15:36:06.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7f9311fc8640 1 Processor -- start 2024-04-16T15:36:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 --2- 172.21.15.80:0/268126069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a88072260 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 --2- 172.21.15.80:0/268126069 >> v2:172.21.15.87:3300/0 conn(0x7f0a8816b5e0 0x7f0a880ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.837+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/268126069 >> 172.21.15.80:0/268126069 conn(0x7f0a88067940 msgr2=0x7f0a8806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 -- 172.21.15.80:0/4131007537 shutdown_connections 2024-04-16T15:36:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/4131007537 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840b3510 0x7fef840b39c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/4131007537 >> v2:172.21.15.87:3300/0 conn(0x7fef840ccdb0 0x7fef8415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 -- 172.21.15.80:0/4131007537 >> 172.21.15.80:0/4131007537 conn(0x7fef84067940 msgr2=0x7fef8406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fd4deffd640 1 --2- 172.21.15.80:0/358599666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd4e006d3f0 tx=0x7fd4d800ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498d48fb8f311d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fd4de7fc640 1 -- 172.21.15.80:0/358599666 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8032070 con 0x7fd4e015ac30 2024-04-16T15:36:06.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fd4de7fc640 1 -- 172.21.15.80:0/358599666 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d802cd90 con 0x7fd4e015ac30 2024-04-16T15:36:06.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fd4de7fc640 1 -- 172.21.15.80:0/358599666 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800be60 con 0x7fd4e015ac30 2024-04-16T15:36:06.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 -- 172.21.15.80:0/4131007537 shutdown_connections 2024-04-16T15:36:06.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/268126069 shutdown_connections 2024-04-16T15:36:06.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/268126069 wait complete. 2024-04-16T15:36:06.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7fef8b4c5640 1 -- 172.21.15.80:0/4131007537 wait complete. 2024-04-16T15:36:06.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7fef8b4c5640 1 Processor -- start 2024-04-16T15:36:06.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f0a8dcb1640 1 Processor -- start 2024-04-16T15:36:06.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.839+0000 7f3e297d5640 1 Processor -- start 2024-04-16T15:36:06.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.839+0000 7f3e297d5640 1 -- start start 2024-04-16T15:36:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7fd4e5df4640 1 -- 172.21.15.80:0/358599666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 msgr2=0x7fd4e00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e240735f0 0x7f3e240aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e24215200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2416d650 con 0x7f3e240735f0 2024-04-16T15:36:06.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.838+0000 7f9311fc8640 1 -- start start 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240995b0 con 0x7f3e2416eaf0 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e297d5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2416c830 con 0x7f3e240b32d0 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39580/0 (socket says 172.21.15.80:39580) 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 -- 172.21.15.80:0/99769287 learned_addr learned my addr 172.21.15.80:0/99769287 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 -- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 msgr2=0x7f3e24215200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:36:06.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e24215200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.839+0000 7f9311fc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f9311fc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 0x7f930c1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f9311fc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15fbb0 0x7f930c0c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f9311fc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f930c0cf6d0 con 0x7f930c15f010 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f9311fc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f930c0cf3f0 con 0x7f930c15eac0 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f9311fc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f930c0cd0d0 con 0x7f930c15fbb0 2024-04-16T15:36:06.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39578/0 (socket says 172.21.15.80:39578) 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f930b7fe640 1 -- 172.21.15.80:0/1719858183 learned_addr learned my addr 172.21.15.80:0/1719858183 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7f930affd640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 0x7f930c1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930b7fe640 1 -- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15fbb0 msgr2=0x7f930c0c3510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930b7fe640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15fbb0 0x7f930c0c3510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930b7fe640 1 -- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 msgr2=0x7f930c1f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930b7fe640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 0x7f930c1f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930b7fe640 1 -- 172.21.15.80:0/1719858183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c14a9c0 con 0x7f930c15eac0 2024-04-16T15:36:06.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f930affd640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 0x7f930c1f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:06.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.840+0000 7fef8b4c5640 1 -- start start 2024-04-16T15:36:06.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 0x7fef8414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f930b7fe640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f930000e8a0 tx=0x7f930000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/358599666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd4e006d3f0 tx=0x7fd4d800ace0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 0x7fef841f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef8406e0d0 con 0x7fef8406f030 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef840b5910 con 0x7fef840b3510 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef8b4c5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fef8406ed00 con 0x7fef840ccdb0 2024-04-16T15:36:06.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f0a8dcb1640 1 -- start start 2024-04-16T15:36:06.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f0a8dcb1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f0a8dcb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 -- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e240735f0 msgr2=0x7f3e240aff10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:36:06.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e240735f0 0x7f3e240aff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.841+0000 7f3e28fd4640 1 -- 172.21.15.80:0/99769287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e24215740 con 0x7f3e2416eaf0 2024-04-16T15:36:06.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f3e28fd4640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c034ac0 tx=0x7f3e1c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f0a877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58440/0 (socket says 172.21.15.80:58440) 2024-04-16T15:36:06.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 -- 172.21.15.80:0/2330600602 learned_addr learned my addr 172.21.15.80:0/2330600602 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f0a877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39602/0 (socket says 172.21.15.80:39602) 2024-04-16T15:36:06.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef88a60640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 0x7fef841f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89261640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 0x7fef8414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 -- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 msgr2=0x7fef841f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 0x7fef841f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c045020 con 0x7f3e2416eaf0 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00f4e0 con 0x7f3e2416eaf0 2024-04-16T15:36:06.861 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c03c040 con 0x7f3e2416eaf0 2024-04-16T15:36:06.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 -- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 msgr2=0x7fef8414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e240ad060 con 0x7f3e2416eaf0 2024-04-16T15:36:06.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7f0a86ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 0x7fef8414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.842+0000 7fef89a62640 1 -- 172.21.15.80:0/2330600602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef841fc080 con 0x7fef840ccdb0 2024-04-16T15:36:06.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7fef88a60640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 0x7fef841f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:06.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7f0a86ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34818/0 (socket says 172.21.15.80:34818) 2024-04-16T15:36:06.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7fef89261640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 0x7fef8414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:06.864 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e240ad900 con 0x7f3e2416eaf0 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7fef89a62640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef7400dbc0 tx=0x7fef74004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74042410 con 0x7fef840ccdb0 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef841fc360 con 0x7fef840ccdb0 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef841fc920 con 0x7fef840ccdb0 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 -- 172.21.15.80:0/358599666 shutdown_connections 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/358599666 >> v2:172.21.15.80:3300/0 conn(0x7fd4e00ce570 0x7fd4e015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/358599666 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e015ac30 0x7fd4e00ce030 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/358599666 >> v2:172.21.15.87:3300/0 conn(0x7fd4e00d0060 0x7fd4e00d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 -- 172.21.15.80:0/358599666 >> 172.21.15.80:0/358599666 conn(0x7fd4e0072ee0 msgr2=0x7fd4e00732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300017070 con 0x7f930c15eac0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930000c940 con 0x7f930c15eac0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.843+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000cd10 con 0x7f930c15eac0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c14af80 con 0x7f930c15eac0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c14b540 con 0x7f930c15eac0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef740425b0 con 0x7fef840ccdb0 2024-04-16T15:36:06.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.845+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74042960 con 0x7fef840ccdb0 2024-04-16T15:36:06.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.845+0000 7f0a877fe640 1 -- 172.21.15.80:0/2996767220 learned_addr learned my addr 172.21.15.80:0/2996767220 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.845+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e1c048020 con 0x7f3e2416eaf0 2024-04-16T15:36:06.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2404fd90 con 0x7f3e2416eaf0 2024-04-16T15:36:06.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 -- 172.21.15.80:0/358599666 shutdown_connections 2024-04-16T15:36:06.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.844+0000 7fd4e5df4640 1 -- 172.21.15.80:0/358599666 wait complete. 2024-04-16T15:36:06.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f3e20ff9640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 0x7f3e1006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f0a8dcb1640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 0x7f0a8816d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880b4d70 con 0x7f0a88071dd0 2024-04-16T15:36:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880b4bf0 con 0x7f0a8806de30 2024-04-16T15:36:06.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880b4ef0 con 0x7f0a8816b5e0 2024-04-16T15:36:06.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e1c0aefb0 con 0x7f3e2416eaf0 2024-04-16T15:36:06.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7fd4e5df4640 1 Processor -- start 2024-04-16T15:36:06.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f3e23fff640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 0x7f3e1006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef84068a40 con 0x7fef840ccdb0 2024-04-16T15:36:06.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 0x7f0a8816d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7fd4e5df4640 1 -- start start 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f3e23fff640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 0x7f3e1006eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e24172350 tx=0x7f3e18006b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.846+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c14b740 con 0x7f930c15eac0 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f930001a070 con 0x7f930c15eac0 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 -- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 msgr2=0x7f0a881669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 -- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 msgr2=0x7f0a880a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f0a87fff640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8820a9b0 con 0x7f0a8816b5e0 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.847+0000 7f92f3fff640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 0x7f92f806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f930008c140 con 0x7f930c15eac0 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 0x7fd4e00b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00d0060 0x7fd4e015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7f0a87fff640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 0x7f0a8816d470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0a80037000 tx=0x7f0a80004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7f930affd640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 0x7f92f806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef74049020 con 0x7fef840ccdb0 2024-04-16T15:36:06.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fef79ffb640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 0x7fef6806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4dffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34832/0 (socket says 172.21.15.80:34832) 2024-04-16T15:36:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef740ad910 con 0x7fef840ccdb0 2024-04-16T15:36:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fef89261640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 0x7fef6806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4dffff640 1 -- 172.21.15.80:0/2003613551 learned_addr learned my addr 172.21.15.80:0/2003613551 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7f930affd640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 0x7f92f806ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f930c204c10 tx=0x7f93040083d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00cbc50 con 0x7fd4e015ac30 2024-04-16T15:36:06.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fef89261640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 0x7fef6806ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef8414de20 tx=0x7fef80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00cb970 con 0x7fd4e00d0060 2024-04-16T15:36:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e0073a00 con 0x7fd4e00ce570 2024-04-16T15:36:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.848+0000 7fd4df7fe640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 0x7fd4e00b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 -- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00d0060 msgr2=0x7fd4e015b3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00d0060 0x7fd4e015b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 -- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 msgr2=0x7fd4e0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e00b3640 con 0x7fd4e00ce570 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4dffff640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.849+0000 7fd4df7fe640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 0x7fd4e00b2e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b390 tx=0x7fd4d000b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.850+0000 7f0a877fe640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:06.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.850+0000 7f0a86ffd640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.851+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f930c14b740 con 0x7f930c15eac0 2024-04-16T15:36:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80045070 con 0x7f0a8816b5e0 2024-04-16T15:36:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80041850 con 0x7f0a8816b5e0 2024-04-16T15:36:06.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80041c00 con 0x7f0a8816b5e0 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001f640 con 0x7fd4e00ce570 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d001f7e0 con 0x7fd4e00ce570 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.853+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e00b3920 con 0x7fd4e00ce570 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.854+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e00c7460 con 0x7fd4e00ce570 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.854+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001fbd0 con 0x7fd4e00ce570 2024-04-16T15:36:06.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a88209e30 con 0x7f0a8816b5e0 2024-04-16T15:36:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef7407ba70 con 0x7fef840ccdb0 2024-04-16T15:36:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f0a8dcb1640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8820a3f0 con 0x7f0a8816b5e0 2024-04-16T15:36:06.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4d0028440 con 0x7fd4e00ce570 2024-04-16T15:36:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.857+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e1c04f070 con 0x7f3e2416eaf0 2024-04-16T15:36:06.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.857+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8808bb00 con 0x7f0a8816b5e0 2024-04-16T15:36:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.857+0000 7fd4c7fff640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 0x7fd4cc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.858+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd4d0094790 con 0x7fd4e00ce570 2024-04-16T15:36:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.858+0000 7fd4deffd640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 0x7fd4cc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e00c7280 con 0x7fd4e00ce570 2024-04-16T15:36:06.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.860+0000 7fd4deffd640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 0x7fd4cc06ee80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8037000 tx=0x7fd4d8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.854+0000 7f2ff53e9640 1 Processor -- start 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.854+0000 7f2ff53e9640 1 -- start start 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f2ff53e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2fe80e7600 0x7f2fe8050460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f2ff53e9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fe8049250 0x7f2fe80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f2ff53e9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8050d40 con 0x7f2fe8006f20 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f2ff53e9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe8007390 con 0x7f2fe8049250 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.855+0000 7f2ff53e9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe80518c0 con 0x7f2fe80e7600 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fe8049250 0x7f2fe80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2fe8049250 0x7f2fe80069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34848/0 (socket says 172.21.15.80:34848) 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 -- 172.21.15.80:0/4143719237 learned_addr learned my addr 172.21.15.80:0/4143719237 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 -- 172.21.15.80:0/4143719237 >> v2:172.21.15.87:3300/0 conn(0x7f2fe80e7600 msgr2=0x7f2fe8050460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 --2- 172.21.15.80:0/4143719237 >> v2:172.21.15.87:3300/0 conn(0x7f2fe80e7600 0x7f2fe8050460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 -- 172.21.15.80:0/4143719237 >> v1:172.21.15.80:6789/0 conn(0x7f2fe8006f20 legacy=0x7f2fe80eb1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.856+0000 7f2fee7fc640 1 -- 172.21.15.80:0/4143719237 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe8051020 con 0x7f2fe8049250 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.858+0000 7f2fee7fc640 1 --2- 172.21.15.80:0/4143719237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8049250 0x7f2fe80069e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002dbb0 tx=0x7f2ff00a7470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed8c95579c8795 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.858+0000 7f2fedffb640 1 -- 172.21.15.80:0/4143719237 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00b3070 con 0x7f2fe8049250 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.858+0000 7f2fedffb640 1 -- 172.21.15.80:0/4143719237 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff00ae600 con 0x7f2fe8049250 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2fedffb640 1 -- 172.21.15.80:0/4143719237 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aea70 con 0x7f2fe8049250 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 -- 172.21.15.80:0/4143719237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8049250 msgr2=0x7f2fe80069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 --2- 172.21.15.80:0/4143719237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8049250 0x7f2fe80069e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002dbb0 tx=0x7f2ff00a7470 comp rx=0 tx=0).stop 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 -- 172.21.15.80:0/4143719237 shutdown_connections 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 --2- 172.21.15.80:0/4143719237 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe8049250 0x7f2fe80069e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.889 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 --2- 172.21.15.80:0/4143719237 >> v2:172.21.15.87:3300/0 conn(0x7f2fe80e7600 0x7f2fe8050460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 -- 172.21.15.80:0/4143719237 >> 172.21.15.80:0/4143719237 conn(0x7f2fe8055c00 msgr2=0x7f2fe8056010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 -- 172.21.15.80:0/4143719237 shutdown_connections 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.859+0000 7f2ff53e9640 1 -- 172.21.15.80:0/4143719237 wait complete. 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.861+0000 7f2ff53e9640 1 Processor -- start 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.861+0000 7f2ff53e9640 1 -- start start 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fe8006f20 0x7f2fe80bd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.890 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 0x7f2fe80e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.862+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a80048070 con 0x7f0a8816b5e0 2024-04-16T15:36:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.862+0000 7f0a6ffff640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 0x7f0a7406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.862+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0a800aeb40 con 0x7f0a8816b5e0 2024-04-16T15:36:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f0a877fe640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 0x7f0a7406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f0a877fe640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 0x7f0a7406ee80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006fd0 tx=0x7f0a78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 0x7f2fe80e9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80e79e0 con 0x7f2fe80e7600 2024-04-16T15:36:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80515e0 con 0x7f2fe8006f20 2024-04-16T15:36:06.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2ff53e9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe80509a0 con 0x7f2fe8049250 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2fee7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 0x7f2fe80e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2fee7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 0x7f2fe80e9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58478/0 (socket says 172.21.15.80:58478) 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2fee7fc640 1 -- 172.21.15.80:0/245456690 learned_addr learned my addr 172.21.15.80:0/245456690 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2feeffd640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fe8006f20 0x7f2fe80bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f2fef7fe640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 0x7f2fe80e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 -- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 msgr2=0x7f2fe80e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 0x7f2fe80e9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 -- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fe8006f20 msgr2=0x7f2fe80bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fe8006f20 0x7f2fe80bd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 -- 172.21.15.80:0/245456690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe80c4f00 con 0x7f2fe80e7600 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fef7fe640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 0x7f2fe80e9540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b530 tx=0x7f2fe000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0014070 con 0x7f2fe80e7600 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.864+0000 7f2ff53e9640 1 -- 172.21.15.80:0/245456690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe80c51e0 con 0x7f2fe80e7600 2024-04-16T15:36:06.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f2ff53e9640 1 -- 172.21.15.80:0/245456690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80c57a0 con 0x7f2fe80e7600 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f466120c640 1 Processor -- start 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.863+0000 7f466120c640 1 -- start start 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f466120c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f465c0b1460 0x7f465c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f466120c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f465c0b4100 0x7f465c0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f466120c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c0cfbc0 con 0x7f465c162f50 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f466120c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f465c0d0c60 con 0x7f465c0b1460 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f466120c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f465c0b1e00 con 0x7f465c0b4100 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f465ad9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f465c162f50 0x7f465c0d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44530/0 (socket says 172.21.15.80:44530) 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f465ad9d640 1 -- 172.21.15.80:0/981593816 learned_addr learned my addr 172.21.15.80:0/981593816 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:06.896 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.865+0000 7f465b59e640 1 --2- 172.21.15.80:0/981593816 >> v2:172.21.15.87:3300/0 conn(0x7f465c0b4100 0x7f465c0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd4e00c7280 con 0x7fd4e00ce570 2024-04-16T15:36:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0010680 con 0x7f2fe80e7600 2024-04-16T15:36:06.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.867+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0014070 con 0x7f2fe80e7600 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7f465b59e640 1 -- 172.21.15.80:0/981593816 >> v2:172.21.15.80:3300/0 conn(0x7f465c0b1460 msgr2=0x7f465c0b18c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7f465b59e640 1 --2- 172.21.15.80:0/981593816 >> v2:172.21.15.80:3300/0 conn(0x7f465c0b1460 0x7f465c0b18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7f465b59e640 1 -- 172.21.15.80:0/981593816 >> v1:172.21.15.87:6789/0 conn(0x7f465c162f50 legacy=0x7f465c0d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.866+0000 7f465b59e640 1 -- 172.21.15.80:0/981593816 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c0cfea0 con 0x7f465c0b4100 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.867+0000 7f465b59e640 1 --2- 172.21.15.80:0/981593816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c0b4590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f465c0739e0 tx=0x7f464c02b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0cd71013c39f66d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.868+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd0005290 con 0x7f2fe80e7600 2024-04-16T15:36:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.868+0000 7f4659d9b640 1 -- 172.21.15.80:0/981593816 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c037070 con 0x7f465c0b4100 2024-04-16T15:36:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.868+0000 7f4659d9b640 1 -- 172.21.15.80:0/981593816 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c030710 con 0x7f465c0b4100 2024-04-16T15:36:06.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.868+0000 7f4659d9b640 1 -- 172.21.15.80:0/981593816 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c030ae0 con 0x7f465c0b4100 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 -- 172.21.15.80:0/981593816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 msgr2=0x7f465c0b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 --2- 172.21.15.80:0/981593816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c0b4590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f465c0739e0 tx=0x7f464c02b730 comp rx=0 tx=0).stop 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 -- 172.21.15.80:0/981593816 shutdown_connections 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 --2- 172.21.15.80:0/981593816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c0b4590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 --2- 172.21.15.80:0/981593816 >> v2:172.21.15.80:3300/0 conn(0x7f465c0b1460 0x7f465c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.869+0000 7f466120c640 1 -- 172.21.15.80:0/981593816 >> 172.21.15.80:0/981593816 conn(0x7f465c09aa70 msgr2=0x7f465c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.870+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fe0017070 con 0x7f2fe80e7600 2024-04-16T15:36:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.870+0000 7f2fd77fe640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 0x7f2fdc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.870+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2fe008bab0 con 0x7f2fe80e7600 2024-04-16T15:36:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.870+0000 7f2feeffd640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 0x7f2fdc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.871+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a8808bb00 con 0x7f0a8816b5e0 2024-04-16T15:36:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.871+0000 7f466120c640 1 -- 172.21.15.80:0/981593816 shutdown_connections 2024-04-16T15:36:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.875+0000 7f466120c640 1 -- 172.21.15.80:0/981593816 wait complete. 2024-04-16T15:36:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.877+0000 7f466120c640 1 Processor -- start 2024-04-16T15:36:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.877+0000 7f2feeffd640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 0x7f2fdc06efb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006fd0 tx=0x7f2fe4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2fe0059540 con 0x7f2fe80e7600 2024-04-16T15:36:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.877+0000 7f466120c640 1 -- start start 2024-04-16T15:36:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c0b1460 0x7f465c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465c162f50 0x7f465c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f465c0d0740 con 0x7f465c162f50 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f465c0d0460 con 0x7f465c0b4100 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.878+0000 7f466120c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f465c0cf890 con 0x7f465c0b1460 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39638/0 (socket says 172.21.15.80:39638) 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 -- 172.21.15.80:0/2249014412 learned_addr learned my addr 172.21.15.80:0/2249014412 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465b59e640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465c162f50 0x7f465c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 -- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c0b1460 msgr2=0x7f465c0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c0b1460 0x7f465c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 -- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465c162f50 msgr2=0x7f465c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465c162f50 0x7f465c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.879+0000 7f465a59c640 1 -- 172.21.15.80:0/2249014412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c0b00c0 con 0x7f465c0b4100 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.880+0000 7f465a59c640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f465400ba50 tx=0x7f465400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.882+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654019070 con 0x7f465c0b4100 2024-04-16T15:36:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.882+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465400cc20 con 0x7f465c0b4100 2024-04-16T15:36:06.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.883+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654014440 con 0x7f465c0b4100 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.884+0000 7f535064e640 1 Processor -- start 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.884+0000 7f535064e640 1 -- start start 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.885+0000 7f535064e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f534815b6c0 0x7f53480b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.885+0000 7f535064e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53480b0780 0x7f53480d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f534e3ea640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f534815b6c0 0x7f53480b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f534e3ea640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f534815b6c0 0x7f53480b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34870/0 (socket says 172.21.15.80:34870) 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f535064e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53480b3ed0 con 0x7f534806f5b0 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f534e3ea640 1 -- 172.21.15.80:0/127639424 learned_addr learned my addr 172.21.15.80:0/127639424 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f53480d0400 con 0x7f534815b6c0 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.886+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f53480cf550 con 0x7f53480b0780 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f534dbe9640 1 --2- 172.21.15.80:0/127639424 >> v2:172.21.15.87:3300/0 conn(0x7f53480b0780 0x7f53480d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f534e3ea640 1 -- 172.21.15.80:0/127639424 >> v2:172.21.15.87:3300/0 conn(0x7f53480b0780 msgr2=0x7f53480d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f534e3ea640 1 --2- 172.21.15.80:0/127639424 >> v2:172.21.15.87:3300/0 conn(0x7f53480b0780 0x7f53480d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f534e3ea640 1 -- 172.21.15.80:0/127639424 >> v1:172.21.15.87:6789/0 conn(0x7f534806f5b0 legacy=0x7f53480c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f534e3ea640 1 -- 172.21.15.80:0/127639424 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53480cf7f0 con 0x7f534815b6c0 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.888+0000 7f534e3ea640 1 --2- 172.21.15.80:0/127639424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480b3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f534815f050 tx=0x7f533802db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f165e8ecf1172a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f466120c640 1 -- 172.21.15.80:0/2249014412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c163870 con 0x7f465c0b4100 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.887+0000 7f466120c640 1 -- 172.21.15.80:0/2249014412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c163df0 con 0x7f465c0b4100 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.889+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f465401c070 con 0x7f465c0b4100 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.890+0000 7f46437fe640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 0x7f464806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.890+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f465408bad0 con 0x7f465c0b4100 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.892+0000 7f534d3e8640 1 -- 172.21.15.80:0/127639424 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533802f900 con 0x7f534815b6c0 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.892+0000 7f534d3e8640 1 -- 172.21.15.80:0/127639424 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533802faa0 con 0x7f534815b6c0 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.892+0000 7f534d3e8640 1 -- 172.21.15.80:0/127639424 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533802fe50 con 0x7f534815b6c0 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.893+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 msgr2=0x7f53480b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.893+0000 7f535064e640 1 --2- 172.21.15.80:0/127639424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480b3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f534815f050 tx=0x7f533802db40 comp rx=0 tx=0).stop 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 shutdown_connections 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f535064e640 1 --2- 172.21.15.80:0/127639424 >> v2:172.21.15.87:3300/0 conn(0x7f53480b0780 0x7f53480d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f535064e640 1 --2- 172.21.15.80:0/127639424 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480b3990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.892+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c04fd90 con 0x7f465c0b4100 2024-04-16T15:36:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f465ad9d640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 0x7f464806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 >> 172.21.15.80:0/127639424 conn(0x7f53480d13a0 msgr2=0x7f53480d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:06.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.894+0000 7f465ad9d640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 0x7f464806eeb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4650007fd0 tx=0x7f4650007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.895+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 shutdown_connections 2024-04-16T15:36:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.895+0000 7f535064e640 1 -- 172.21.15.80:0/127639424 wait complete. 2024-04-16T15:36:06.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.896+0000 7f535064e640 1 Processor -- start 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.897+0000 7f535064e640 1 -- start start 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f534806f5b0 0x7f5348153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 0x7f53480b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53480d0090 con 0x7f534815b6c0 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f53480cfdb0 con 0x7f53480b0780 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f535064e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f53480d0dd0 con 0x7f534806f5b0 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f534dbe9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 0x7f53480b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f534dbe9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 0x7f53480b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39668/0 (socket says 172.21.15.80:39668) 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f534dbe9640 1 -- 172.21.15.80:0/1256487991 learned_addr learned my addr 172.21.15.80:0/1256487991 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.898+0000 7f534ebeb640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 -- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f534806f5b0 msgr2=0x7f5348153320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f534806f5b0 0x7f5348153320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 -- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 msgr2=0x7f53480b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:06.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 0x7f53480b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 -- 172.21.15.80:0/1256487991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53480b4b50 con 0x7f534815b6c0 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.899+0000 7f534ebeb640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480cd950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f534400c410 tx=0x7f534400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.900+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344011790 con 0x7f534815b6c0 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.900+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46540595e0 con 0x7f465c0b4100 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.900+0000 7f535064e640 1 -- 172.21.15.80:0/1256487991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53480b4e30 con 0x7f534815b6c0 2024-04-16T15:36:06.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.900+0000 7f535064e640 1 -- 172.21.15.80:0/1256487991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53480b53f0 con 0x7f534815b6c0 2024-04-16T15:36:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.904+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344017070 con 0x7f534815b6c0 2024-04-16T15:36:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.904+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344011b70 con 0x7f534815b6c0 2024-04-16T15:36:06.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.906+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5330005290 con 0x7f534815b6c0 2024-04-16T15:36:06.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.916+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f534401c460 con 0x7f534815b6c0 2024-04-16T15:36:06.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.917+0000 7f533effd640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 0x7f532c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:06.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.917+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f534408bb40 con 0x7f534815b6c0 2024-04-16T15:36:06.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.917+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f534408f280 con 0x7f534815b6c0 2024-04-16T15:36:06.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.918+0000 7f534e3ea640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 0x7f532c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:06.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:06.929+0000 7f534e3ea640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 0x7f532c06ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5338038000 tx=0x7f5338008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:07.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.261+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fef840b42c0 con 0x7fef840ccdb0 2024-04-16T15:36:07.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.268+0000 7fef79ffb640 1 -- 172.21.15.80:0/2330600602 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fef7407b370 con 0x7fef840ccdb0 2024-04-16T15:36:07.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.268+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd4e004fd90 con 0x7fd4e00ce570 2024-04-16T15:36:07.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.269+0000 7fd4c7fff640 1 -- 172.21.15.80:0/2003613551 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4d000d290 con 0x7fd4e00ce570 2024-04-16T15:36:07.267 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-16T15:36:07.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.271+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f930c0b3920 con 0x7f930c15eac0 2024-04-16T15:36:07.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.272+0000 7f92f3fff640 1 -- 172.21.15.80:0/1719858183 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f930005a2a0 con 0x7f930c15eac0 2024-04-16T15:36:07.273 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-16T15:36:07.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 msgr2=0x7fd4cc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 0x7fd4cc06ee80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8037000 tx=0x7fd4d8032000 comp rx=0 tx=0).stop 2024-04-16T15:36:07.273 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 msgr2=0x7fd4e00b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 0x7fd4e00b2e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b390 tx=0x7fd4d000b790 comp rx=0 tx=0).stop 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 shutdown_connections 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e015ac30 0x7fd4e0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e00d0060 0x7fd4e015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4cc06c9c0 0x7fd4cc06ee80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 --2- 172.21.15.80:0/2003613551 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e00ce570 0x7fd4e00b2e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.274+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 >> 172.21.15.80:0/2003613551 conn(0x7fd4e0072ee0 msgr2=0x7fd4e006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.275+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 shutdown_connections 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.275+0000 7fd4e5df4640 1 -- 172.21.15.80:0/2003613551 wait complete. 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 msgr2=0x7fef6806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 0x7fef6806ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef8414de20 tx=0x7fef80008040 comp rx=0 tx=0).stop 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 msgr2=0x7fef84156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef7400dbc0 tx=0x7fef74004730 comp rx=0 tx=0).stop 2024-04-16T15:36:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 msgr2=0x7f92f806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 0x7f92f806ee80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f930c204c10 tx=0x7f93040083d0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 msgr2=0x7f930c0c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.276 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f930000e8a0 tx=0x7f930000ed60 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 shutdown_connections 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef6806c9c0 0x7fef6806ee80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef840ccdb0 0x7fef84156850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef840b3510 0x7fef841f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 --2- 172.21.15.80:0/2330600602 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef8406f030 0x7fef8414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 >> 172.21.15.80:0/2330600602 conn(0x7fef84067940 msgr2=0x7fef8415c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 shutdown_connections 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f92f806c9c0 0x7f92f806ee80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f930c15fbb0 0x7f930c0c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f930c15f010 0x7f930c1f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 --2- 172.21.15.80:0/1719858183 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f930c15eac0 0x7f930c0c6f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 >> 172.21.15.80:0/1719858183 conn(0x7f930c0b2e00 msgr2=0x7f930c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 shutdown_connections 2024-04-16T15:36:07.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 shutdown_connections 2024-04-16T15:36:07.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.277+0000 7fef8b4c5640 1 -- 172.21.15.80:0/2330600602 wait complete. 2024-04-16T15:36:07.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.278+0000 7f9311fc8640 1 -- 172.21.15.80:0/1719858183 wait complete. 2024-04-16T15:36:07.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2024-04-16T15:36:07.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2024-04-16T15:36:07.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2024-04-16T15:36:07.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.308+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2fd0005850 con 0x7f2fe80e7600 2024-04-16T15:36:07.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.308+0000 7f2fd77fe640 1 -- 172.21.15.80:0/245456690 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2fe005d840 con 0x7f2fe80e7600 2024-04-16T15:36:07.307 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 msgr2=0x7f2fdc06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 0x7f2fdc06efb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006fd0 tx=0x7f2fe4008040 comp rx=0 tx=0).stop 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 msgr2=0x7f2fe80e9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 0x7f2fe80e9540 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b530 tx=0x7f2fe000b9f0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 shutdown_connections 2024-04-16T15:36:07.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.310+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2fe80e7600 0x7f2fe80e9540 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2fdc06caf0 0x7f2fdc06efb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2fe8049250 0x7f2fe80e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 --2- 172.21.15.80:0/245456690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2fe8006f20 0x7f2fe80bd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 >> 172.21.15.80:0/245456690 conn(0x7f2fe8055c00 msgr2=0x7f2fe8103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 shutdown_connections 2024-04-16T15:36:07.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.311+0000 7f2fd57fa640 1 -- 172.21.15.80:0/245456690 wait complete. 2024-04-16T15:36:07.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2024-04-16T15:36:07.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.344+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f465c164030 con 0x7f465c0b4100 2024-04-16T15:36:07.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.345+0000 7f46437fe640 1 -- 172.21.15.80:0/2249014412 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f465405d8e0 con 0x7f465c0b4100 2024-04-16T15:36:07.343 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 msgr2=0x7f464806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 0x7f464806eeb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4650007fd0 tx=0x7f4650007980 comp rx=0 tx=0).stop 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 msgr2=0x7f465c163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f465400ba50 tx=0x7f465400bf10 comp rx=0 tx=0).stop 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 shutdown_connections 2024-04-16T15:36:07.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f465c162f50 0x7f465c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c0b4100 0x7f465c163330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f464806c9f0 0x7f464806eeb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 --2- 172.21.15.80:0/2249014412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f465c0b1460 0x7f465c0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 >> 172.21.15.80:0/2249014412 conn(0x7f465c09aa70 msgr2=0x7f465c1520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 shutdown_connections 2024-04-16T15:36:07.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.347+0000 7f46417fa640 1 -- 172.21.15.80:0/2249014412 wait complete. 2024-04-16T15:36:07.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2024-04-16T15:36:07.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.378+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0a880cd280 con 0x7f0a8816b5e0 2024-04-16T15:36:07.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.378+0000 7f0a6ffff640 1 -- 172.21.15.80:0/2996767220 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a880cd280 con 0x7f0a8816b5e0 2024-04-16T15:36:07.377 INFO:teuthology.orchestra.run.smithi080.stdout:55834574856 2024-04-16T15:36:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 msgr2=0x7f0a7406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 0x7f0a7406ee80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006fd0 tx=0x7f0a78008040 comp rx=0 tx=0).stop 2024-04-16T15:36:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 msgr2=0x7f0a8816d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 0x7f0a8816d470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0a80037000 tx=0x7f0a80004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 shutdown_connections 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0a7406c9c0 0x7f0a7406ee80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0a8816b5e0 0x7f0a8816d470 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0a88071dd0 0x7f0a880a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 --2- 172.21.15.80:0/2996767220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a8806de30 0x7f0a881669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 >> 172.21.15.80:0/2996767220 conn(0x7f0a88067940 msgr2=0x7f0a88074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 shutdown_connections 2024-04-16T15:36:07.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.382+0000 7f0a6dffb640 1 -- 172.21.15.80:0/2996767220 wait complete. 2024-04-16T15:36:07.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.393+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5330005580 con 0x7f534815b6c0 2024-04-16T15:36:07.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.393+0000 7f533effd640 1 -- 172.21.15.80:0/1256487991 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5344089e20 con 0x7f534815b6c0 2024-04-16T15:36:07.391 INFO:teuthology.orchestra.run.smithi080.stdout:55834574855 2024-04-16T15:36:07.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.1 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 msgr2=0x7f532c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 0x7f532c06ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5338038000 tx=0x7f5338008030 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 msgr2=0x7f53480cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480cd950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f534400c410 tx=0x7f534400c8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 shutdown_connections 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f534815b6c0 0x7f53480cd950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53480b0780 0x7f53480b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f532c06c9c0 0x7f532c06ee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 --2- 172.21.15.80:0/1256487991 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f534806f5b0 0x7f5348153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 >> 172.21.15.80:0/1256487991 conn(0x7f53480d13a0 msgr2=0x7f53480b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 shutdown_connections 2024-04-16T15:36:07.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.395+0000 7f533cff9640 1 -- 172.21.15.80:0/1256487991 wait complete. 2024-04-16T15:36:07.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.398+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3e2406f530 con 0x7f3e2416eaf0 2024-04-16T15:36:07.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.399+0000 7f3e20ff9640 1 -- 172.21.15.80:0/99769287 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e1c07d110 con 0x7f3e2416eaf0 2024-04-16T15:36:07.398 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:07.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 msgr2=0x7f3e1006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 0x7f3e1006eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e24172350 tx=0x7f3e18006b50 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 msgr2=0x7f3e240cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c034ac0 tx=0x7f3e1c004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 shutdown_connections 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e2416eaf0 0x7f3e240cca00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e1006c9f0 0x7f3e1006eeb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e240b32d0 0x7f3e24215200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 --2- 172.21.15.80:0/99769287 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e240735f0 0x7f3e240aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 >> 172.21.15.80:0/99769287 conn(0x7f3e240b57c0 msgr2=0x7f3e2416e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 shutdown_connections 2024-04-16T15:36:07.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:07.401+0000 7f3e297d5640 1 -- 172.21.15.80:0/99769287 wait complete. 2024-04-16T15:36:07.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2024-04-16T15:36:07.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-16T15:36:08.293 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T15:36:08.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T15:36:08.297 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T15:36:08.321 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T15:36:08.362 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T15:36:08.393 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T15:36:08.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T15:36:08.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T15:36:08.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.418+0000 7f7166a4a640 1 Processor -- start 2024-04-16T15:36:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.418+0000 7f7166a4a640 1 -- start start 2024-04-16T15:36:08.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7166a4a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71600cd9f0 0x7f71601665c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7166a4a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716015bd50 con 0x7f716006f650 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7166a4a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716015c030 con 0x7f7160145020 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7166a4a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f716015c310 con 0x7f71600cd9f0 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7164fe7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71600cd9f0 0x7f71601665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7164fe7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f71600cd9f0 0x7f71601665c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34890/0 (socket says 172.21.15.80:34890) 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.419+0000 7f7164fe7640 1 -- 172.21.15.80:0/2092003067 learned_addr learned my addr 172.21.15.80:0/2092003067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.420+0000 7f7164fe7640 1 -- 172.21.15.80:0/2092003067 >> v1:172.21.15.87:6789/0 conn(0x7f7160145020 legacy=0x7f716006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.420+0000 7f7164fe7640 1 -- 172.21.15.80:0/2092003067 >> v1:172.21.15.80:6789/0 conn(0x7f716006f650 legacy=0x7f71600cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.420+0000 7f7164fe7640 1 -- 172.21.15.80:0/2092003067 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716015c5f0 con 0x7f71600cd9f0 2024-04-16T15:36:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.421+0000 7f7164fe7640 1 --2- 172.21.15.80:0/2092003067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71600cd9f0 0x7f71601665c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7158009e50 tx=0x7f7158030420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed30a2a8735631d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.422+0000 7f715effd640 1 -- 172.21.15.80:0/2092003067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715803c070 con 0x7f71600cd9f0 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.422+0000 7f715effd640 1 -- 172.21.15.80:0/2092003067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7158037600 con 0x7f71600cd9f0 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.422+0000 7f715effd640 1 -- 172.21.15.80:0/2092003067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71580379d0 con 0x7f71600cd9f0 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.423+0000 7f7166a4a640 1 -- 172.21.15.80:0/2092003067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71600cd9f0 msgr2=0x7f71601665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.423+0000 7f7166a4a640 1 --2- 172.21.15.80:0/2092003067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71600cd9f0 0x7f71601665c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7158009e50 tx=0x7f7158030420 comp rx=0 tx=0).stop 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.424+0000 7f7166a4a640 1 -- 172.21.15.80:0/2092003067 shutdown_connections 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.424+0000 7f7166a4a640 1 --2- 172.21.15.80:0/2092003067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f71600cd9f0 0x7f71601665c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.424+0000 7f7166a4a640 1 -- 172.21.15.80:0/2092003067 >> 172.21.15.80:0/2092003067 conn(0x7f7160067d90 msgr2=0x7f716006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.424+0000 7f7166a4a640 1 -- 172.21.15.80:0/2092003067 shutdown_connections 2024-04-16T15:36:08.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.424+0000 7f7166a4a640 1 -- 172.21.15.80:0/2092003067 wait complete. 2024-04-16T15:36:08.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.426+0000 7f7166a4a640 1 Processor -- start 2024-04-16T15:36:08.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.426+0000 7f7166a4a640 1 -- start start 2024-04-16T15:36:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f716006f650 0x7f7160140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160145020 0x7f71601570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f716006dfb0 con 0x7f7160145020 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f716006de30 con 0x7f716006f650 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7166a4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f716006e130 con 0x7f71600cd9f0 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f715f7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f715f7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58500/0 (socket says 172.21.15.80:58500) 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f715f7fe640 1 -- 172.21.15.80:0/2446956365 learned_addr learned my addr 172.21.15.80:0/2446956365 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.428+0000 7f7164fe7640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160145020 0x7f71601570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 -- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f716006f650 msgr2=0x7f7160140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f716006f650 0x7f7160140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 -- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160145020 msgr2=0x7f71601570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160145020 0x7f71601570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 -- 172.21.15.80:0/2446956365 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716013a420 con 0x7f71600cd9f0 2024-04-16T15:36:08.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715f7fe640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f715400c480 tx=0x7f715400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71540052d0 con 0x7f71600cd9f0 2024-04-16T15:36:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.429+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7154005470 con 0x7f71600cd9f0 2024-04-16T15:36:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.430+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154012850 con 0x7f71600cd9f0 2024-04-16T15:36:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.430+0000 7f7166a4a640 1 -- 172.21.15.80:0/2446956365 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716013a700 con 0x7f71600cd9f0 2024-04-16T15:36:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.430+0000 7f7166a4a640 1 -- 172.21.15.80:0/2446956365 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f716013acc0 con 0x7f71600cd9f0 2024-04-16T15:36:08.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.433+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71540129f0 con 0x7f71600cd9f0 2024-04-16T15:36:08.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.433+0000 7f715cff9640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 0x7f714c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.434+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f715408b9f0 con 0x7f71600cd9f0 2024-04-16T15:36:08.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.434+0000 7f715ffff640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 0x7f714c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.435+0000 7f715ffff640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 0x7f714c06ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7160140de0 tx=0x7f7150007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.435+0000 7f7166a4a640 1 -- 172.21.15.80:0/2446956365 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71600ceea0 con 0x7f71600cd9f0 2024-04-16T15:36:08.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.441+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71600ceea0 con 0x7f71600cd9f0 2024-04-16T15:36:08.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.474+0000 7fc71d80d640 1 Processor -- start 2024-04-16T15:36:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.474+0000 7fc71d80d640 1 -- start start 2024-04-16T15:36:08.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7f7495558640 1 Processor -- start 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc71d80d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc718067d50 0x7fc7180ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc71d80d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71806de30 con 0x7fc71806e5f0 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc71d80d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180b5350 con 0x7fc71806f030 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc71d80d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc7180b5110 con 0x7fc718067d50 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc716ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc718067d50 0x7fc7180ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc716ffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc718067d50 0x7fc7180ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34912/0 (socket says 172.21.15.80:34912) 2024-04-16T15:36:08.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7fc716ffd640 1 -- 172.21.15.80:0/1920156024 learned_addr learned my addr 172.21.15.80:0/1920156024 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.475+0000 7f7495558640 1 -- start start 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 0x7f74900737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f749015b890 0x7f7490154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74900b3b90 0x7f74900b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f74900b4540 con 0x7f74900b3b90 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f74900d0bd0 con 0x7f7490072030 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7f7495558640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7490155270 con 0x7f749015b890 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.477+0000 7f7494d57640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74900b3b90 0x7f74900b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.477+0000 7f7494d57640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f74900b3b90 0x7f74900b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34924/0 (socket says 172.21.15.80:34924) 2024-04-16T15:36:08.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.477+0000 7f7494d57640 1 -- 172.21.15.80:0/2681208030 learned_addr learned my addr 172.21.15.80:0/2681208030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7fc716ffd640 1 -- 172.21.15.80:0/1920156024 >> v1:172.21.15.87:6789/0 conn(0x7fc71806f030 legacy=0x7fc71815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f748f7fe640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f749015b890 0x7f7490154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7fc716ffd640 1 -- 172.21.15.80:0/1920156024 >> v1:172.21.15.80:6789/0 conn(0x7fc71806e5f0 legacy=0x7fc7180b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f7494d57640 1 -- 172.21.15.80:0/2681208030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f749015b890 msgr2=0x7f7490154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.476+0000 7fc716ffd640 1 -- 172.21.15.80:0/1920156024 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180b5630 con 0x7fc718067d50 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f7494d57640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f749015b890 0x7f7490154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f748ffff640 1 --2- 172.21.15.80:0/2681208030 >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 0x7f74900737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f7494d57640 1 -- 172.21.15.80:0/2681208030 >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 msgr2=0x7f74900737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f7494d57640 1 --2- 172.21.15.80:0/2681208030 >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 0x7f74900737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f7494d57640 1 -- 172.21.15.80:0/2681208030 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749015bd10 con 0x7f74900b3b90 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.478+0000 7f748ffff640 1 --2- 172.21.15.80:0/2681208030 >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 0x7f74900737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:08.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.480+0000 7fc716ffd640 1 --2- 172.21.15.80:0/1920156024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc718067d50 0x7fc7180ccd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097f0 tx=0x7fc70802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fac243d5e4fad12 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.480+0000 7f7494d57640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74900b3b90 0x7f74900b4000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f74900b2e40 tx=0x7f748402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff71609ddb3a9fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.480+0000 7fc715ffb640 1 -- 172.21.15.80:0/1920156024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708038070 con 0x7fc718067d50 2024-04-16T15:36:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.480+0000 7fc715ffb640 1 -- 172.21.15.80:0/1920156024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708031740 con 0x7fc718067d50 2024-04-16T15:36:08.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.480+0000 7fc715ffb640 1 -- 172.21.15.80:0/1920156024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70802f050 con 0x7fc718067d50 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.481+0000 7efc119bd640 1 Processor -- start 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.481+0000 7efc119bd640 1 -- start start 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.481+0000 7fc71d80d640 1 -- 172.21.15.80:0/1920156024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc718067d50 msgr2=0x7fc7180ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.481+0000 7fc71d80d640 1 --2- 172.21.15.80:0/1920156024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc718067d50 0x7fc7180ccd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097f0 tx=0x7fc70802b7e0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7fc71d80d640 1 -- 172.21.15.80:0/1920156024 shutdown_connections 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7fc71d80d640 1 --2- 172.21.15.80:0/1920156024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc718067d50 0x7fc7180ccd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7fc71d80d640 1 -- 172.21.15.80:0/1920156024 >> 172.21.15.80:0/1920156024 conn(0x7fc718067940 msgr2=0x7fc71806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7f748effd640 1 -- 172.21.15.80:0/2681208030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484034070 con 0x7f74900b3b90 2024-04-16T15:36:08.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7f748effd640 1 -- 172.21.15.80:0/2681208030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7484030860 con 0x7f74900b3b90 2024-04-16T15:36:08.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7f748effd640 1 -- 172.21.15.80:0/2681208030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484030c30 con 0x7f74900b3b90 2024-04-16T15:36:08.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7fc71d80d640 1 -- 172.21.15.80:0/1920156024 shutdown_connections 2024-04-16T15:36:08.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7fc71d80d640 1 -- 172.21.15.80:0/1920156024 wait complete. 2024-04-16T15:36:08.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7efc119bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efc0c06d910 0x7efc0c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.483 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7efc119bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c0d3630 con 0x7efc0c162f70 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7efc119bd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c0d3910 con 0x7efc0c09c630 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.482+0000 7efc119bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efc0c06cfd0 con 0x7efc0c06d910 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7efc0affd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efc0c162f70 0x7efc0c06d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33986/0 (socket says 172.21.15.80:33986) 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7efc0affd640 1 -- 172.21.15.80:0/160575292 learned_addr learned my addr 172.21.15.80:0/160575292 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374232386 0 0) 0x7efc0c0d3630 con 0x7efc0c162f70 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf8003520 con 0x7efc0c162f70 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7f7495558640 1 -- 172.21.15.80:0/2681208030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74900b3b90 msgr2=0x7f74900b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.483+0000 7f7495558640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74900b3b90 0x7f74900b4000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f74900b2e40 tx=0x7f748402b9a0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7fc71d80d640 1 Processor -- start 2024-04-16T15:36:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc027fc640 1 --2- 172.21.15.80:0/160575292 >> v2:172.21.15.87:3300/0 conn(0x7efc0c06d910 0x7efc0c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7fc71d80d640 1 -- start start 2024-04-16T15:36:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213722332 0 0) 0x7efc0c0d3910 con 0x7efc0c09c630 2024-04-16T15:36:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc0c0d3630 con 0x7efc0c09c630 2024-04-16T15:36:08.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1062196059 0 0) 0x7efbf8003520 con 0x7efc0c162f70 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 >> v2:172.21.15.87:3300/0 conn(0x7efc0c06d910 msgr2=0x7efc0c06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 --2- 172.21.15.80:0/160575292 >> v2:172.21.15.87:3300/0 conn(0x7efc0c06d910 0x7efc0c06ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 >> v1:172.21.15.87:6789/0 conn(0x7efc0c09c630 legacy=0x7efc0c0b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c0d3bf0 con 0x7efc0c162f70 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7efbf40015f0 con 0x7efc0c162f70 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 >> v1:172.21.15.80:6789/0 conn(0x7efc0c162f70 legacy=0x7efc0c06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8003b40 0x7efbf8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efbf8004800 0x7efbf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0affd640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8003b40 0x7efbf8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.485+0000 7efc027fc640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efbf8004800 0x7efbf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.484+0000 7efc0a7fc640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efbf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.485+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c06cfd0 con 0x7efbf8003b40 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.485+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efbf800c040 con 0x7efbf80051c0 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.485+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efbf800c240 con 0x7efbf8004800 2024-04-16T15:36:08.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.485+0000 7efc0b7fe640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efbf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7f7495558640 1 -- 172.21.15.80:0/2681208030 shutdown_connections 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7f7495558640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74900b3b90 0x7f74900b4000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7f7495558640 1 --2- 172.21.15.80:0/2681208030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f749015b890 0x7f7490154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7f7495558640 1 --2- 172.21.15.80:0/2681208030 >> v2:172.21.15.87:3300/0 conn(0x7f7490072030 0x7f74900737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7f7495558640 1 -- 172.21.15.80:0/2681208030 >> 172.21.15.80:0/2681208030 conn(0x7f74900b57c0 msgr2=0x7f7490072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc71d80d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7efc0b7fe640 1 -- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efbf8004800 msgr2=0x7efbf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7efc0b7fe640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efbf8004800 0x7efbf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc71d80d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71806e5f0 0x7fc718205440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7efc0b7fe640 1 -- 172.21.15.80:0/160575292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8003b40 msgr2=0x7efbf8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7efc0b7fe640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efbf8003b40 0x7efbf8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7efc0b7fe640 1 -- 172.21.15.80:0/160575292 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c0d3bf0 con 0x7efbf80051c0 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc716ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc716ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58536/0 (socket says 172.21.15.80:58536) 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc716ffd640 1 -- 172.21.15.80:0/3582095738 learned_addr learned my addr 172.21.15.80:0/3582095738 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 0x7fc71815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.486+0000 7fc7167fc640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71806e5f0 0x7fc718205440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180b3c20 con 0x7fc71806f030 2024-04-16T15:36:08.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7f7495558640 1 -- 172.21.15.80:0/2681208030 shutdown_connections 2024-04-16T15:36:08.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc71806e0d0 con 0x7fc71806e5f0 2024-04-16T15:36:08.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180b3da0 con 0x7fc718067d50 2024-04-16T15:36:08.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7efc0b7fe640 1 -- 172.21.15.80:0/160575292 reap_dead start 2024-04-16T15:36:08.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7efc0b7fe640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efbf800b9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc04001fd0 tx=0x7efbf8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977a1bfdc5a17858 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7f7495558640 1 -- 172.21.15.80:0/2681208030 wait complete. 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc716ffd640 1 -- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71806e5f0 msgr2=0x7fc718205440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc716ffd640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71806e5f0 0x7fc718205440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc716ffd640 1 -- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 msgr2=0x7fc71815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc7177fe640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 0x7fc71815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04001bf0 con 0x7efbf80051c0 2024-04-16T15:36:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc716ffd640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 0x7fc71815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.487+0000 7fc716ffd640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc718202b70 con 0x7fc718067d50 2024-04-16T15:36:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc04003b70 con 0x7efbf80051c0 2024-04-16T15:36:08.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7fc7177fe640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 0x7fc71815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7efc0a7fc640 1 -- 172.21.15.80:0/160575292 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040050d0 con 0x7efbf80051c0 2024-04-16T15:36:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7fc716ffd640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097f0 tx=0x7fc7080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7f7495558640 1 Processor -- start 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.488+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708043070 con 0x7fc718067d50 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708033980 con 0x7fc718067d50 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708038040 con 0x7fc718067d50 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc718202de0 con 0x7fc718067d50 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71815da50 con 0x7fc718067d50 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7efc119bd640 1 -- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 msgr2=0x7efbf800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7efc119bd640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efbf800b9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efc04001fd0 tx=0x7efbf8005830 comp rx=0 tx=0).stop 2024-04-16T15:36:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7efc119bd640 1 -- 172.21.15.80:0/160575292 shutdown_connections 2024-04-16T15:36:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7efc119bd640 1 --2- 172.21.15.80:0/160575292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efbf800b9c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7efc119bd640 1 -- 172.21.15.80:0/160575292 >> 172.21.15.80:0/160575292 conn(0x7efc0c0d46b0 msgr2=0x7efc0c0d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.489+0000 7f7495558640 1 -- start start 2024-04-16T15:36:08.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.490+0000 7efc119bd640 1 -- 172.21.15.80:0/160575292 shutdown_connections 2024-04-16T15:36:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.490+0000 7f7495558640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7490072030 0x7f74900ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.490+0000 7f7495558640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 0x7f74900ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.490+0000 7f7495558640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7494d57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7494d57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34958/0 (socket says 172.21.15.80:34958) 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7494d57640 1 -- 172.21.15.80:0/2370658260 learned_addr learned my addr 172.21.15.80:0/2370658260 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f74900d0580 con 0x7f749015b890 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f74900d02a0 con 0x7f74900b3b90 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f74900d0860 con 0x7f7490072030 2024-04-16T15:36:08.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc708046070 con 0x7fc718067d50 2024-04-16T15:36:08.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f748ffff640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7490072030 0x7f74900ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.491+0000 7f748f7fe640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 0x7f74900ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7fc6fffff640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 0x7fc70406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc7080adaf0 con 0x7fc718067d50 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7fc7167fc640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 0x7fc70406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f748f7fe640 1 -- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7490072030 msgr2=0x7f74900ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f748f7fe640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7490072030 0x7f74900ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f748f7fe640 1 -- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 msgr2=0x7f7490099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f748f7fe640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f748f7fe640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74900af720 con 0x7f74900b3b90 2024-04-16T15:36:08.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7f7494d57640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.492+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc718159d60 con 0x7fc718067d50 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f748f7fe640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 0x7f74900ae710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f748000d550 tx=0x7f748000da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74800125f0 con 0x7f74900b3b90 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7480019070 con 0x7f74900b3b90 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74800129b0 con 0x7f74900b3b90 2024-04-16T15:36:08.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7fc7167fc640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 0x7fc70406ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc718204e60 tx=0x7fc710009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749013d230 con 0x7f74900b3b90 2024-04-16T15:36:08.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74901fa4a0 con 0x7f74900b3b90 2024-04-16T15:36:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.493+0000 7efc119bd640 1 -- 172.21.15.80:0/160575292 wait complete. 2024-04-16T15:36:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.495+0000 7efc119bd640 1 Processor -- start 2024-04-16T15:36:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.495+0000 7efc119bd640 1 -- start start 2024-04-16T15:36:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.495+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749004fd90 con 0x7f74900b3b90 2024-04-16T15:36:08.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7480012b50 con 0x7f74900b3b90 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc0c165ff0 0x7efc0c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0c0c9f80 0x7efc0c1f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c163350 con 0x7efc0c0c9f80 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c0b7cb0 con 0x7efbf80051c0 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7efc119bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c0d32e0 con 0x7efc0c165ff0 2024-04-16T15:36:08.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7f748cff9640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 0x7f747c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39722/0 (socket says 172.21.15.80:39722) 2024-04-16T15:36:08.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 -- 172.21.15.80:0/1582718851 learned_addr learned my addr 172.21.15.80:0/1582718851 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0b7fe640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0c0c9f80 0x7efc0c1f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc027fc640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc0c165ff0 0x7efc0c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 -- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc0c165ff0 msgr2=0x7efc0c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc0c165ff0 0x7efc0c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 -- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0c0c9f80 msgr2=0x7efc0c1f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0c0c9f80 0x7efc0c1f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 -- 172.21.15.80:0/1582718851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c166470 con 0x7efbf80051c0 2024-04-16T15:36:08.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.496+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f748008be90 con 0x7f74900b3b90 2024-04-16T15:36:08.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7f748ffff640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 0x7f747c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.497+0000 7efc0affd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e750 tx=0x7efbf400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.498+0000 7f748ffff640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 0x7f747c06ee30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7488007130 tx=0x7f74880077c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.498+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc718159d60 con 0x7fc718067d50 2024-04-16T15:36:08.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.501+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74900af720 con 0x7f74900b3b90 2024-04-16T15:36:08.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.502+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400ee60 con 0x7efbf80051c0 2024-04-16T15:36:08.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.502+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4018070 con 0x7efbf80051c0 2024-04-16T15:36:08.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.503+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400cab0 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.503+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c1f92f0 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.503+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c1638e0 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.505+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c069150 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.507+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efbf400cc50 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.507+0000 7efc08ff9640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 0x7efbec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.507+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efbf408c770 con 0x7efbf80051c0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.508+0000 7efc027fc640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 0x7efbec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.509+0000 7efc027fc640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 0x7efbec06ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0cb730 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.514 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.510+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efbf405a990 con 0x7efbf80051c0 2024-04-16T15:36:08.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.548+0000 7f669c80c640 1 Processor -- start 2024-04-16T15:36:08.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.548+0000 7f669c80c640 1 -- start start 2024-04-16T15:36:08.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669c80c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669c80c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669815bdb0 con 0x7f66980b3510 2024-04-16T15:36:08.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669c80c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669806de30 con 0x7f669806f030 2024-04-16T15:36:08.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669c80c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f66980b5110 con 0x7f66980ccdb0 2024-04-16T15:36:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669659c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669659c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58562/0 (socket says 172.21.15.80:58562) 2024-04-16T15:36:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.550+0000 7f669659c640 1 -- 172.21.15.80:0/1878483315 learned_addr learned my addr 172.21.15.80:0/1878483315 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.551+0000 7f669659c640 1 -- 172.21.15.80:0/1878483315 >> v1:172.21.15.87:6789/0 conn(0x7f669806f030 legacy=0x7f669806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.560+0000 7f669659c640 1 -- 172.21.15.80:0/1878483315 >> v1:172.21.15.80:6789/0 conn(0x7f66980b3510 legacy=0x7f6698071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.560+0000 7f669659c640 1 -- 172.21.15.80:0/1878483315 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980b5350 con 0x7f66980ccdb0 2024-04-16T15:36:08.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.561+0000 7f669659c640 1 --2- 172.21.15.80:0/1878483315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f66880088d0 tx=0x7f668802de70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6d19b31fb0a940 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.561+0000 7f669559a640 1 -- 172.21.15.80:0/1878483315 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688034070 con 0x7f66980ccdb0 2024-04-16T15:36:08.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.562+0000 7f669559a640 1 -- 172.21.15.80:0/1878483315 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668802eba0 con 0x7f66980ccdb0 2024-04-16T15:36:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 -- 172.21.15.80:0/1878483315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 msgr2=0x7f669815b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 --2- 172.21.15.80:0/1878483315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f66880088d0 tx=0x7f668802de70 comp rx=0 tx=0).stop 2024-04-16T15:36:08.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 -- 172.21.15.80:0/1878483315 shutdown_connections 2024-04-16T15:36:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 --2- 172.21.15.80:0/1878483315 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669815b870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 -- 172.21.15.80:0/1878483315 >> 172.21.15.80:0/1878483315 conn(0x7f6698067940 msgr2=0x7f669806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.562 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 -- 172.21.15.80:0/1878483315 shutdown_connections 2024-04-16T15:36:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.563+0000 7f669c80c640 1 -- 172.21.15.80:0/1878483315 wait complete. 2024-04-16T15:36:08.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.565+0000 7f669c80c640 1 Processor -- start 2024-04-16T15:36:08.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.566+0000 7f669c80c640 1 -- start start 2024-04-16T15:36:08.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.567+0000 7f669c80c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 0x7f66981e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.567+0000 7f669c80c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669c80c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f6695d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f6695d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34970/0 (socket says 172.21.15.80:34970) 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 0x7f66981e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 0x7f66981e3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:39736/0 (socket says 172.21.15.80:39736) 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f6695d9b640 1 -- 172.21.15.80:0/336962839 learned_addr learned my addr 172.21.15.80:0/336962839 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f669806e0d0 con 0x7f66980b3510 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f66980b5910 con 0x7f669806f030 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f669806ed00 con 0x7f66980ccdb0 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.568+0000 7f6696d9d640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 -- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 msgr2=0x7f669814bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669814bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 -- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 msgr2=0x7f66981e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 0x7f66981e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981e35c0 con 0x7f66980b3510 2024-04-16T15:36:08.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.569+0000 7f6695d9b640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f669000cb20 tx=0x7f6690002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.571+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690017070 con 0x7f66980b3510 2024-04-16T15:36:08.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.571+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6690003da0 con 0x7f66980b3510 2024-04-16T15:36:08.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.571+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669000a900 con 0x7f66980b3510 2024-04-16T15:36:08.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.571+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66980afd00 con 0x7f66980b3510 2024-04-16T15:36:08.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.571+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66981f95c0 con 0x7f66980b3510 2024-04-16T15:36:08.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.573+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f667c005290 con 0x7f66980b3510 2024-04-16T15:36:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.578+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f669001a070 con 0x7f66980b3510 2024-04-16T15:36:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.578+0000 7f6686ffd640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 0x7f667806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.579+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f669008be40 con 0x7f66980b3510 2024-04-16T15:36:08.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.579+0000 7f669659c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 0x7f667806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.580+0000 7f669659c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 0x7f667806ee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6688039000 tx=0x7f668800a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.585+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66900598c0 con 0x7f66980b3510 2024-04-16T15:36:08.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.591+0000 7f61ff59e640 1 Processor -- start 2024-04-16T15:36:08.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.592+0000 7f61ff59e640 1 -- start start 2024-04-16T15:36:08.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f2e19c57640 1 Processor -- start 2024-04-16T15:36:08.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f2e19c57640 1 -- start start 2024-04-16T15:36:08.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e19c57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2e1406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e19c57640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2e1406d010 0x7f2e140d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e19c57640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e140d5510 con 0x7f2e140b3b00 2024-04-16T15:36:08.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e19c57640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2e140cfe00 con 0x7f2e1406d010 2024-04-16T15:36:08.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61ff59e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 0x7f620009b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61ff59e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62000d2e60 0x7f62000cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61ff59e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62000b3cc0 con 0x7f620009ace0 2024-04-16T15:36:08.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61ff59e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f62000b3700 con 0x7f62000d2e60 2024-04-16T15:36:08.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61ff59e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f62000b39e0 con 0x7f62000d1280 2024-04-16T15:36:08.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61fdd9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 0x7f620009b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61fdd9b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 0x7f620009b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58572/0 (socket says 172.21.15.80:58572) 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61fdd9b640 1 -- 172.21.15.80:0/715529211 learned_addr learned my addr 172.21.15.80:0/715529211 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.594+0000 7f61fed9d640 1 --2- 172.21.15.80:0/715529211 >> v2:172.21.15.87:3300/0 conn(0x7f62000d2e60 0x7f62000cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f61fed9d640 1 -- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 msgr2=0x7f620009b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f61fed9d640 1 --2- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 0x7f620009b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f61fed9d640 1 -- 172.21.15.80:0/715529211 >> v1:172.21.15.87:6789/0 conn(0x7f620009ace0 legacy=0x7f620015f860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f61fed9d640 1 -- 172.21.15.80:0/715529211 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62000d0d60 con 0x7f62000d2e60 2024-04-16T15:36:08.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e19c57640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2e140b3ee0 con 0x7f2e140d4dc0 2024-04-16T15:36:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f61fed9d640 1 --2- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62000d2e60 0x7f62000cd000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009d90 tx=0x7f61f802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4ee413038466a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e137fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2e140b3b00 0x7f2e140d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44592/0 (socket says 172.21.15.80:44592) 2024-04-16T15:36:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.595+0000 7f2e137fe640 1 -- 172.21.15.80:0/4230556636 learned_addr learned my addr 172.21.15.80:0/4230556636 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:08.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f61fd59a640 1 -- 172.21.15.80:0/715529211 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8039070 con 0x7f62000d2e60 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e13fff640 1 --2- 172.21.15.80:0/4230556636 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406d010 0x7f2e140d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e12ffd640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2e1406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127632662 0 0) 0x7f2e140d5510 con 0x7f2e140b3b00 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dfc003520 con 0x7f2e140b3b00 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.1 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2944218056 0 0) 0x7f2dfc003520 con 0x7f2e140b3b00 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 msgr2=0x7f2e1406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2e1406cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406d010 msgr2=0x7f2e140d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 --2- 172.21.15.80:0/4230556636 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406d010 0x7f2e140d2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140d5240 con 0x7f2e140b3b00 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.1 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f2e08001670 con 0x7f2e140b3b00 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 >> v1:172.21.15.87:6789/0 conn(0x7f2e140b3b00 legacy=0x7f2e140d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dfc004800 0x7f2dfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f61fd59a640 1 -- 172.21.15.80:0/715529211 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f802cb60 con 0x7f62000d2e60 2024-04-16T15:36:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f61fd59a640 1 -- 172.21.15.80:0/715529211 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8034440 con 0x7f62000d2e60 2024-04-16T15:36:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f61ff59e640 1 -- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62000d2e60 msgr2=0x7f62000cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f61ff59e640 1 --2- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62000d2e60 0x7f62000cd000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009d90 tx=0x7f61f802bdb0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2dfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140cfe00 con 0x7f2dfc0039b0 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140b3ee0 con 0x7f2dfc004800 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc01c9d0 con 0x7f2e140d4dc0 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.596+0000 7f2e13fff640 1 --2- 172.21.15.80:0/4230556636 >> v2:172.21.15.80:3300/0 conn(0x7f2e1406d010 0x7f2e140d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 -- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 msgr2=0x7f2dfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 -- 172.21.15.80:0/715529211 shutdown_connections 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 --2- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62000d2e60 0x7f62000cd000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 --2- 172.21.15.80:0/715529211 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d1280 0x7f620009b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 -- 172.21.15.80:0/715529211 >> 172.21.15.80:0/715529211 conn(0x7f62000d2340 msgr2=0x7f62000d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e13fff640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2dfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2dfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 -- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dfc004800 msgr2=0x7f2dfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dfc004800 0x7f2dfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e137fe640 1 -- 172.21.15.80:0/4230556636 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140d5240 con 0x7f2dfc0039b0 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.597+0000 7f2e13fff640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140d4dc0 0x7f2dfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f1be0228640 1 Processor -- start 2024-04-16T15:36:08.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f2e137fe640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c2c0 tx=0x7f2dfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7496ab4ccd6e4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 -- 172.21.15.80:0/715529211 shutdown_connections 2024-04-16T15:36:08.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.598+0000 7f61ff59e640 1 -- 172.21.15.80:0/715529211 wait complete. 2024-04-16T15:36:08.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.599+0000 7f1be0228640 1 -- start start 2024-04-16T15:36:08.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.599+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08007d70 con 0x7f2dfc0039b0 2024-04-16T15:36:08.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.599+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08030070 con 0x7f2dfc0039b0 2024-04-16T15:36:08.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f61ff59e640 1 Processor -- start 2024-04-16T15:36:08.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f1be0228640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 0x7f1bd806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.599+0000 7f2e127fc640 1 -- 172.21.15.80:0/4230556636 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0802cdc0 con 0x7f2dfc0039b0 2024-04-16T15:36:08.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f2e19c57640 1 -- 172.21.15.80:0/4230556636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 msgr2=0x7f2dfc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f2e19c57640 1 --2- 172.21.15.80:0/4230556636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2dfc003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c2c0 tx=0x7f2dfc005830 comp rx=0 tx=0).stop 2024-04-16T15:36:08.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f2e13fff640 1 -- 172.21.15.80:0/4230556636 reap_dead start 2024-04-16T15:36:08.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f2e19c57640 1 -- 172.21.15.80:0/4230556636 shutdown_connections 2024-04-16T15:36:08.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f2e19c57640 1 -- 172.21.15.80:0/4230556636 >> 172.21.15.80:0/4230556636 conn(0x7f2e1408c000 msgr2=0x7f2e140d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f1be0228640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f1bddfc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 0x7f1bd806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1bddfc4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 0x7f1bd806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35002/0 (socket says 172.21.15.80:35002) 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1bde7c5640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f1bd806d0b0 0x7f1bd80b4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33996/0 (socket says 172.21.15.80:33996) 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1bdd7c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1bdd7c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:58596/0 (socket says 172.21.15.80:58596) 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1bddfc4640 1 -- 172.21.15.80:0/1242153998 learned_addr learned my addr 172.21.15.80:0/1242153998 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd806bad0 con 0x7f1bd806d0b0 2024-04-16T15:36:08.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f2e19c57640 1 -- 172.21.15.80:0/4230556636 shutdown_connections 2024-04-16T15:36:08.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f1bdcfc2640 1 -- 172.21.15.80:0/1242153998 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98901230 0 0) 0x7f1bd806bad0 con 0x7f1bd806d0b0 2024-04-16T15:36:08.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd806c6e0 con 0x7f1bd815ab10 2024-04-16T15:36:08.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd806bdb0 con 0x7f1bd80702b0 2024-04-16T15:36:08.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.600+0000 7f61ff59e640 1 -- start start 2024-04-16T15:36:08.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f61ff59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.601+0000 7f61ff59e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 0x7f6200151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f2e19c57640 1 -- 172.21.15.80:0/4230556636 wait complete. 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61fe59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35010/0 (socket says 172.21.15.80:35010) 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61ff59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62001547f0 0x7f6200153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61ff59e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f62001600f0 con 0x7f620009ace0 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61ff59e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f620015ff70 con 0x7f62001547f0 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61ff59e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6200160270 con 0x7f62000d2e60 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61fe59c640 1 -- 172.21.15.80:0/1087490593 learned_addr learned my addr 172.21.15.80:0/1087490593 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61fdd9b640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 0x7f6200151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.602+0000 7f61fed9d640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62001547f0 0x7f6200153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 -- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62001547f0 msgr2=0x7f6200153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62001547f0 0x7f6200153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 -- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 msgr2=0x7f62000b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 -- 172.21.15.80:0/1087490593 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62001518c0 con 0x7f62000d2e60 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fe59c640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f61fdd9b640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 0x7f6200151380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61f000e850 tx=0x7f61f000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.603+0000 7f1bdcfc2640 1 -- 172.21.15.80:0/1242153998 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bc4005730 con 0x7f1bd806d0b0 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/1242153998 >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 msgr2=0x7f1bd806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f1bdd7c3640 1 --2- 172.21.15.80:0/1242153998 >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 0x7f1bd806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/1242153998 >> v1:172.21.15.80:6789/0 conn(0x7f1bd806d0b0 legacy=0x7f1bd80b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/1242153998 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd806c090 con 0x7f1bd80702b0 2024-04-16T15:36:08.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f2e19c57640 1 Processor -- start 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f2e19c57640 1 -- start start 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0017070 con 0x7f62000d2e60 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f000c940 con 0x7f62000d2e60 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.604+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f000ccf0 con 0x7f62000d2e60 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62000cc050 con 0x7f62000d2e60 2024-04-16T15:36:08.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62000b7920 con 0x7f62000d2e60 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f1bdd7c3640 1 --2- 172.21.15.80:0/1242153998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bd806c860 tx=0x7f1bd402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=673c29e1a0d431d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f1bdcfc2640 1 -- 172.21.15.80:0/1242153998 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4035070 con 0x7f1bd80702b0 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f1bdcfc2640 1 -- 172.21.15.80:0/1242153998 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd4031640 con 0x7f1bd80702b0 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f2e19c57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f2e19c57640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140b9a70 0x7f2e1415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.605+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35018/0 (socket says 172.21.15.80:35018) 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 -- 172.21.15.80:0/1449628930 learned_addr learned my addr 172.21.15.80:0/1449628930 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e140b9ed0 0x7f2e1415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140cfa90 con 0x7f2dfc0039b0 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140cf7b0 con 0x7f2e140b9ed0 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1406d4a0 con 0x7f2e140b9a70 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e12ffd640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140b9a70 0x7f2e1415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e13fff640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e140b9ed0 0x7f2e1415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 -- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140b9a70 msgr2=0x7f2e1415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140b9a70 0x7f2e1415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 -- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e140b9ed0 msgr2=0x7f2e1415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e140b9ed0 0x7f2e1415cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f2e137fe640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140cd750 con 0x7f2dfc0039b0 2024-04-16T15:36:08.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.606+0000 7f1bdcfc2640 1 -- 172.21.15.80:0/1242153998 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4035070 con 0x7f1bd80702b0 2024-04-16T15:36:08.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 msgr2=0x7f1bd806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 --2- 172.21.15.80:0/1242153998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bd806c860 tx=0x7f1bd402ba20 comp rx=0 tx=0).stop 2024-04-16T15:36:08.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 shutdown_connections 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 --2- 172.21.15.80:0/1242153998 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd80702b0 0x7f1bd806cb70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 --2- 172.21.15.80:0/1242153998 >> v2:172.21.15.80:3300/0 conn(0x7f1bd815ab10 0x7f1bd806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 >> 172.21.15.80:0/1242153998 conn(0x7f1bd80d0c50 msgr2=0x7f1bd80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.608+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61f001a070 con 0x7f62000d2e60 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.608+0000 7f61eeffd640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 0x7f61e006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.609+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f61f008bd50 con 0x7f62000d2e60 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.609+0000 7f61fe59c640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 0x7f61e006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.609+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4005290 con 0x7f62000d2e60 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f2e137fe640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c2c0 tx=0x7f2e08001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08004bf0 con 0x7f2dfc0039b0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e08004d90 con 0x7f2dfc0039b0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.607+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e080072b0 con 0x7f2dfc0039b0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.608+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e140cda30 con 0x7f2dfc0039b0 2024-04-16T15:36:08.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.610+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141663d0 con 0x7f2dfc0039b0 2024-04-16T15:36:08.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.610+0000 7f61fe59c640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 0x7f61e006ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009e00 tx=0x7f61f4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.610+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 shutdown_connections 2024-04-16T15:36:08.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.610+0000 7f1be0228640 1 -- 172.21.15.80:0/1242153998 wait complete. 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.611+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e14069150 con 0x7f2dfc0039b0 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.611+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e08047020 con 0x7f2dfc0039b0 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.612+0000 7f2dfbfff640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 0x7f2e0006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.612+0000 7f1be0228640 1 Processor -- start 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.613+0000 7f1be0228640 1 -- start start 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd80702b0 0x7f1bd814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd814f8d0 0x7f1bd80725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1bdd7c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1bdd7c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35022/0 (socket says 172.21.15.80:35022) 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/2772626847 learned_addr learned my addr 172.21.15.80:0/2772626847 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80b55e0 con 0x7f1bd815ab10 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80b5460 con 0x7f1bd80702b0 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f1be0228640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd815aef0 con 0x7f1bd814f8d0 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd814f8d0 msgr2=0x7f1bd80725d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd814f8d0 0x7f1bd80725d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd80702b0 msgr2=0x7f1bd814ef60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd80702b0 0x7f1bd814ef60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd815c320 con 0x7f1bd815ab10 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.615+0000 7f1bdd7c3640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009790 tx=0x7f1bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62001518c0 con 0x7f62000d2e60 2024-04-16T15:36:08.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.612+0000 7f2e12ffd640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 0x7f2e0006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2e08076e80 con 0x7f2dfc0039b0 2024-04-16T15:36:08.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.614+0000 7f2e12ffd640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 0x7f2e0006ee00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e040093d0 tx=0x7f2e040094a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.622+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4048070 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.622+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd40044c0 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.622+0000 7f1be0228640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd814da40 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.622+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4035040 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.622+0000 7f1be0228640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd8150090 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.624+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd8069150 con 0x7f1bd815ab10 2024-04-16T15:36:08.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.624+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e0807af10 con 0x7f2dfc0039b0 2024-04-16T15:36:08.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.636+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bd404b070 con 0x7f1bd815ab10 2024-04-16T15:36:08.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.636+0000 7f1bce7fc640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:08.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.637+0000 7f1bddfc4640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:08.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.638+0000 7f1bddfc4640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009990 tx=0x7f1bc8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:08.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.638+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1bd40add90 con 0x7f1bd815ab10 2024-04-16T15:36:08.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.638+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bd40dcb80 con 0x7f1bd815ab10 2024-04-16T15:36:08.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.850+0000 7f7166a4a640 1 -- 172.21.15.80:0/2446956365 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7160068a40 con 0x7f71600cd9f0 2024-04-16T15:36:08.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.851+0000 7f715cff9640 1 -- 172.21.15.80:0/2446956365 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7154059b50 con 0x7f71600cd9f0 2024-04-16T15:36:08.849 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 msgr2=0x7f714c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 0x7f714c06ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7160140de0 tx=0x7f7150007990 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 msgr2=0x7f7160139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f715400c480 tx=0x7f715400c940 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 shutdown_connections 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7160145020 0x7f71601570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f714c06c9c0 0x7f714c06ee80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f71600cd9f0 0x7f7160139940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 --2- 172.21.15.80:0/2446956365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f716006f650 0x7f7160140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.855+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 >> 172.21.15.80:0/2446956365 conn(0x7f7160067d90 msgr2=0x7f716006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.856+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 shutdown_connections 2024-04-16T15:36:08.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.856+0000 7f71467fc640 1 -- 172.21.15.80:0/2446956365 wait complete. 2024-04-16T15:36:08.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-16T15:36:08.871 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.895+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc7180cd9c0 con 0x7fc718067d50 2024-04-16T15:36:08.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.897+0000 7fc6fffff640 1 -- 172.21.15.80:0/3582095738 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7180cd9c0 con 0x7fc718067d50 2024-04-16T15:36:08.895 INFO:teuthology.orchestra.run.smithi080.stdout:55834574859 2024-04-16T15:36:08.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.899+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 msgr2=0x7fc70406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.899+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 0x7fc70406ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc718204e60 tx=0x7fc710009040 comp rx=0 tx=0).stop 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 msgr2=0x7fc718204f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097f0 tx=0x7fc7080046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 shutdown_connections 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc71806f030 0x7fc71815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc71806e5f0 0x7fc718205440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc70406c9c0 0x7fc70406ee80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 --2- 172.21.15.80:0/3582095738 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc718067d50 0x7fc718204f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 >> 172.21.15.80:0/3582095738 conn(0x7fc718067940 msgr2=0x7fc718159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 shutdown_connections 2024-04-16T15:36:08.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.900+0000 7fc71d80d640 1 -- 172.21.15.80:0/3582095738 wait complete. 2024-04-16T15:36:08.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.905+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f74900cf8b0 con 0x7f74900b3b90 2024-04-16T15:36:08.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.905+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efc0c0ca360 con 0x7efbf80051c0 2024-04-16T15:36:08.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.906+0000 7efc08ff9640 1 -- 172.21.15.80:0/1582718851 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbf405a290 con 0x7efbf80051c0 2024-04-16T15:36:08.905 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:08.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.906+0000 7f748cff9640 1 -- 172.21.15.80:0/2370658260 <== mon.1 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74900af720 con 0x7f74900b3b90 2024-04-16T15:36:08.906 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:08.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 msgr2=0x7efbec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 0x7efbec06ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0cb730 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2024-04-16T15:36:08.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 msgr2=0x7f747c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 msgr2=0x7efc0c1640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e750 tx=0x7efbf400ec10 comp rx=0 tx=0).stop 2024-04-16T15:36:08.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 0x7f747c06ee30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7488007130 tx=0x7f74880077c0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 msgr2=0x7f74900ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 shutdown_connections 2024-04-16T15:36:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc0c0c9f80 0x7efc0c1f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efbec06c9c0 0x7efbec06ee80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efc0c165ff0 0x7efc0c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 --2- 172.21.15.80:0/1582718851 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efbf80051c0 0x7efc0c1640e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 >> 172.21.15.80:0/1582718851 conn(0x7efc0c0d46b0 msgr2=0x7efc0c074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 0x7f74900ae710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f748000d550 tx=0x7f748000da10 comp rx=0 tx=0).stop 2024-04-16T15:36:08.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 shutdown_connections 2024-04-16T15:36:08.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f749015b890 0x7f7490099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74900b3b90 0x7f74900ae710 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f748000d550 tx=0x7f748000da10 comp rx=0 tx=0).stop 2024-04-16T15:36:08.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 shutdown_connections 2024-04-16T15:36:08.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f747c06c970 0x7f747c06ee30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7efc119bd640 1 -- 172.21.15.80:0/1582718851 wait complete. 2024-04-16T15:36:08.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 --2- 172.21.15.80:0/2370658260 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7490072030 0x7f74900ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.909+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 >> 172.21.15.80:0/2370658260 conn(0x7f74900b57c0 msgr2=0x7f74901459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 shutdown_connections 2024-04-16T15:36:08.915 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.910+0000 7f7495558640 1 -- 172.21.15.80:0/2370658260 wait complete. 2024-04-16T15:36:08.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-16T15:36:08.916 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-16T15:36:08.927 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-16T15:36:08.927 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.949+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f667c005850 con 0x7f66980b3510 2024-04-16T15:36:08.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.949+0000 7f6686ffd640 1 -- 172.21.15.80:0/336962839 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f669005dbc0 con 0x7f66980b3510 2024-04-16T15:36:08.948 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 msgr2=0x7f667806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 0x7f667806ee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6688039000 tx=0x7f668800a040 comp rx=0 tx=0).stop 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 msgr2=0x7f66980b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f669000cb20 tx=0x7f6690002090 comp rx=0 tx=0).stop 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 shutdown_connections 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f667806c9c0 0x7f667806ee80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f66980ccdb0 0x7f669814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f66980b3510 0x7f66980b14c0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f669000cb20 tx=0x7f6690002090 comp rx=0 tx=0).stop 2024-04-16T15:36:08.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 --2- 172.21.15.80:0/336962839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f669806f030 0x7f66981e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 >> 172.21.15.80:0/336962839 conn(0x7f6698067940 msgr2=0x7f6698074d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 shutdown_connections 2024-04-16T15:36:08.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.951+0000 7f669c80c640 1 -- 172.21.15.80:0/336962839 wait complete. 2024-04-16T15:36:08.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.955+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f61e4005580 con 0x7f62000d2e60 2024-04-16T15:36:08.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.956+0000 7f61eeffd640 1 -- 172.21.15.80:0/1087490593 <== mon.2 v2:172.21.15.87:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61f00597d0 con 0x7f62000d2e60 2024-04-16T15:36:08.954 INFO:teuthology.orchestra.run.smithi080.stdout:55834574857 2024-04-16T15:36:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 msgr2=0x7f61e006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 0x7f61e006ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009e00 tx=0x7f61f4009190 comp rx=0 tx=0).stop 2024-04-16T15:36:08.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 msgr2=0x7f6200151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 0x7f6200151380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61f000e850 tx=0x7f61f000ed10 comp rx=0 tx=0).stop 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 shutdown_connections 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62001547f0 0x7f6200153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f61e006c9c0 0x7f61e006ee80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f62000d2e60 0x7f6200151380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 --2- 172.21.15.80:0/1087490593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f620009ace0 0x7f62000b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 >> 172.21.15.80:0/1087490593 conn(0x7f62000d2340 msgr2=0x7f620015c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 shutdown_connections 2024-04-16T15:36:08.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.958+0000 7f61ff59e640 1 -- 172.21.15.80:0/1087490593 wait complete. 2024-04-16T15:36:08.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-16T15:36:08.962 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-16T15:36:08.968 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.974+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2e140d4120 con 0x7f2dfc0039b0 2024-04-16T15:36:08.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.975+0000 7f2dfbfff640 1 -- 172.21.15.80:0/1449628930 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e0807a810 con 0x7f2dfc0039b0 2024-04-16T15:36:08.973 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 msgr2=0x7f2e0006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 0x7f2e0006ee00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e040093d0 tx=0x7f2e040094a0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 msgr2=0x7f2e14165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c2c0 tx=0x7f2e08001970 comp rx=0 tx=0).stop 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 shutdown_connections 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e140b9ed0 0x7f2e1415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2e0006c940 0x7f2e0006ee00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2e140b9a70 0x7f2e1415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 --2- 172.21.15.80:0/1449628930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2dfc0039b0 0x7f2e14165e90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 >> 172.21.15.80:0/1449628930 conn(0x7f2e1408c000 msgr2=0x7f2e140b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 shutdown_connections 2024-04-16T15:36:08.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.977+0000 7f2e19c57640 1 -- 172.21.15.80:0/1449628930 wait complete. 2024-04-16T15:36:08.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.980+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1bd8159600 con 0x7f1bd815ab10 2024-04-16T15:36:08.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.980+0000 7f1bce7fc640 1 -- 172.21.15.80:0/2772626847 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bd4052080 con 0x7f1bd815ab10 2024-04-16T15:36:08.979 INFO:teuthology.orchestra.run.smithi080.stdout:55834574858 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 msgr2=0x7f1bbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009990 tx=0x7f1bc8009240 comp rx=0 tx=0).stop 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 msgr2=0x7f1bd814d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009790 tx=0x7f1bd40046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 shutdown_connections 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.982+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1bbc06c8f0 0x7f1bbc06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1bd814f8d0 0x7f1bd80725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1bd815ab10 0x7f1bd814d500 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 --2- 172.21.15.80:0/2772626847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bd80702b0 0x7f1bd814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 >> 172.21.15.80:0/2772626847 conn(0x7f1bd80d0c50 msgr2=0x7f1bd8159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 shutdown_connections 2024-04-16T15:36:08.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:08.983+0000 7f1bbbfff640 1 -- 172.21.15.80:0/2772626847 wait complete. 2024-04-16T15:36:08.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-16T15:36:08.987 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-16T15:36:08.992 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:08.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T15:36:08.993 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:36:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.136+0000 7f3a97d75640 1 Processor -- start 2024-04-16T15:36:09.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.136+0000 7f3a97d75640 1 -- start start 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a97d75640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a90145a30 0x7f3a9006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a97d75640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a9006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a97d75640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a900ccd90 con 0x7f3a90145fb0 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a97d75640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3a90145e10 con 0x7f3a90145a30 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a97d75640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3a900b1520 con 0x7f3a900ce280 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a95b11640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3a90145a30 0x7f3a9006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a95310640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3a90145fb0 0x7f3a90160290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:33998/0 (socket says 172.21.15.80:33998) 2024-04-16T15:36:09.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a95310640 1 -- 172.21.15.80:0/1004197149 learned_addr learned my addr 172.21.15.80:0/1004197149 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.137+0000 7f3a96312640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a9006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a95b11640 1 -- 172.21.15.80:0/1004197149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 msgr2=0x7f3a9006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a95b11640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a9006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a95b11640 1 -- 172.21.15.80:0/1004197149 >> v1:172.21.15.80:6789/0 conn(0x7f3a90145fb0 legacy=0x7f3a90160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a95b11640 1 -- 172.21.15.80:0/1004197149 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900b1800 con 0x7f3a90145a30 2024-04-16T15:36:09.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a94b0f640 1 -- 172.21.15.80:0/1004197149 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637247088 0 0) 0x7f3a900ccd90 con 0x7f3a90145fb0 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a95b11640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145a30 0x7f3a9006b9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0097a0 tx=0x7f3a8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e663e737bad036 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a94b0f640 1 -- 172.21.15.80:0/1004197149 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c035020 con 0x7f3a90145a30 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a94b0f640 1 -- 172.21.15.80:0/1004197149 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c031830 con 0x7f3a90145a30 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.138+0000 7f3a94b0f640 1 -- 172.21.15.80:0/1004197149 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c031c00 con 0x7f3a90145a30 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 -- 172.21.15.80:0/1004197149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145a30 msgr2=0x7f3a9006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145a30 0x7f3a9006b9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0097a0 tx=0x7f3a8c02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 -- 172.21.15.80:0/1004197149 shutdown_connections 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a9006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 --2- 172.21.15.80:0/1004197149 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145a30 0x7f3a9006b9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 -- 172.21.15.80:0/1004197149 >> 172.21.15.80:0/1004197149 conn(0x7f3a9009aa70 msgr2=0x7f3a900b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:09.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 -- 172.21.15.80:0/1004197149 shutdown_connections 2024-04-16T15:36:09.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.139+0000 7f3a97d75640 1 -- 172.21.15.80:0/1004197149 wait complete. 2024-04-16T15:36:09.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.140+0000 7f3a97d75640 1 Processor -- start 2024-04-16T15:36:09.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.140+0000 7f3a97d75640 1 -- start start 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a900b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 0x7f3a900ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900b2d00 con 0x7f3a90145fb0 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900b1dc0 con 0x7f3a90145a30 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a97d75640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3a900b2e80 con 0x7f3a900ce280 2024-04-16T15:36:09.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35030/0 (socket says 172.21.15.80:35030) 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 -- 172.21.15.80:0/3257799030 learned_addr learned my addr 172.21.15.80:0/3257799030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a95b11640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a900b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a95310640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 0x7f3a900ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 -- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 msgr2=0x7f3a900b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a900b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 -- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 msgr2=0x7f3a900ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 0x7f3a900ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a96312640 1 -- 172.21.15.80:0/3257799030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900cf5b0 con 0x7f3a90145fb0 2024-04-16T15:36:09.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.141+0000 7f3a95310640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 0x7f3a900ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a96312640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009fd0 tx=0x7f3a8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88014420 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88019070 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a900cf890 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88014800 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.142+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a900cfe50 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.143+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a90068a40 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.143+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a880149a0 con 0x7f3a90145fb0 2024-04-16T15:36:09.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.144+0000 7f3a867fc640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 0x7f3a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.144+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3a8808c710 con 0x7f3a90145fb0 2024-04-16T15:36:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.144+0000 7f3a95b11640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 0x7f3a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.144+0000 7f3a95b11640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 0x7f3a7406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c036000 tx=0x7f3a8c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.148+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a8805a800 con 0x7f3a90145fb0 2024-04-16T15:36:09.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.320+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a900d19d0 con 0x7f3a7406c8f0 2024-04-16T15:36:09.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.327+0000 7f3a867fc640 1 -- 172.21.15.80:0/3257799030 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f3a900d19d0 con 0x7f3a7406c8f0 2024-04-16T15:36:09.329 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:09.331 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 msgr2=0x7f3a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 0x7f3a7406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c036000 tx=0x7f3a8c03c040 comp rx=0 tx=0).stop 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 msgr2=0x7f3a900cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009fd0 tx=0x7f3a8800e4b0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 shutdown_connections 2024-04-16T15:36:09.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a90145fb0 0x7f3a900cacb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a90145a30 0x7f3a900ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3a7406c8f0 0x7f3a7406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 --2- 172.21.15.80:0/3257799030 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3a900ce280 0x7f3a900b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 >> 172.21.15.80:0/3257799030 conn(0x7f3a9009aa70 msgr2=0x7f3a900701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 shutdown_connections 2024-04-16T15:36:09.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.331+0000 7f3a97d75640 1 -- 172.21.15.80:0/3257799030 wait complete. 2024-04-16T15:36:09.340 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-16T15:36:09.162187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219468,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755252,"statfs":{"total":773094113280,"available":772869378048,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002690"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083878+0000","last_change":"2024-04-16T15:35:46.903839+0000","last_active":"2024-04-16T15:35:55.083878+0000","last_peered":"2024-04-16T15:35:55.083878+0000","last_clean":"2024-04-16T15:35:55.083878+0000","last_became_active":"2024-04-16T15:35:46.903559+0000","last_became_peered":"2024-04-16T15:35:46.903559+0000","last_unstale":"2024-04-16T15:35:55.083878+0000","last_undegraded":"2024-04-16T15:35:55.083878+0000","last_fullsized":"2024-04-16T15:35:55.083878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928439+0000","last_change":"2024-04-16T15:35:47.906302+0000","last_active":"2024-04-16T15:35:53.928439+0000","last_peered":"2024-04-16T15:35:53.928439+0000","last_clean":"2024-04-16T15:35:53.928439+0000","last_became_active":"2024-04-16T15:35:47.905445+0000","last_became_peered":"2024-04-16T15:35:47.905445+0000","last_unstale":"2024-04-16T15:35:53.928439+0000","last_undegraded":"2024-04-16T15:35:53.928439+0000","last_fullsized":"2024-04-16T15:35:53.928439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927788+0000","last_change":"2024-04-16T15:35:52.665449+0000","last_active":"2024-04-16T15:35:53.927788+0000","last_peered":"2024-04-16T15:35:53.927788+0000","last_clean":"2024-04-16T15:35:53.927788+0000","last_became_active":"2024-04-16T15:35:52.665084+0000","last_became_peered":"2024-04-16T15:35:52.665084+0000","last_unstale":"2024-04-16T15:35:53.927788+0000","last_undegraded":"2024-04-16T15:35:53.927788+0000","last_fullsized":"2024-04-16T15:35:53.927788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:19:37.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928611+0000","last_change":"2024-04-16T15:35:46.898739+0000","last_active":"2024-04-16T15:35:53.928611+0000","last_peered":"2024-04-16T15:35:53.928611+0000","last_clean":"2024-04-16T15:35:53.928611+0000","last_became_active":"2024-04-16T15:35:46.898423+0000","last_became_peered":"2024-04-16T15:35:46.898423+0000","last_unstale":"2024-04-16T15:35:53.928611+0000","last_undegraded":"2024-04-16T15:35:53.928611+0000","last_fullsized":"2024-04-16T15:35:53.928611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083665+0000","last_change":"2024-04-16T15:35:47.907617+0000","last_active":"2024-04-16T15:35:55.083665+0000","last_peered":"2024-04-16T15:35:55.083665+0000","last_clean":"2024-04-16T15:35:55.083665+0000","last_became_active":"2024-04-16T15:35:47.907273+0000","last_became_peered":"2024-04-16T15:35:47.907273+0000","last_unstale":"2024-04-16T15:35:55.083665+0000","last_undegraded":"2024-04-16T15:35:55.083665+0000","last_fullsized":"2024-04-16T15:35:55.083665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:55.452016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930079+0000","last_change":"2024-04-16T15:35:51.944987+0000","last_active":"2024-04-16T15:35:53.930079+0000","last_peered":"2024-04-16T15:35:53.930079+0000","last_clean":"2024-04-16T15:35:53.930079+0000","last_became_active":"2024-04-16T15:35:51.944345+0000","last_became_peered":"2024-04-16T15:35:51.944345+0000","last_unstale":"2024-04-16T15:35:53.930079+0000","last_undegraded":"2024-04-16T15:35:53.930079+0000","last_fullsized":"2024-04-16T15:35:53.930079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082829+0000","last_change":"2024-04-16T15:35:46.902233+0000","last_active":"2024-04-16T15:35:55.082829+0000","last_peered":"2024-04-16T15:35:55.082829+0000","last_clean":"2024-04-16T15:35:55.082829+0000","last_became_active":"2024-04-16T15:35:46.901940+0000","last_became_peered":"2024-04-16T15:35:46.901940+0000","last_unstale":"2024-04-16T15:35:55.082829+0000","last_undegraded":"2024-04-16T15:35:55.082829+0000","last_fullsized":"2024-04-16T15:35:55.082829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930367+0000","last_change":"2024-04-16T15:35:47.898146+0000","last_active":"2024-04-16T15:35:53.930367+0000","last_peered":"2024-04-16T15:35:53.930367+0000","last_clean":"2024-04-16T15:35:53.930367+0000","last_became_active":"2024-04-16T15:35:47.897840+0000","last_became_peered":"2024-04-16T15:35:47.897840+0000","last_unstale":"2024-04-16T15:35:53.930367+0000","last_undegraded":"2024-04-16T15:35:53.930367+0000","last_fullsized":"2024-04-16T15:35:53.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930469+0000","last_change":"2024-04-16T15:35:51.945269+0000","last_active":"2024-04-16T15:35:53.930469+0000","last_peered":"2024-04-16T15:35:53.930469+0000","last_clean":"2024-04-16T15:35:53.930469+0000","last_became_active":"2024-04-16T15:35:51.943815+0000","last_became_peered":"2024-04-16T15:35:51.943815+0000","last_unstale":"2024-04-16T15:35:53.930469+0000","last_undegraded":"2024-04-16T15:35:53.930469+0000","last_fullsized":"2024-04-16T15:35:53.930469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082796+0000","last_change":"2024-04-16T15:35:46.901105+0000","last_active":"2024-04-16T15:35:55.082796+0000","last_peered":"2024-04-16T15:35:55.082796+0000","last_clean":"2024-04-16T15:35:55.082796+0000","last_became_active":"2024-04-16T15:35:46.900800+0000","last_became_peered":"2024-04-16T15:35:46.900800+0000","last_unstale":"2024-04-16T15:35:55.082796+0000","last_undegraded":"2024-04-16T15:35:55.082796+0000","last_fullsized":"2024-04-16T15:35:55.082796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:11.448206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930964+0000","last_change":"2024-04-16T15:35:47.897967+0000","last_active":"2024-04-16T15:35:53.930964+0000","last_peered":"2024-04-16T15:35:53.930964+0000","last_clean":"2024-04-16T15:35:53.930964+0000","last_became_active":"2024-04-16T15:35:47.897689+0000","last_became_peered":"2024-04-16T15:35:47.897689+0000","last_unstale":"2024-04-16T15:35:53.930964+0000","last_undegraded":"2024-04-16T15:35:53.930964+0000","last_fullsized":"2024-04-16T15:35:53.930964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930582+0000","last_change":"2024-04-16T15:35:51.945075+0000","last_active":"2024-04-16T15:35:53.930582+0000","last_peered":"2024-04-16T15:35:53.930582+0000","last_clean":"2024-04-16T15:35:53.930582+0000","last_became_active":"2024-04-16T15:35:51.944674+0000","last_became_peered":"2024-04-16T15:35:51.944674+0000","last_unstale":"2024-04-16T15:35:53.930582+0000","last_undegraded":"2024-04-16T15:35:53.930582+0000","last_fullsized":"2024-04-16T15:35:53.930582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368841+0000","last_change":"2024-04-16T15:35:47.906053+0000","last_active":"2024-04-16T15:35:54.368841+0000","last_peered":"2024-04-16T15:35:54.368841+0000","last_clean":"2024-04-16T15:35:54.368841+0000","last_became_active":"2024-04-16T15:35:47.905735+0000","last_became_peered":"2024-04-16T15:35:47.905735+0000","last_unstale":"2024-04-16T15:35:54.368841+0000","last_undegraded":"2024-04-16T15:35:54.368841+0000","last_fullsized":"2024-04-16T15:35:54.368841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082789+0000","last_change":"2024-04-16T15:35:46.903005+0000","last_active":"2024-04-16T15:35:55.082789+0000","last_peered":"2024-04-16T15:35:55.082789+0000","last_clean":"2024-04-16T15:35:55.082789+0000","last_became_active":"2024-04-16T15:35:46.902690+0000","last_became_peered":"2024-04-16T15:35:46.902690+0000","last_unstale":"2024-04-16T15:35:55.082789+0000","last_undegraded":"2024-04-16T15:35:55.082789+0000","last_fullsized":"2024-04-16T15:35:55.082789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931392+0000","last_change":"2024-04-16T15:35:51.944672+0000","last_active":"2024-04-16T15:35:53.931392+0000","last_peered":"2024-04-16T15:35:53.931392+0000","last_clean":"2024-04-16T15:35:53.931392+0000","last_became_active":"2024-04-16T15:35:51.943902+0000","last_became_peered":"2024-04-16T15:35:51.943902+0000","last_unstale":"2024-04-16T15:35:53.931392+0000","last_undegraded":"2024-04-16T15:35:53.931392+0000","last_fullsized":"2024-04-16T15:35:53.931392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927970+0000","last_change":"2024-04-16T15:35:47.911396+0000","last_active":"2024-04-16T15:35:53.927970+0000","last_peered":"2024-04-16T15:35:53.927970+0000","last_clean":"2024-04-16T15:35:53.927970+0000","last_became_active":"2024-04-16T15:35:47.910994+0000","last_became_peered":"2024-04-16T15:35:47.910994+0000","last_unstale":"2024-04-16T15:35:53.927970+0000","last_undegraded":"2024-04-16T15:35:53.927970+0000","last_fullsized":"2024-04-16T15:35:53.927970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084084+0000","last_change":"2024-04-16T15:35:46.900976+0000","last_active":"2024-04-16T15:35:55.084084+0000","last_peered":"2024-04-16T15:35:55.084084+0000","last_clean":"2024-04-16T15:35:55.084084+0000","last_became_active":"2024-04-16T15:35:46.900725+0000","last_became_peered":"2024-04-16T15:35:46.900725+0000","last_unstale":"2024-04-16T15:35:55.084084+0000","last_undegraded":"2024-04-16T15:35:55.084084+0000","last_fullsized":"2024-04-16T15:35:55.084084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931016+0000","last_change":"2024-04-16T15:35:51.941220+0000","last_active":"2024-04-16T15:35:53.931016+0000","last_peered":"2024-04-16T15:35:53.931016+0000","last_clean":"2024-04-16T15:35:53.931016+0000","last_became_active":"2024-04-16T15:35:51.940585+0000","last_became_peered":"2024-04-16T15:35:51.940585+0000","last_unstale":"2024-04-16T15:35:53.931016+0000","last_undegraded":"2024-04-16T15:35:53.931016+0000","last_fullsized":"2024-04-16T15:35:53.931016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927961+0000","last_change":"2024-04-16T15:35:47.911281+0000","last_active":"2024-04-16T15:35:53.927961+0000","last_peered":"2024-04-16T15:35:53.927961+0000","last_clean":"2024-04-16T15:35:53.927961+0000","last_became_active":"2024-04-16T15:35:47.910748+0000","last_became_peered":"2024-04-16T15:35:47.910748+0000","last_unstale":"2024-04-16T15:35:53.927961+0000","last_undegraded":"2024-04-16T15:35:53.927961+0000","last_fullsized":"2024-04-16T15:35:53.927961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083203+0000","last_change":"2024-04-16T15:35:46.902533+0000","last_active":"2024-04-16T15:35:55.083203+0000","last_peered":"2024-04-16T15:35:55.083203+0000","last_clean":"2024-04-16T15:35:55.083203+0000","last_became_active":"2024-04-16T15:35:46.902221+0000","last_became_peered":"2024-04-16T15:35:46.902221+0000","last_unstale":"2024-04-16T15:35:55.083203+0000","last_undegraded":"2024-04-16T15:35:55.083203+0000","last_fullsized":"2024-04-16T15:35:55.083203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083349+0000","last_change":"2024-04-16T15:35:52.664607+0000","last_active":"2024-04-16T15:35:55.083349+0000","last_peered":"2024-04-16T15:35:55.083349+0000","last_clean":"2024-04-16T15:35:55.083349+0000","last_became_active":"2024-04-16T15:35:52.664234+0000","last_became_peered":"2024-04-16T15:35:52.664234+0000","last_unstale":"2024-04-16T15:35:55.083349+0000","last_undegraded":"2024-04-16T15:35:55.083349+0000","last_fullsized":"2024-04-16T15:35:55.083349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930192+0000","last_change":"2024-04-16T15:35:47.913469+0000","last_active":"2024-04-16T15:35:53.930192+0000","last_peered":"2024-04-16T15:35:53.930192+0000","last_clean":"2024-04-16T15:35:53.930192+0000","last_became_active":"2024-04-16T15:35:47.912952+0000","last_became_peered":"2024-04-16T15:35:47.912952+0000","last_unstale":"2024-04-16T15:35:53.930192+0000","last_undegraded":"2024-04-16T15:35:53.930192+0000","last_fullsized":"2024-04-16T15:35:53.930192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:12.452242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083012+0000","last_change":"2024-04-16T15:35:46.903630+0000","last_active":"2024-04-16T15:35:55.083012+0000","last_peered":"2024-04-16T15:35:55.083012+0000","last_clean":"2024-04-16T15:35:55.083012+0000","last_became_active":"2024-04-16T15:35:46.903282+0000","last_became_peered":"2024-04-16T15:35:46.903282+0000","last_unstale":"2024-04-16T15:35:55.083012+0000","last_undegraded":"2024-04-16T15:35:55.083012+0000","last_fullsized":"2024-04-16T15:35:55.083012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930012+0000","last_change":"2024-04-16T15:35:51.944348+0000","last_active":"2024-04-16T15:35:53.930012+0000","last_peered":"2024-04-16T15:35:53.930012+0000","last_clean":"2024-04-16T15:35:53.930012+0000","last_became_active":"2024-04-16T15:35:51.943917+0000","last_became_peered":"2024-04-16T15:35:51.943917+0000","last_unstale":"2024-04-16T15:35:53.930012+0000","last_undegraded":"2024-04-16T15:35:53.930012+0000","last_fullsized":"2024-04-16T15:35:53.930012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083778+0000","last_change":"2024-04-16T15:35:47.909155+0000","last_active":"2024-04-16T15:35:55.083778+0000","last_peered":"2024-04-16T15:35:55.083778+0000","last_clean":"2024-04-16T15:35:55.083778+0000","last_became_active":"2024-04-16T15:35:47.908864+0000","last_became_peered":"2024-04-16T15:35:47.908864+0000","last_unstale":"2024-04-16T15:35:55.083778+0000","last_undegraded":"2024-04-16T15:35:55.083778+0000","last_fullsized":"2024-04-16T15:35:55.083778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369537+0000","last_change":"2024-04-16T15:35:46.899721+0000","last_active":"2024-04-16T15:35:54.369537+0000","last_peered":"2024-04-16T15:35:54.369537+0000","last_clean":"2024-04-16T15:35:54.369537+0000","last_became_active":"2024-04-16T15:35:46.899479+0000","last_became_peered":"2024-04-16T15:35:46.899479+0000","last_unstale":"2024-04-16T15:35:54.369537+0000","last_undegraded":"2024-04-16T15:35:54.369537+0000","last_fullsized":"2024-04-16T15:35:54.369537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929961+0000","last_change":"2024-04-16T15:35:52.664780+0000","last_active":"2024-04-16T15:35:53.929961+0000","last_peered":"2024-04-16T15:35:53.929961+0000","last_clean":"2024-04-16T15:35:53.929961+0000","last_became_active":"2024-04-16T15:35:52.664358+0000","last_became_peered":"2024-04-16T15:35:52.664358+0000","last_unstale":"2024-04-16T15:35:53.929961+0000","last_undegraded":"2024-04-16T15:35:53.929961+0000","last_fullsized":"2024-04-16T15:35:53.929961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928626+0000","last_change":"2024-04-16T15:35:47.919497+0000","last_active":"2024-04-16T15:35:53.928626+0000","last_peered":"2024-04-16T15:35:53.928626+0000","last_clean":"2024-04-16T15:35:53.928626+0000","last_became_active":"2024-04-16T15:35:47.919212+0000","last_became_peered":"2024-04-16T15:35:47.919212+0000","last_unstale":"2024-04-16T15:35:53.928626+0000","last_undegraded":"2024-04-16T15:35:53.928626+0000","last_fullsized":"2024-04-16T15:35:53.928626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082805+0000","last_change":"2024-04-16T15:35:46.900937+0000","last_active":"2024-04-16T15:35:55.082805+0000","last_peered":"2024-04-16T15:35:55.082805+0000","last_clean":"2024-04-16T15:35:55.082805+0000","last_became_active":"2024-04-16T15:35:46.900654+0000","last_became_peered":"2024-04-16T15:35:46.900654+0000","last_unstale":"2024-04-16T15:35:55.082805+0000","last_undegraded":"2024-04-16T15:35:55.082805+0000","last_fullsized":"2024-04-16T15:35:55.082805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927710+0000","last_change":"2024-04-16T15:35:52.665635+0000","last_active":"2024-04-16T15:35:53.927710+0000","last_peered":"2024-04-16T15:35:53.927710+0000","last_clean":"2024-04-16T15:35:53.927710+0000","last_became_active":"2024-04-16T15:35:52.665117+0000","last_became_peered":"2024-04-16T15:35:52.665117+0000","last_unstale":"2024-04-16T15:35:53.927710+0000","last_undegraded":"2024-04-16T15:35:53.927710+0000","last_fullsized":"2024-04-16T15:35:53.927710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:14.451474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084034+0000","last_change":"2024-04-16T15:35:47.911904+0000","last_active":"2024-04-16T15:35:55.084034+0000","last_peered":"2024-04-16T15:35:55.084034+0000","last_clean":"2024-04-16T15:35:55.084034+0000","last_became_active":"2024-04-16T15:35:47.911640+0000","last_became_peered":"2024-04-16T15:35:47.911640+0000","last_unstale":"2024-04-16T15:35:55.084034+0000","last_undegraded":"2024-04-16T15:35:55.084034+0000","last_fullsized":"2024-04-16T15:35:55.084034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083711+0000","last_change":"2024-04-16T15:35:46.903622+0000","last_active":"2024-04-16T15:35:55.083711+0000","last_peered":"2024-04-16T15:35:55.083711+0000","last_clean":"2024-04-16T15:35:55.083711+0000","last_became_active":"2024-04-16T15:35:46.903301+0000","last_became_peered":"2024-04-16T15:35:46.903301+0000","last_unstale":"2024-04-16T15:35:55.083711+0000","last_undegraded":"2024-04-16T15:35:55.083711+0000","last_fullsized":"2024-04-16T15:35:55.083711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083996+0000","last_change":"2024-04-16T15:35:52.662090+0000","last_active":"2024-04-16T15:35:55.083996+0000","last_peered":"2024-04-16T15:35:55.083996+0000","last_clean":"2024-04-16T15:35:55.083996+0000","last_became_active":"2024-04-16T15:35:52.661689+0000","last_became_peered":"2024-04-16T15:35:52.661689+0000","last_unstale":"2024-04-16T15:35:55.083996+0000","last_undegraded":"2024-04-16T15:35:55.083996+0000","last_fullsized":"2024-04-16T15:35:55.083996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931070+0000","last_change":"2024-04-16T15:35:47.912680+0000","last_active":"2024-04-16T15:35:53.931070+0000","last_peered":"2024-04-16T15:35:53.931070+0000","last_clean":"2024-04-16T15:35:53.931070+0000","last_became_active":"2024-04-16T15:35:47.912362+0000","last_became_peered":"2024-04-16T15:35:47.912362+0000","last_unstale":"2024-04-16T15:35:53.931070+0000","last_undegraded":"2024-04-16T15:35:53.931070+0000","last_fullsized":"2024-04-16T15:35:53.931070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084115+0000","last_change":"2024-04-16T15:35:46.902183+0000","last_active":"2024-04-16T15:35:55.084115+0000","last_peered":"2024-04-16T15:35:55.084115+0000","last_clean":"2024-04-16T15:35:55.084115+0000","last_became_active":"2024-04-16T15:35:46.901974+0000","last_became_peered":"2024-04-16T15:35:46.901974+0000","last_unstale":"2024-04-16T15:35:55.084115+0000","last_undegraded":"2024-04-16T15:35:55.084115+0000","last_fullsized":"2024-04-16T15:35:55.084115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084296+0000","last_change":"2024-04-16T15:35:51.944263+0000","last_active":"2024-04-16T15:35:55.084296+0000","last_peered":"2024-04-16T15:35:55.084296+0000","last_clean":"2024-04-16T15:35:55.084296+0000","last_became_active":"2024-04-16T15:35:51.943863+0000","last_became_peered":"2024-04-16T15:35:51.943863+0000","last_unstale":"2024-04-16T15:35:55.084296+0000","last_undegraded":"2024-04-16T15:35:55.084296+0000","last_fullsized":"2024-04-16T15:35:55.084296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930852+0000","last_change":"2024-04-16T15:35:47.904118+0000","last_active":"2024-04-16T15:35:53.930852+0000","last_peered":"2024-04-16T15:35:53.930852+0000","last_clean":"2024-04-16T15:35:53.930852+0000","last_became_active":"2024-04-16T15:35:47.903698+0000","last_became_peered":"2024-04-16T15:35:47.903698+0000","last_unstale":"2024-04-16T15:35:53.930852+0000","last_undegraded":"2024-04-16T15:35:53.930852+0000","last_fullsized":"2024-04-16T15:35:53.930852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930850+0000","last_change":"2024-04-16T15:35:46.902362+0000","last_active":"2024-04-16T15:35:53.930850+0000","last_peered":"2024-04-16T15:35:53.930850+0000","last_clean":"2024-04-16T15:35:53.930850+0000","last_became_active":"2024-04-16T15:35:46.902062+0000","last_became_peered":"2024-04-16T15:35:46.902062+0000","last_unstale":"2024-04-16T15:35:53.930850+0000","last_undegraded":"2024-04-16T15:35:53.930850+0000","last_fullsized":"2024-04-16T15:35:53.930850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083986+0000","last_change":"2024-04-16T15:35:51.947084+0000","last_active":"2024-04-16T15:35:55.083986+0000","last_peered":"2024-04-16T15:35:55.083986+0000","last_clean":"2024-04-16T15:35:55.083986+0000","last_became_active":"2024-04-16T15:35:51.946724+0000","last_became_peered":"2024-04-16T15:35:51.946724+0000","last_unstale":"2024-04-16T15:35:55.083986+0000","last_undegraded":"2024-04-16T15:35:55.083986+0000","last_fullsized":"2024-04-16T15:35:55.083986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083003+0000","last_change":"2024-04-16T15:35:47.912577+0000","last_active":"2024-04-16T15:35:55.083003+0000","last_peered":"2024-04-16T15:35:55.083003+0000","last_clean":"2024-04-16T15:35:55.083003+0000","last_became_active":"2024-04-16T15:35:47.911408+0000","last_became_peered":"2024-04-16T15:35:47.911408+0000","last_unstale":"2024-04-16T15:35:55.083003+0000","last_undegraded":"2024-04-16T15:35:55.083003+0000","last_fullsized":"2024-04-16T15:35:55.083003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571080+0000","last_change":"2024-04-16T15:35:46.894699+0000","last_active":"2024-04-16T15:35:54.571080+0000","last_peered":"2024-04-16T15:35:54.571080+0000","last_clean":"2024-04-16T15:35:54.571080+0000","last_became_active":"2024-04-16T15:35:46.894408+0000","last_became_peered":"2024-04-16T15:35:46.894408+0000","last_unstale":"2024-04-16T15:35:54.571080+0000","last_undegraded":"2024-04-16T15:35:54.571080+0000","last_fullsized":"2024-04-16T15:35:54.571080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083498+0000","last_change":"2024-04-16T15:35:51.941063+0000","last_active":"2024-04-16T15:35:55.083498+0000","last_peered":"2024-04-16T15:35:55.083498+0000","last_clean":"2024-04-16T15:35:55.083498+0000","last_became_active":"2024-04-16T15:35:51.940669+0000","last_became_peered":"2024-04-16T15:35:51.940669+0000","last_unstale":"2024-04-16T15:35:55.083498+0000","last_undegraded":"2024-04-16T15:35:55.083498+0000","last_fullsized":"2024-04-16T15:35:55.083498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083196+0000","last_change":"2024-04-16T15:35:47.904932+0000","last_active":"2024-04-16T15:35:55.083196+0000","last_peered":"2024-04-16T15:35:55.083196+0000","last_clean":"2024-04-16T15:35:55.083196+0000","last_became_active":"2024-04-16T15:35:47.902287+0000","last_became_peered":"2024-04-16T15:35:47.902287+0000","last_unstale":"2024-04-16T15:35:55.083196+0000","last_undegraded":"2024-04-16T15:35:55.083196+0000","last_fullsized":"2024-04-16T15:35:55.083196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:46.901553+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:46.901306+0000","last_became_peered":"2024-04-16T15:35:46.901306+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083417+0000","last_change":"2024-04-16T15:35:52.664769+0000","last_active":"2024-04-16T15:35:55.083417+0000","last_peered":"2024-04-16T15:35:55.083417+0000","last_clean":"2024-04-16T15:35:55.083417+0000","last_became_active":"2024-04-16T15:35:52.664412+0000","last_became_peered":"2024-04-16T15:35:52.664412+0000","last_unstale":"2024-04-16T15:35:55.083417+0000","last_undegraded":"2024-04-16T15:35:55.083417+0000","last_fullsized":"2024-04-16T15:35:55.083417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927849+0000","last_change":"2024-04-16T15:35:47.922561+0000","last_active":"2024-04-16T15:35:53.927849+0000","last_peered":"2024-04-16T15:35:53.927849+0000","last_clean":"2024-04-16T15:35:53.927849+0000","last_became_active":"2024-04-16T15:35:47.922290+0000","last_became_peered":"2024-04-16T15:35:47.922290+0000","last_unstale":"2024-04-16T15:35:53.927849+0000","last_undegraded":"2024-04-16T15:35:53.927849+0000","last_fullsized":"2024-04-16T15:35:53.927849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930657+0000","last_change":"2024-04-16T15:35:46.896323+0000","last_active":"2024-04-16T15:35:53.930657+0000","last_peered":"2024-04-16T15:35:53.930657+0000","last_clean":"2024-04-16T15:35:53.930657+0000","last_became_active":"2024-04-16T15:35:46.895810+0000","last_became_peered":"2024-04-16T15:35:46.895810+0000","last_unstale":"2024-04-16T15:35:53.930657+0000","last_undegraded":"2024-04-16T15:35:53.930657+0000","last_fullsized":"2024-04-16T15:35:53.930657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083251+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:35:55.083251+0000","last_peered":"2024-04-16T15:35:55.083251+0000","last_clean":"2024-04-16T15:35:55.083251+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:35:55.083251+0000","last_undegraded":"2024-04-16T15:35:55.083251+0000","last_fullsized":"2024-04-16T15:35:55.083251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369307+0000","last_change":"2024-04-16T15:35:52.664786+0000","last_active":"2024-04-16T15:35:54.369307+0000","last_peered":"2024-04-16T15:35:54.369307+0000","last_clean":"2024-04-16T15:35:54.369307+0000","last_became_active":"2024-04-16T15:35:52.664391+0000","last_became_peered":"2024-04-16T15:35:52.664391+0000","last_unstale":"2024-04-16T15:35:54.369307+0000","last_undegraded":"2024-04-16T15:35:54.369307+0000","last_fullsized":"2024-04-16T15:35:54.369307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083545+0000","last_change":"2024-04-16T15:35:47.922117+0000","last_active":"2024-04-16T15:35:55.083545+0000","last_peered":"2024-04-16T15:35:55.083545+0000","last_clean":"2024-04-16T15:35:55.083545+0000","last_became_active":"2024-04-16T15:35:47.921710+0000","last_became_peered":"2024-04-16T15:35:47.921710+0000","last_unstale":"2024-04-16T15:35:55.083545+0000","last_undegraded":"2024-04-16T15:35:55.083545+0000","last_fullsized":"2024-04-16T15:35:55.083545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571271+0000","last_change":"2024-04-16T15:35:46.896754+0000","last_active":"2024-04-16T15:35:54.571271+0000","last_peered":"2024-04-16T15:35:54.571271+0000","last_clean":"2024-04-16T15:35:54.571271+0000","last_became_active":"2024-04-16T15:35:46.896444+0000","last_became_peered":"2024-04-16T15:35:46.896444+0000","last_unstale":"2024-04-16T15:35:54.571271+0000","last_undegraded":"2024-04-16T15:35:54.571271+0000","last_fullsized":"2024-04-16T15:35:54.571271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368973+0000","last_change":"2024-04-16T15:35:52.662295+0000","last_active":"2024-04-16T15:35:54.368973+0000","last_peered":"2024-04-16T15:35:54.368973+0000","last_clean":"2024-04-16T15:35:54.368973+0000","last_became_active":"2024-04-16T15:35:52.661789+0000","last_became_peered":"2024-04-16T15:35:52.661789+0000","last_unstale":"2024-04-16T15:35:54.368973+0000","last_undegraded":"2024-04-16T15:35:54.368973+0000","last_fullsized":"2024-04-16T15:35:54.368973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930470+0000","last_change":"2024-04-16T15:35:47.915448+0000","last_active":"2024-04-16T15:35:53.930470+0000","last_peered":"2024-04-16T15:35:53.930470+0000","last_clean":"2024-04-16T15:35:53.930470+0000","last_became_active":"2024-04-16T15:35:47.915151+0000","last_became_peered":"2024-04-16T15:35:47.915151+0000","last_unstale":"2024-04-16T15:35:53.930470+0000","last_undegraded":"2024-04-16T15:35:53.930470+0000","last_fullsized":"2024-04-16T15:35:53.930470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082565+0000","last_change":"2024-04-16T15:35:46.897447+0000","last_active":"2024-04-16T15:35:55.082565+0000","last_peered":"2024-04-16T15:35:55.082565+0000","last_clean":"2024-04-16T15:35:55.082565+0000","last_became_active":"2024-04-16T15:35:46.897179+0000","last_became_peered":"2024-04-16T15:35:46.897179+0000","last_unstale":"2024-04-16T15:35:55.082565+0000","last_undegraded":"2024-04-16T15:35:55.082565+0000","last_fullsized":"2024-04-16T15:35:55.082565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084143+0000","last_change":"2024-04-16T15:35:51.944235+0000","last_active":"2024-04-16T15:35:55.084143+0000","last_peered":"2024-04-16T15:35:55.084143+0000","last_clean":"2024-04-16T15:35:55.084143+0000","last_became_active":"2024-04-16T15:35:51.943896+0000","last_became_peered":"2024-04-16T15:35:51.943896+0000","last_unstale":"2024-04-16T15:35:55.084143+0000","last_undegraded":"2024-04-16T15:35:55.084143+0000","last_fullsized":"2024-04-16T15:35:55.084143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083827+0000","last_change":"2024-04-16T15:35:47.918103+0000","last_active":"2024-04-16T15:35:55.083827+0000","last_peered":"2024-04-16T15:35:55.083827+0000","last_clean":"2024-04-16T15:35:55.083827+0000","last_became_active":"2024-04-16T15:35:47.917822+0000","last_became_peered":"2024-04-16T15:35:47.917822+0000","last_unstale":"2024-04-16T15:35:55.083827+0000","last_undegraded":"2024-04-16T15:35:55.083827+0000","last_fullsized":"2024-04-16T15:35:55.083827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:17.070863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571348+0000","last_change":"2024-04-16T15:35:46.894341+0000","last_active":"2024-04-16T15:35:54.571348+0000","last_peered":"2024-04-16T15:35:54.571348+0000","last_clean":"2024-04-16T15:35:54.571348+0000","last_became_active":"2024-04-16T15:35:46.894073+0000","last_became_peered":"2024-04-16T15:35:46.894073+0000","last_unstale":"2024-04-16T15:35:54.571348+0000","last_undegraded":"2024-04-16T15:35:54.571348+0000","last_fullsized":"2024-04-16T15:35:54.571348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929370+0000","last_change":"2024-04-16T15:35:52.662624+0000","last_active":"2024-04-16T15:35:53.929370+0000","last_peered":"2024-04-16T15:35:53.929370+0000","last_clean":"2024-04-16T15:35:53.929370+0000","last_became_active":"2024-04-16T15:35:52.661957+0000","last_became_peered":"2024-04-16T15:35:52.661957+0000","last_unstale":"2024-04-16T15:35:53.929370+0000","last_undegraded":"2024-04-16T15:35:53.929370+0000","last_fullsized":"2024-04-16T15:35:53.929370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083699+0000","last_change":"2024-04-16T15:35:47.918195+0000","last_active":"2024-04-16T15:35:55.083699+0000","last_peered":"2024-04-16T15:35:55.083699+0000","last_clean":"2024-04-16T15:35:55.083699+0000","last_became_active":"2024-04-16T15:35:47.917803+0000","last_became_peered":"2024-04-16T15:35:47.917803+0000","last_unstale":"2024-04-16T15:35:55.083699+0000","last_undegraded":"2024-04-16T15:35:55.083699+0000","last_fullsized":"2024-04-16T15:35:55.083699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930244+0000","last_change":"2024-04-16T15:35:46.899018+0000","last_active":"2024-04-16T15:35:53.930244+0000","last_peered":"2024-04-16T15:35:53.930244+0000","last_clean":"2024-04-16T15:35:53.930244+0000","last_became_active":"2024-04-16T15:35:46.898729+0000","last_became_peered":"2024-04-16T15:35:46.898729+0000","last_unstale":"2024-04-16T15:35:53.930244+0000","last_undegraded":"2024-04-16T15:35:53.930244+0000","last_fullsized":"2024-04-16T15:35:53.930244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929608+0000","last_change":"2024-04-16T15:35:51.941144+0000","last_active":"2024-04-16T15:35:53.929608+0000","last_peered":"2024-04-16T15:35:53.929608+0000","last_clean":"2024-04-16T15:35:53.929608+0000","last_became_active":"2024-04-16T15:35:51.940597+0000","last_became_peered":"2024-04-16T15:35:51.940597+0000","last_unstale":"2024-04-16T15:35:53.929608+0000","last_undegraded":"2024-04-16T15:35:53.929608+0000","last_fullsized":"2024-04-16T15:35:53.929608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:41.324458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083262+0000","last_change":"2024-04-16T15:35:47.914496+0000","last_active":"2024-04-16T15:35:55.083262+0000","last_peered":"2024-04-16T15:35:55.083262+0000","last_clean":"2024-04-16T15:35:55.083262+0000","last_became_active":"2024-04-16T15:35:47.913786+0000","last_became_peered":"2024-04-16T15:35:47.913786+0000","last_unstale":"2024-04-16T15:35:55.083262+0000","last_undegraded":"2024-04-16T15:35:55.083262+0000","last_fullsized":"2024-04-16T15:35:55.083262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570927+0000","last_change":"2024-04-16T15:35:46.897628+0000","last_active":"2024-04-16T15:35:54.570927+0000","last_peered":"2024-04-16T15:35:54.570927+0000","last_clean":"2024-04-16T15:35:54.570927+0000","last_became_active":"2024-04-16T15:35:46.897367+0000","last_became_peered":"2024-04-16T15:35:46.897367+0000","last_unstale":"2024-04-16T15:35:54.570927+0000","last_undegraded":"2024-04-16T15:35:54.570927+0000","last_fullsized":"2024-04-16T15:35:54.570927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083283+0000","last_change":"2024-04-16T15:35:51.945992+0000","last_active":"2024-04-16T15:35:55.083283+0000","last_peered":"2024-04-16T15:35:55.083283+0000","last_clean":"2024-04-16T15:35:55.083283+0000","last_became_active":"2024-04-16T15:35:51.945596+0000","last_became_peered":"2024-04-16T15:35:51.945596+0000","last_unstale":"2024-04-16T15:35:55.083283+0000","last_undegraded":"2024-04-16T15:35:55.083283+0000","last_fullsized":"2024-04-16T15:35:55.083283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368868+0000","last_change":"2024-04-16T15:35:47.910686+0000","last_active":"2024-04-16T15:35:54.368868+0000","last_peered":"2024-04-16T15:35:54.368868+0000","last_clean":"2024-04-16T15:35:54.368868+0000","last_became_active":"2024-04-16T15:35:47.910289+0000","last_became_peered":"2024-04-16T15:35:47.910289+0000","last_unstale":"2024-04-16T15:35:54.368868+0000","last_undegraded":"2024-04-16T15:35:54.368868+0000","last_fullsized":"2024-04-16T15:35:54.368868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368949+0000","last_change":"2024-04-16T15:35:46.899316+0000","last_active":"2024-04-16T15:35:54.368949+0000","last_peered":"2024-04-16T15:35:54.368949+0000","last_clean":"2024-04-16T15:35:54.368949+0000","last_became_active":"2024-04-16T15:35:46.899031+0000","last_became_peered":"2024-04-16T15:35:46.899031+0000","last_unstale":"2024-04-16T15:35:54.368949+0000","last_undegraded":"2024-04-16T15:35:54.368949+0000","last_fullsized":"2024-04-16T15:35:54.368949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928588+0000","last_change":"2024-04-16T15:35:52.665294+0000","last_active":"2024-04-16T15:35:53.928588+0000","last_peered":"2024-04-16T15:35:53.928588+0000","last_clean":"2024-04-16T15:35:53.928588+0000","last_became_active":"2024-04-16T15:35:52.664948+0000","last_became_peered":"2024-04-16T15:35:52.664948+0000","last_unstale":"2024-04-16T15:35:53.928588+0000","last_undegraded":"2024-04-16T15:35:53.928588+0000","last_fullsized":"2024-04-16T15:35:53.928588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:52.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083368+0000","last_change":"2024-04-16T15:35:47.921106+0000","last_active":"2024-04-16T15:35:55.083368+0000","last_peered":"2024-04-16T15:35:55.083368+0000","last_clean":"2024-04-16T15:35:55.083368+0000","last_became_active":"2024-04-16T15:35:47.920831+0000","last_became_peered":"2024-04-16T15:35:47.920831+0000","last_unstale":"2024-04-16T15:35:55.083368+0000","last_undegraded":"2024-04-16T15:35:55.083368+0000","last_fullsized":"2024-04-16T15:35:55.083368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930813+0000","last_change":"2024-04-16T15:35:46.894785+0000","last_active":"2024-04-16T15:35:53.930813+0000","last_peered":"2024-04-16T15:35:53.930813+0000","last_clean":"2024-04-16T15:35:53.930813+0000","last_became_active":"2024-04-16T15:35:46.894416+0000","last_became_peered":"2024-04-16T15:35:46.894416+0000","last_unstale":"2024-04-16T15:35:53.930813+0000","last_undegraded":"2024-04-16T15:35:53.930813+0000","last_fullsized":"2024-04-16T15:35:53.930813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928344+0000","last_change":"2024-04-16T15:35:52.662123+0000","last_active":"2024-04-16T15:35:53.928344+0000","last_peered":"2024-04-16T15:35:53.928344+0000","last_clean":"2024-04-16T15:35:53.928344+0000","last_became_active":"2024-04-16T15:35:52.661758+0000","last_became_peered":"2024-04-16T15:35:52.661758+0000","last_unstale":"2024-04-16T15:35:53.928344+0000","last_undegraded":"2024-04-16T15:35:53.928344+0000","last_fullsized":"2024-04-16T15:35:53.928344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:12.922280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083720+0000","last_change":"2024-04-16T15:35:47.916216+0000","last_active":"2024-04-16T15:35:55.083720+0000","last_peered":"2024-04-16T15:35:55.083720+0000","last_clean":"2024-04-16T15:35:55.083720+0000","last_became_active":"2024-04-16T15:35:47.915566+0000","last_became_peered":"2024-04-16T15:35:47.915566+0000","last_unstale":"2024-04-16T15:35:55.083720+0000","last_undegraded":"2024-04-16T15:35:55.083720+0000","last_fullsized":"2024-04-16T15:35:55.083720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082527+0000","last_change":"2024-04-16T15:35:46.897293+0000","last_active":"2024-04-16T15:35:55.082527+0000","last_peered":"2024-04-16T15:35:55.082527+0000","last_clean":"2024-04-16T15:35:55.082527+0000","last_became_active":"2024-04-16T15:35:46.897006+0000","last_became_peered":"2024-04-16T15:35:46.897006+0000","last_unstale":"2024-04-16T15:35:55.082527+0000","last_undegraded":"2024-04-16T15:35:55.082527+0000","last_fullsized":"2024-04-16T15:35:55.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931065+0000","last_change":"2024-04-16T15:35:52.664883+0000","last_active":"2024-04-16T15:35:53.931065+0000","last_peered":"2024-04-16T15:35:53.931065+0000","last_clean":"2024-04-16T15:35:53.931065+0000","last_became_active":"2024-04-16T15:35:52.664454+0000","last_became_peered":"2024-04-16T15:35:52.664454+0000","last_unstale":"2024-04-16T15:35:53.931065+0000","last_undegraded":"2024-04-16T15:35:53.931065+0000","last_fullsized":"2024-04-16T15:35:53.931065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083452+0000","last_change":"2024-04-16T15:35:47.922333+0000","last_active":"2024-04-16T15:35:55.083452+0000","last_peered":"2024-04-16T15:35:55.083452+0000","last_clean":"2024-04-16T15:35:55.083452+0000","last_became_active":"2024-04-16T15:35:47.922051+0000","last_became_peered":"2024-04-16T15:35:47.922051+0000","last_unstale":"2024-04-16T15:35:55.083452+0000","last_undegraded":"2024-04-16T15:35:55.083452+0000","last_fullsized":"2024-04-16T15:35:55.083452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:57.478864+0000","last_change":"2024-04-16T15:35:46.899953+0000","last_active":"2024-04-16T15:35:57.478864+0000","last_peered":"2024-04-16T15:35:57.478864+0000","last_clean":"2024-04-16T15:35:57.478864+0000","last_became_active":"2024-04-16T15:35:46.899684+0000","last_became_peered":"2024-04-16T15:35:46.899684+0000","last_unstale":"2024-04-16T15:35:57.478864+0000","last_undegraded":"2024-04-16T15:35:57.478864+0000","last_fullsized":"2024-04-16T15:35:57.478864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084387+0000","last_change":"2024-04-16T15:35:51.940461+0000","last_active":"2024-04-16T15:35:55.084387+0000","last_peered":"2024-04-16T15:35:55.084387+0000","last_clean":"2024-04-16T15:35:55.084387+0000","last_became_active":"2024-04-16T15:35:51.940074+0000","last_became_peered":"2024-04-16T15:35:51.940074+0000","last_unstale":"2024-04-16T15:35:55.084387+0000","last_undegraded":"2024-04-16T15:35:55.084387+0000","last_fullsized":"2024-04-16T15:35:55.084387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931115+0000","last_change":"2024-04-16T15:35:47.914523+0000","last_active":"2024-04-16T15:35:53.931115+0000","last_peered":"2024-04-16T15:35:53.931115+0000","last_clean":"2024-04-16T15:35:53.931115+0000","last_became_active":"2024-04-16T15:35:47.914263+0000","last_became_peered":"2024-04-16T15:35:47.914263+0000","last_unstale":"2024-04-16T15:35:53.931115+0000","last_undegraded":"2024-04-16T15:35:53.931115+0000","last_fullsized":"2024-04-16T15:35:53.931115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:49.648392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082701+0000","last_change":"2024-04-16T15:35:46.902816+0000","last_active":"2024-04-16T15:35:55.082701+0000","last_peered":"2024-04-16T15:35:55.082701+0000","last_clean":"2024-04-16T15:35:55.082701+0000","last_became_active":"2024-04-16T15:35:46.901873+0000","last_became_peered":"2024-04-16T15:35:46.901873+0000","last_unstale":"2024-04-16T15:35:55.082701+0000","last_undegraded":"2024-04-16T15:35:55.082701+0000","last_fullsized":"2024-04-16T15:35:55.082701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930687+0000","last_change":"2024-04-16T15:35:51.945111+0000","last_active":"2024-04-16T15:35:53.930687+0000","last_peered":"2024-04-16T15:35:53.930687+0000","last_clean":"2024-04-16T15:35:53.930687+0000","last_became_active":"2024-04-16T15:35:51.944177+0000","last_became_peered":"2024-04-16T15:35:51.944177+0000","last_unstale":"2024-04-16T15:35:53.930687+0000","last_undegraded":"2024-04-16T15:35:53.930687+0000","last_fullsized":"2024-04-16T15:35:53.930687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083788+0000","last_change":"2024-04-16T15:35:47.920026+0000","last_active":"2024-04-16T15:35:55.083788+0000","last_peered":"2024-04-16T15:35:55.083788+0000","last_clean":"2024-04-16T15:35:55.083788+0000","last_became_active":"2024-04-16T15:35:47.919754+0000","last_became_peered":"2024-04-16T15:35:47.919754+0000","last_unstale":"2024-04-16T15:35:55.083788+0000","last_undegraded":"2024-04-16T15:35:55.083788+0000","last_fullsized":"2024-04-16T15:35:55.083788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929875+0000","last_change":"2024-04-16T15:35:46.901151+0000","last_active":"2024-04-16T15:35:53.929875+0000","last_peered":"2024-04-16T15:35:53.929875+0000","last_clean":"2024-04-16T15:35:53.929875+0000","last_became_active":"2024-04-16T15:35:46.900666+0000","last_became_peered":"2024-04-16T15:35:46.900666+0000","last_unstale":"2024-04-16T15:35:53.929875+0000","last_undegraded":"2024-04-16T15:35:53.929875+0000","last_fullsized":"2024-04-16T15:35:53.929875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927908+0000","last_change":"2024-04-16T15:35:51.942012+0000","last_active":"2024-04-16T15:35:53.927908+0000","last_peered":"2024-04-16T15:35:53.927908+0000","last_clean":"2024-04-16T15:35:53.927908+0000","last_became_active":"2024-04-16T15:35:51.941666+0000","last_became_peered":"2024-04-16T15:35:51.941666+0000","last_unstale":"2024-04-16T15:35:53.927908+0000","last_undegraded":"2024-04-16T15:35:53.927908+0000","last_fullsized":"2024-04-16T15:35:53.927908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:07.372834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929764+0000","last_change":"2024-04-16T15:35:47.916230+0000","last_active":"2024-04-16T15:35:53.929764+0000","last_peered":"2024-04-16T15:35:53.929764+0000","last_clean":"2024-04-16T15:35:53.929764+0000","last_became_active":"2024-04-16T15:35:47.915930+0000","last_became_peered":"2024-04-16T15:35:47.915930+0000","last_unstale":"2024-04-16T15:35:53.929764+0000","last_undegraded":"2024-04-16T15:35:53.929764+0000","last_fullsized":"2024-04-16T15:35:53.929764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369463+0000","last_change":"2024-04-16T15:35:46.899249+0000","last_active":"2024-04-16T15:35:54.369463+0000","last_peered":"2024-04-16T15:35:54.369463+0000","last_clean":"2024-04-16T15:35:54.369463+0000","last_became_active":"2024-04-16T15:35:46.898904+0000","last_became_peered":"2024-04-16T15:35:46.898904+0000","last_unstale":"2024-04-16T15:35:54.369463+0000","last_undegraded":"2024-04-16T15:35:54.369463+0000","last_fullsized":"2024-04-16T15:35:54.369463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928158+0000","last_change":"2024-04-16T15:35:52.664770+0000","last_active":"2024-04-16T15:35:53.928158+0000","last_peered":"2024-04-16T15:35:53.928158+0000","last_clean":"2024-04-16T15:35:53.928158+0000","last_became_active":"2024-04-16T15:35:52.664405+0000","last_became_peered":"2024-04-16T15:35:52.664405+0000","last_unstale":"2024-04-16T15:35:53.928158+0000","last_undegraded":"2024-04-16T15:35:53.928158+0000","last_fullsized":"2024-04-16T15:35:53.928158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:44.943582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083145+0000","last_change":"2024-04-16T15:35:52.664928+0000","last_active":"2024-04-16T15:35:55.083145+0000","last_peered":"2024-04-16T15:35:55.083145+0000","last_clean":"2024-04-16T15:35:55.083145+0000","last_became_active":"2024-04-16T15:35:52.664390+0000","last_became_peered":"2024-04-16T15:35:52.664390+0000","last_unstale":"2024-04-16T15:35:55.083145+0000","last_undegraded":"2024-04-16T15:35:55.083145+0000","last_fullsized":"2024-04-16T15:35:55.083145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083042+0000","last_change":"2024-04-16T15:35:47.913302+0000","last_active":"2024-04-16T15:35:55.083042+0000","last_peered":"2024-04-16T15:35:55.083042+0000","last_clean":"2024-04-16T15:35:55.083042+0000","last_became_active":"2024-04-16T15:35:47.912246+0000","last_became_peered":"2024-04-16T15:35:47.912246+0000","last_unstale":"2024-04-16T15:35:55.083042+0000","last_undegraded":"2024-04-16T15:35:55.083042+0000","last_fullsized":"2024-04-16T15:35:55.083042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929579+0000","last_change":"2024-04-16T15:35:46.895206+0000","last_active":"2024-04-16T15:35:53.929579+0000","last_peered":"2024-04-16T15:35:53.929579+0000","last_clean":"2024-04-16T15:35:53.929579+0000","last_became_active":"2024-04-16T15:35:46.894912+0000","last_became_peered":"2024-04-16T15:35:46.894912+0000","last_unstale":"2024-04-16T15:35:53.929579+0000","last_undegraded":"2024-04-16T15:35:53.929579+0000","last_fullsized":"2024-04-16T15:35:53.929579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369422+0000","last_change":"2024-04-16T15:35:51.941806+0000","last_active":"2024-04-16T15:35:54.369422+0000","last_peered":"2024-04-16T15:35:54.369422+0000","last_clean":"2024-04-16T15:35:54.369422+0000","last_became_active":"2024-04-16T15:35:51.941433+0000","last_became_peered":"2024-04-16T15:35:51.941433+0000","last_unstale":"2024-04-16T15:35:54.369422+0000","last_undegraded":"2024-04-16T15:35:54.369422+0000","last_fullsized":"2024-04-16T15:35:54.369422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928093+0000","last_change":"2024-04-16T15:35:47.911758+0000","last_active":"2024-04-16T15:35:53.928093+0000","last_peered":"2024-04-16T15:35:53.928093+0000","last_clean":"2024-04-16T15:35:53.928093+0000","last_became_active":"2024-04-16T15:35:47.911245+0000","last_became_peered":"2024-04-16T15:35:47.911245+0000","last_unstale":"2024-04-16T15:35:53.928093+0000","last_undegraded":"2024-04-16T15:35:53.928093+0000","last_fullsized":"2024-04-16T15:35:53.928093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928041+0000","last_change":"2024-04-16T15:35:46.900742+0000","last_active":"2024-04-16T15:35:53.928041+0000","last_peered":"2024-04-16T15:35:53.928041+0000","last_clean":"2024-04-16T15:35:53.928041+0000","last_became_active":"2024-04-16T15:35:46.900416+0000","last_became_peered":"2024-04-16T15:35:46.900416+0000","last_unstale":"2024-04-16T15:35:53.928041+0000","last_undegraded":"2024-04-16T15:35:53.928041+0000","last_fullsized":"2024-04-16T15:35:53.928041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369097+0000","last_change":"2024-04-16T15:35:46.895563+0000","last_active":"2024-04-16T15:35:54.369097+0000","last_peered":"2024-04-16T15:35:54.369097+0000","last_clean":"2024-04-16T15:35:54.369097+0000","last_became_active":"2024-04-16T15:35:46.895267+0000","last_became_peered":"2024-04-16T15:35:46.895267+0000","last_unstale":"2024-04-16T15:35:54.369097+0000","last_undegraded":"2024-04-16T15:35:54.369097+0000","last_fullsized":"2024-04-16T15:35:54.369097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084188+0000","last_change":"2024-04-16T15:35:47.904515+0000","last_active":"2024-04-16T15:35:55.084188+0000","last_peered":"2024-04-16T15:35:55.084188+0000","last_clean":"2024-04-16T15:35:55.084188+0000","last_became_active":"2024-04-16T15:35:47.902329+0000","last_became_peered":"2024-04-16T15:35:47.902329+0000","last_unstale":"2024-04-16T15:35:55.084188+0000","last_undegraded":"2024-04-16T15:35:55.084188+0000","last_fullsized":"2024-04-16T15:35:55.084188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571221+0000","last_change":"2024-04-16T15:35:51.942716+0000","last_active":"2024-04-16T15:35:54.571221+0000","last_peered":"2024-04-16T15:35:54.571221+0000","last_clean":"2024-04-16T15:35:54.571221+0000","last_became_active":"2024-04-16T15:35:51.942306+0000","last_became_peered":"2024-04-16T15:35:51.942306+0000","last_unstale":"2024-04-16T15:35:54.571221+0000","last_undegraded":"2024-04-16T15:35:54.571221+0000","last_fullsized":"2024-04-16T15:35:54.571221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:21.643419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928089+0000","last_change":"2024-04-16T15:35:46.903607+0000","last_active":"2024-04-16T15:35:53.928089+0000","last_peered":"2024-04-16T15:35:53.928089+0000","last_clean":"2024-04-16T15:35:53.928089+0000","last_became_active":"2024-04-16T15:35:46.903329+0000","last_became_peered":"2024-04-16T15:35:46.903329+0000","last_unstale":"2024-04-16T15:35:53.928089+0000","last_undegraded":"2024-04-16T15:35:53.928089+0000","last_fullsized":"2024-04-16T15:35:53.928089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.903874+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.903605+0000","last_became_peered":"2024-04-16T15:35:47.903605+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:34.270943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928371+0000","last_change":"2024-04-16T15:35:51.941375+0000","last_active":"2024-04-16T15:35:53.928371+0000","last_peered":"2024-04-16T15:35:53.928371+0000","last_clean":"2024-04-16T15:35:53.928371+0000","last_became_active":"2024-04-16T15:35:51.940976+0000","last_became_peered":"2024-04-16T15:35:51.940976+0000","last_unstale":"2024-04-16T15:35:53.928371+0000","last_undegraded":"2024-04-16T15:35:53.928371+0000","last_fullsized":"2024-04-16T15:35:53.928371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:26.365805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368749+0000","last_change":"2024-04-16T15:35:47.911340+0000","last_active":"2024-04-16T15:35:54.368749+0000","last_peered":"2024-04-16T15:35:54.368749+0000","last_clean":"2024-04-16T15:35:54.368749+0000","last_became_active":"2024-04-16T15:35:47.910024+0000","last_became_peered":"2024-04-16T15:35:47.910024+0000","last_unstale":"2024-04-16T15:35:54.368749+0000","last_undegraded":"2024-04-16T15:35:54.368749+0000","last_fullsized":"2024-04-16T15:35:54.368749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570957+0000","last_change":"2024-04-16T15:35:47.921417+0000","last_active":"2024-04-16T15:35:54.570957+0000","last_peered":"2024-04-16T15:35:54.570957+0000","last_clean":"2024-04-16T15:35:54.570957+0000","last_became_active":"2024-04-16T15:35:47.921049+0000","last_became_peered":"2024-04-16T15:35:47.921049+0000","last_unstale":"2024-04-16T15:35:54.570957+0000","last_undegraded":"2024-04-16T15:35:54.570957+0000","last_fullsized":"2024-04-16T15:35:54.570957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.921766+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.921491+0000","last_became_peered":"2024-04-16T15:35:47.921491+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084075+0000","last_change":"2024-04-16T15:35:47.913693+0000","last_active":"2024-04-16T15:35:55.084075+0000","last_peered":"2024-04-16T15:35:55.084075+0000","last_clean":"2024-04-16T15:35:55.084075+0000","last_became_active":"2024-04-16T15:35:47.912712+0000","last_became_peered":"2024-04-16T15:35:47.912712+0000","last_unstale":"2024-04-16T15:35:55.084075+0000","last_undegraded":"2024-04-16T15:35:55.084075+0000","last_fullsized":"2024-04-16T15:35:55.084075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928318+0000","last_change":"2024-04-16T15:35:47.910738+0000","last_active":"2024-04-16T15:35:53.928318+0000","last_peered":"2024-04-16T15:35:53.928318+0000","last_clean":"2024-04-16T15:35:53.928318+0000","last_became_active":"2024-04-16T15:35:47.910305+0000","last_became_peered":"2024-04-16T15:35:47.910305+0000","last_unstale":"2024-04-16T15:35:53.928318+0000","last_undegraded":"2024-04-16T15:35:53.928318+0000","last_fullsized":"2024-04-16T15:35:53.928318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082815+0000","last_change":"2024-04-16T15:35:47.912617+0000","last_active":"2024-04-16T15:35:55.082815+0000","last_peered":"2024-04-16T15:35:55.082815+0000","last_clean":"2024-04-16T15:35:55.082815+0000","last_became_active":"2024-04-16T15:35:47.912319+0000","last_became_peered":"2024-04-16T15:35:47.912319+0000","last_unstale":"2024-04-16T15:35:55.082815+0000","last_undegraded":"2024-04-16T15:35:55.082815+0000","last_fullsized":"2024-04-16T15:35:55.082815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369503+0000","last_change":"2024-04-16T15:35:47.914226+0000","last_active":"2024-04-16T15:35:54.369503+0000","last_peered":"2024-04-16T15:35:54.369503+0000","last_clean":"2024-04-16T15:35:54.369503+0000","last_became_active":"2024-04-16T15:35:47.913944+0000","last_became_peered":"2024-04-16T15:35:47.913944+0000","last_unstale":"2024-04-16T15:35:54.369503+0000","last_undegraded":"2024-04-16T15:35:54.369503+0000","last_fullsized":"2024-04-16T15:35:54.369503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928560+0000","last_change":"2024-04-16T15:35:47.910810+0000","last_active":"2024-04-16T15:35:53.928560+0000","last_peered":"2024-04-16T15:35:53.928560+0000","last_clean":"2024-04-16T15:35:53.928560+0000","last_became_active":"2024-04-16T15:35:47.910509+0000","last_became_peered":"2024-04-16T15:35:47.910509+0000","last_unstale":"2024-04-16T15:35:53.928560+0000","last_undegraded":"2024-04-16T15:35:53.928560+0000","last_fullsized":"2024-04-16T15:35:53.928560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929472+0000","last_change":"2024-04-16T15:35:47.921447+0000","last_active":"2024-04-16T15:35:53.929472+0000","last_peered":"2024-04-16T15:35:53.929472+0000","last_clean":"2024-04-16T15:35:53.929472+0000","last_became_active":"2024-04-16T15:35:47.921165+0000","last_became_peered":"2024-04-16T15:35:47.921165+0000","last_unstale":"2024-04-16T15:35:53.929472+0000","last_undegraded":"2024-04-16T15:35:53.929472+0000","last_fullsized":"2024-04-16T15:35:53.929472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927957+0000","last_change":"2024-04-16T15:35:47.909329+0000","last_active":"2024-04-16T15:35:53.927957+0000","last_peered":"2024-04-16T15:35:53.927957+0000","last_clean":"2024-04-16T15:35:53.927957+0000","last_became_active":"2024-04-16T15:35:47.908921+0000","last_became_peered":"2024-04-16T15:35:47.908921+0000","last_unstale":"2024-04-16T15:35:53.927957+0000","last_undegraded":"2024-04-16T15:35:53.927957+0000","last_fullsized":"2024-04-16T15:35:53.927957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930611+0000","last_change":"2024-04-16T15:35:47.916529+0000","last_active":"2024-04-16T15:35:53.930611+0000","last_peered":"2024-04-16T15:35:53.930611+0000","last_clean":"2024-04-16T15:35:53.930611+0000","last_became_active":"2024-04-16T15:35:47.916272+0000","last_became_peered":"2024-04-16T15:35:47.916272+0000","last_unstale":"2024-04-16T15:35:53.930611+0000","last_undegraded":"2024-04-16T15:35:53.930611+0000","last_fullsized":"2024-04-16T15:35:53.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083999+0000","last_change":"2024-04-16T15:35:47.916637+0000","last_active":"2024-04-16T15:35:55.083999+0000","last_peered":"2024-04-16T15:35:55.083999+0000","last_clean":"2024-04-16T15:35:55.083999+0000","last_became_active":"2024-04-16T15:35:47.915756+0000","last_became_peered":"2024-04-16T15:35:47.915756+0000","last_unstale":"2024-04-16T15:35:55.083999+0000","last_undegraded":"2024-04-16T15:35:55.083999+0000","last_fullsized":"2024-04-16T15:35:55.083999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369168+0000","last_change":"2024-04-16T15:35:47.905523+0000","last_active":"2024-04-16T15:35:54.369168+0000","last_peered":"2024-04-16T15:35:54.369168+0000","last_clean":"2024-04-16T15:35:54.369168+0000","last_became_active":"2024-04-16T15:35:47.905101+0000","last_became_peered":"2024-04-16T15:35:47.905101+0000","last_unstale":"2024-04-16T15:35:54.369168+0000","last_undegraded":"2024-04-16T15:35:54.369168+0000","last_fullsized":"2024-04-16T15:35:54.369168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083700+0000","last_change":"2024-04-16T15:35:47.917168+0000","last_active":"2024-04-16T15:35:55.083700+0000","last_peered":"2024-04-16T15:35:55.083700+0000","last_clean":"2024-04-16T15:35:55.083700+0000","last_became_active":"2024-04-16T15:35:47.914760+0000","last_became_peered":"2024-04-16T15:35:47.914760+0000","last_unstale":"2024-04-16T15:35:55.083700+0000","last_undegraded":"2024-04-16T15:35:55.083700+0000","last_fullsized":"2024-04-16T15:35:55.083700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:58.573474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571311+0000","last_change":"2024-04-16T15:35:47.906661+0000","last_active":"2024-04-16T15:35:54.571311+0000","last_peered":"2024-04-16T15:35:54.571311+0000","last_clean":"2024-04-16T15:35:54.571311+0000","last_became_active":"2024-04-16T15:35:47.906376+0000","last_became_peered":"2024-04-16T15:35:47.906376+0000","last_unstale":"2024-04-16T15:35:54.571311+0000","last_undegraded":"2024-04-16T15:35:54.571311+0000","last_fullsized":"2024-04-16T15:35:54.571311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930697+0000","last_change":"2024-04-16T15:35:47.918857+0000","last_active":"2024-04-16T15:35:53.930697+0000","last_peered":"2024-04-16T15:35:53.930697+0000","last_clean":"2024-04-16T15:35:53.930697+0000","last_became_active":"2024-04-16T15:35:47.918601+0000","last_became_peered":"2024-04-16T15:35:47.918601+0000","last_unstale":"2024-04-16T15:35:53.930697+0000","last_undegraded":"2024-04-16T15:35:53.930697+0000","last_fullsized":"2024-04-16T15:35:53.930697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929331+0000","last_change":"2024-04-16T15:35:47.903123+0000","last_active":"2024-04-16T15:35:53.929331+0000","last_peered":"2024-04-16T15:35:53.929331+0000","last_clean":"2024-04-16T15:35:53.929331+0000","last_became_active":"2024-04-16T15:35:47.902519+0000","last_became_peered":"2024-04-16T15:35:47.902519+0000","last_unstale":"2024-04-16T15:35:53.929331+0000","last_undegraded":"2024-04-16T15:35:53.929331+0000","last_fullsized":"2024-04-16T15:35:53.929331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:47.906920+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:47.906647+0000","last_became_peered":"2024-04-16T15:35:47.906647+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083651+0000","last_change":"2024-04-16T15:35:47.903897+0000","last_active":"2024-04-16T15:35:55.083651+0000","last_peered":"2024-04-16T15:35:55.083651+0000","last_clean":"2024-04-16T15:35:55.083651+0000","last_became_active":"2024-04-16T15:35:47.903636+0000","last_became_peered":"2024-04-16T15:35:47.903636+0000","last_unstale":"2024-04-16T15:35:55.083651+0000","last_undegraded":"2024-04-16T15:35:55.083651+0000","last_fullsized":"2024-04-16T15:35:55.083651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:17.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927930+0000","last_change":"2024-04-16T15:35:47.919522+0000","last_active":"2024-04-16T15:35:53.927930+0000","last_peered":"2024-04-16T15:35:53.927930+0000","last_clean":"2024-04-16T15:35:53.927930+0000","last_became_active":"2024-04-16T15:35:47.919224+0000","last_became_peered":"2024-04-16T15:35:47.919224+0000","last_unstale":"2024-04-16T15:35:53.927930+0000","last_undegraded":"2024-04-16T15:35:53.927930+0000","last_fullsized":"2024-04-16T15:35:53.927930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931084+0000","last_change":"2024-04-16T15:35:47.904535+0000","last_active":"2024-04-16T15:35:53.931084+0000","last_peered":"2024-04-16T15:35:53.931084+0000","last_clean":"2024-04-16T15:35:53.931084+0000","last_became_active":"2024-04-16T15:35:47.904263+0000","last_became_peered":"2024-04-16T15:35:47.904263+0000","last_unstale":"2024-04-16T15:35:53.931084+0000","last_undegraded":"2024-04-16T15:35:53.931084+0000","last_fullsized":"2024-04-16T15:35:53.931084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369248+0000","last_change":"2024-04-16T15:35:47.908367+0000","last_active":"2024-04-16T15:35:54.369248+0000","last_peered":"2024-04-16T15:35:54.369248+0000","last_clean":"2024-04-16T15:35:54.369248+0000","last_became_active":"2024-04-16T15:35:47.908073+0000","last_became_peered":"2024-04-16T15:35:47.908073+0000","last_unstale":"2024-04-16T15:35:54.369248+0000","last_undegraded":"2024-04-16T15:35:54.369248+0000","last_fullsized":"2024-04-16T15:35:54.369248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369451+0000","last_change":"2024-04-16T15:35:47.907751+0000","last_active":"2024-04-16T15:35:54.369451+0000","last_peered":"2024-04-16T15:35:54.369451+0000","last_clean":"2024-04-16T15:35:54.369451+0000","last_became_active":"2024-04-16T15:35:47.907492+0000","last_became_peered":"2024-04-16T15:35:47.907492+0000","last_unstale":"2024-04-16T15:35:54.369451+0000","last_undegraded":"2024-04-16T15:35:54.369451+0000","last_fullsized":"2024-04-16T15:35:54.369451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083822+0000","last_change":"2024-04-16T15:35:47.922537+0000","last_active":"2024-04-16T15:35:55.083822+0000","last_peered":"2024-04-16T15:35:55.083822+0000","last_clean":"2024-04-16T15:35:55.083822+0000","last_became_active":"2024-04-16T15:35:47.922261+0000","last_became_peered":"2024-04-16T15:35:47.922261+0000","last_unstale":"2024-04-16T15:35:55.083822+0000","last_undegraded":"2024-04-16T15:35:55.083822+0000","last_fullsized":"2024-04-16T15:35:55.083822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927732+0000","last_change":"2024-04-16T15:35:47.921897+0000","last_active":"2024-04-16T15:35:53.927732+0000","last_peered":"2024-04-16T15:35:53.927732+0000","last_clean":"2024-04-16T15:35:53.927732+0000","last_became_active":"2024-04-16T15:35:47.921646+0000","last_became_peered":"2024-04-16T15:35:47.921646+0000","last_unstale":"2024-04-16T15:35:53.927732+0000","last_undegraded":"2024-04-16T15:35:53.927732+0000","last_fullsized":"2024-04-16T15:35:53.927732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083179+0000","last_change":"2024-04-16T15:35:47.920391+0000","last_active":"2024-04-16T15:35:55.083179+0000","last_peered":"2024-04-16T15:35:55.083179+0000","last_clean":"2024-04-16T15:35:55.083179+0000","last_became_active":"2024-04-16T15:35:47.920071+0000","last_became_peered":"2024-04-16T15:35:47.920071+0000","last_unstale":"2024-04-16T15:35:55.083179+0000","last_undegraded":"2024-04-16T15:35:55.083179+0000","last_fullsized":"2024-04-16T15:35:55.083179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930585+0000","last_change":"2024-04-16T15:35:47.903213+0000","last_active":"2024-04-16T15:35:53.930585+0000","last_peered":"2024-04-16T15:35:53.930585+0000","last_clean":"2024-04-16T15:35:53.930585+0000","last_became_active":"2024-04-16T15:35:47.902785+0000","last_became_peered":"2024-04-16T15:35:47.902785+0000","last_unstale":"2024-04-16T15:35:53.930585+0000","last_undegraded":"2024-04-16T15:35:53.930585+0000","last_fullsized":"2024-04-16T15:35:53.930585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083264+0000","last_change":"2024-04-16T15:35:47.914772+0000","last_active":"2024-04-16T15:35:55.083264+0000","last_peered":"2024-04-16T15:35:55.083264+0000","last_clean":"2024-04-16T15:35:55.083264+0000","last_became_active":"2024-04-16T15:35:47.913751+0000","last_became_peered":"2024-04-16T15:35:47.913751+0000","last_unstale":"2024-04-16T15:35:55.083264+0000","last_undegraded":"2024-04-16T15:35:55.083264+0000","last_fullsized":"2024-04-16T15:35:55.083264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930257+0000","last_change":"2024-04-16T15:35:47.914826+0000","last_active":"2024-04-16T15:35:53.930257+0000","last_peered":"2024-04-16T15:35:53.930257+0000","last_clean":"2024-04-16T15:35:53.930257+0000","last_became_active":"2024-04-16T15:35:47.913014+0000","last_became_peered":"2024-04-16T15:35:47.913014+0000","last_unstale":"2024-04-16T15:35:53.930257+0000","last_undegraded":"2024-04-16T15:35:53.930257+0000","last_fullsized":"2024-04-16T15:35:53.930257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083035+0000","last_change":"2024-04-16T15:35:47.907911+0000","last_active":"2024-04-16T15:35:55.083035+0000","last_peered":"2024-04-16T15:35:55.083035+0000","last_clean":"2024-04-16T15:35:55.083035+0000","last_became_active":"2024-04-16T15:35:47.907655+0000","last_became_peered":"2024-04-16T15:35:47.907655+0000","last_unstale":"2024-04-16T15:35:55.083035+0000","last_undegraded":"2024-04-16T15:35:55.083035+0000","last_fullsized":"2024-04-16T15:35:55.083035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083534+0000","last_change":"2024-04-16T15:35:47.907719+0000","last_active":"2024-04-16T15:35:55.083534+0000","last_peered":"2024-04-16T15:35:55.083534+0000","last_clean":"2024-04-16T15:35:55.083534+0000","last_became_active":"2024-04-16T15:35:47.907381+0000","last_became_peered":"2024-04-16T15:35:47.907381+0000","last_unstale":"2024-04-16T15:35:55.083534+0000","last_undegraded":"2024-04-16T15:35:55.083534+0000","last_fullsized":"2024-04-16T15:35:55.083534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083718+0000","last_change":"2024-04-16T15:35:47.913767+0000","last_active":"2024-04-16T15:35:55.083718+0000","last_peered":"2024-04-16T15:35:55.083718+0000","last_clean":"2024-04-16T15:35:55.083718+0000","last_became_active":"2024-04-16T15:35:47.913475+0000","last_became_peered":"2024-04-16T15:35:47.913475+0000","last_unstale":"2024-04-16T15:35:55.083718+0000","last_undegraded":"2024-04-16T15:35:55.083718+0000","last_fullsized":"2024-04-16T15:35:55.083718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:36:09.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:36:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.487+0000 7f4fe2172640 1 Processor -- start 2024-04-16T15:36:09.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.487+0000 7f4fe2172640 1 -- start start 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fe2172640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fdc15e780 0x7f4fdc0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fe2172640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 0x7f4fdc0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fe2172640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fdc0b7ce0 con 0x7f4fdc0d26d0 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fe2172640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc0ba670 con 0x7f4fdc15e780 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fe2172640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc0b7fc0 con 0x7f4fdc0cf360 2024-04-16T15:36:09.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fdc15e780 0x7f4fdc0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4fdc15e780 0x7f4fdc0b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35032/0 (socket says 172.21.15.80:35032) 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/123884563 learned_addr learned my addr 172.21.15.80:0/123884563 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 0x7f4fdc0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/123884563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 msgr2=0x7f4fdc0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 0x7f4fdc0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/123884563 >> v1:172.21.15.87:6789/0 conn(0x7f4fdc0d26d0 legacy=0x7f4fdc0b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/123884563 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc0b82a0 con 0x7f4fdc15e780 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.488+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 0x7f4fdc0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc15e780 0x7f4fdc0b7700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009870 tx=0x7f4fcc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7671b6046d41b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fda7fc640 1 -- 172.21.15.80:0/123884563 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc034070 con 0x7f4fdc15e780 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fda7fc640 1 -- 172.21.15.80:0/123884563 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc030840 con 0x7f4fdc15e780 2024-04-16T15:36:09.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fda7fc640 1 -- 172.21.15.80:0/123884563 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030c10 con 0x7f4fdc15e780 2024-04-16T15:36:09.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 -- 172.21.15.80:0/123884563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc15e780 msgr2=0x7f4fdc0b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc15e780 0x7f4fdc0b7700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009870 tx=0x7f4fcc02b980 comp rx=0 tx=0).stop 2024-04-16T15:36:09.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 -- 172.21.15.80:0/123884563 shutdown_connections 2024-04-16T15:36:09.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc0cf360 0x7f4fdc0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 --2- 172.21.15.80:0/123884563 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc15e780 0x7f4fdc0b7700 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 -- 172.21.15.80:0/123884563 >> 172.21.15.80:0/123884563 conn(0x7f4fdc0734f0 msgr2=0x7f4fdc073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 -- 172.21.15.80:0/123884563 shutdown_connections 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.489+0000 7f4fe2172640 1 -- 172.21.15.80:0/123884563 wait complete. 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 Processor -- start 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 -- start start 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 0x7f4fdc14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc15e780 0x7f4fdc0c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0cfd00 con 0x7f4fdc0cf360 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0b8860 con 0x7f4fdc0d26d0 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.491+0000 7f4fe2172640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc15eb60 con 0x7f4fdc15e780 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35042/0 (socket says 172.21.15.80:35042) 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/3701591043 learned_addr learned my addr 172.21.15.80:0/3701591043 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdbfff640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc15e780 0x7f4fdc0c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc15e780 msgr2=0x7f4fdc0c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdaffd640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 0x7f4fdc14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc15e780 0x7f4fdc0c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 msgr2=0x7f4fdc14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 0x7f4fdc14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 -- 172.21.15.80:0/3701591043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc15ce70 con 0x7f4fdc0cf360 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdaffd640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 0x7f4fdc14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:09.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fdb7fe640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000c00 tx=0x7f4fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc034040 con 0x7f4fdc0cf360 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc039d90 con 0x7f4fdc0cf360 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc0c9d40 con 0x7f4fdc0cf360 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc043610 con 0x7f4fdc0cf360 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.492+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc0c8a40 con 0x7f4fdc0cf360 2024-04-16T15:36:09.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.493+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc068a40 con 0x7f4fdc0cf360 2024-04-16T15:36:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.494+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fcc04a060 con 0x7f4fdc0cf360 2024-04-16T15:36:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.494+0000 7f4fc3fff640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 0x7f4fc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.494+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4fcc0ae080 con 0x7f4fdc0cf360 2024-04-16T15:36:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.494+0000 7f4fdaffd640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 0x7f4fc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.494+0000 7f4fdaffd640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 0x7f4fc806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc15d0c0 tx=0x7f4fd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.498+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4fcc03e070 con 0x7f4fdc0cf360 2024-04-16T15:36:09.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.669+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fdc0cebc0 con 0x7f4fc806c8f0 2024-04-16T15:36:09.675 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.677+0000 7f4fc3fff640 1 -- 172.21.15.80:0/3701591043 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f4fd0069310 con 0x7f4fc806c8f0 2024-04-16T15:36:09.679 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:09.680 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 msgr2=0x7f4fc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 0x7f4fc806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc15d0c0 tx=0x7f4fd0009040 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 msgr2=0x7f4fdc15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000c00 tx=0x7f4fcc0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 shutdown_connections 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4fc806c8f0 0x7f4fc806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4fdc15e780 0x7f4fdc0c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4fdc0d26d0 0x7f4fdc14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 --2- 172.21.15.80:0/3701591043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fdc0cf360 0x7f4fdc15d110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 >> 172.21.15.80:0/3701591043 conn(0x7f4fdc0734f0 msgr2=0x7f4fdc06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 shutdown_connections 2024-04-16T15:36:09.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.680+0000 7f4fe2172640 1 -- 172.21.15.80:0/3701591043 wait complete. 2024-04-16T15:36:09.690 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-16T15:36:09.162187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219468,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755252,"statfs":{"total":773094113280,"available":772869378048,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002690"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083878+0000","last_change":"2024-04-16T15:35:46.903839+0000","last_active":"2024-04-16T15:35:55.083878+0000","last_peered":"2024-04-16T15:35:55.083878+0000","last_clean":"2024-04-16T15:35:55.083878+0000","last_became_active":"2024-04-16T15:35:46.903559+0000","last_became_peered":"2024-04-16T15:35:46.903559+0000","last_unstale":"2024-04-16T15:35:55.083878+0000","last_undegraded":"2024-04-16T15:35:55.083878+0000","last_fullsized":"2024-04-16T15:35:55.083878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928439+0000","last_change":"2024-04-16T15:35:47.906302+0000","last_active":"2024-04-16T15:35:53.928439+0000","last_peered":"2024-04-16T15:35:53.928439+0000","last_clean":"2024-04-16T15:35:53.928439+0000","last_became_active":"2024-04-16T15:35:47.905445+0000","last_became_peered":"2024-04-16T15:35:47.905445+0000","last_unstale":"2024-04-16T15:35:53.928439+0000","last_undegraded":"2024-04-16T15:35:53.928439+0000","last_fullsized":"2024-04-16T15:35:53.928439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927788+0000","last_change":"2024-04-16T15:35:52.665449+0000","last_active":"2024-04-16T15:35:53.927788+0000","last_peered":"2024-04-16T15:35:53.927788+0000","last_clean":"2024-04-16T15:35:53.927788+0000","last_became_active":"2024-04-16T15:35:52.665084+0000","last_became_peered":"2024-04-16T15:35:52.665084+0000","last_unstale":"2024-04-16T15:35:53.927788+0000","last_undegraded":"2024-04-16T15:35:53.927788+0000","last_fullsized":"2024-04-16T15:35:53.927788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:19:37.233395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928611+0000","last_change":"2024-04-16T15:35:46.898739+0000","last_active":"2024-04-16T15:35:53.928611+0000","last_peered":"2024-04-16T15:35:53.928611+0000","last_clean":"2024-04-16T15:35:53.928611+0000","last_became_active":"2024-04-16T15:35:46.898423+0000","last_became_peered":"2024-04-16T15:35:46.898423+0000","last_unstale":"2024-04-16T15:35:53.928611+0000","last_undegraded":"2024-04-16T15:35:53.928611+0000","last_fullsized":"2024-04-16T15:35:53.928611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083665+0000","last_change":"2024-04-16T15:35:47.907617+0000","last_active":"2024-04-16T15:35:55.083665+0000","last_peered":"2024-04-16T15:35:55.083665+0000","last_clean":"2024-04-16T15:35:55.083665+0000","last_became_active":"2024-04-16T15:35:47.907273+0000","last_became_peered":"2024-04-16T15:35:47.907273+0000","last_unstale":"2024-04-16T15:35:55.083665+0000","last_undegraded":"2024-04-16T15:35:55.083665+0000","last_fullsized":"2024-04-16T15:35:55.083665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:55.452016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930079+0000","last_change":"2024-04-16T15:35:51.944987+0000","last_active":"2024-04-16T15:35:53.930079+0000","last_peered":"2024-04-16T15:35:53.930079+0000","last_clean":"2024-04-16T15:35:53.930079+0000","last_became_active":"2024-04-16T15:35:51.944345+0000","last_became_peered":"2024-04-16T15:35:51.944345+0000","last_unstale":"2024-04-16T15:35:53.930079+0000","last_undegraded":"2024-04-16T15:35:53.930079+0000","last_fullsized":"2024-04-16T15:35:53.930079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082829+0000","last_change":"2024-04-16T15:35:46.902233+0000","last_active":"2024-04-16T15:35:55.082829+0000","last_peered":"2024-04-16T15:35:55.082829+0000","last_clean":"2024-04-16T15:35:55.082829+0000","last_became_active":"2024-04-16T15:35:46.901940+0000","last_became_peered":"2024-04-16T15:35:46.901940+0000","last_unstale":"2024-04-16T15:35:55.082829+0000","last_undegraded":"2024-04-16T15:35:55.082829+0000","last_fullsized":"2024-04-16T15:35:55.082829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930367+0000","last_change":"2024-04-16T15:35:47.898146+0000","last_active":"2024-04-16T15:35:53.930367+0000","last_peered":"2024-04-16T15:35:53.930367+0000","last_clean":"2024-04-16T15:35:53.930367+0000","last_became_active":"2024-04-16T15:35:47.897840+0000","last_became_peered":"2024-04-16T15:35:47.897840+0000","last_unstale":"2024-04-16T15:35:53.930367+0000","last_undegraded":"2024-04-16T15:35:53.930367+0000","last_fullsized":"2024-04-16T15:35:53.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930469+0000","last_change":"2024-04-16T15:35:51.945269+0000","last_active":"2024-04-16T15:35:53.930469+0000","last_peered":"2024-04-16T15:35:53.930469+0000","last_clean":"2024-04-16T15:35:53.930469+0000","last_became_active":"2024-04-16T15:35:51.943815+0000","last_became_peered":"2024-04-16T15:35:51.943815+0000","last_unstale":"2024-04-16T15:35:53.930469+0000","last_undegraded":"2024-04-16T15:35:53.930469+0000","last_fullsized":"2024-04-16T15:35:53.930469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082796+0000","last_change":"2024-04-16T15:35:46.901105+0000","last_active":"2024-04-16T15:35:55.082796+0000","last_peered":"2024-04-16T15:35:55.082796+0000","last_clean":"2024-04-16T15:35:55.082796+0000","last_became_active":"2024-04-16T15:35:46.900800+0000","last_became_peered":"2024-04-16T15:35:46.900800+0000","last_unstale":"2024-04-16T15:35:55.082796+0000","last_undegraded":"2024-04-16T15:35:55.082796+0000","last_fullsized":"2024-04-16T15:35:55.082796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:11.448206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930964+0000","last_change":"2024-04-16T15:35:47.897967+0000","last_active":"2024-04-16T15:35:53.930964+0000","last_peered":"2024-04-16T15:35:53.930964+0000","last_clean":"2024-04-16T15:35:53.930964+0000","last_became_active":"2024-04-16T15:35:47.897689+0000","last_became_peered":"2024-04-16T15:35:47.897689+0000","last_unstale":"2024-04-16T15:35:53.930964+0000","last_undegraded":"2024-04-16T15:35:53.930964+0000","last_fullsized":"2024-04-16T15:35:53.930964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930582+0000","last_change":"2024-04-16T15:35:51.945075+0000","last_active":"2024-04-16T15:35:53.930582+0000","last_peered":"2024-04-16T15:35:53.930582+0000","last_clean":"2024-04-16T15:35:53.930582+0000","last_became_active":"2024-04-16T15:35:51.944674+0000","last_became_peered":"2024-04-16T15:35:51.944674+0000","last_unstale":"2024-04-16T15:35:53.930582+0000","last_undegraded":"2024-04-16T15:35:53.930582+0000","last_fullsized":"2024-04-16T15:35:53.930582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368841+0000","last_change":"2024-04-16T15:35:47.906053+0000","last_active":"2024-04-16T15:35:54.368841+0000","last_peered":"2024-04-16T15:35:54.368841+0000","last_clean":"2024-04-16T15:35:54.368841+0000","last_became_active":"2024-04-16T15:35:47.905735+0000","last_became_peered":"2024-04-16T15:35:47.905735+0000","last_unstale":"2024-04-16T15:35:54.368841+0000","last_undegraded":"2024-04-16T15:35:54.368841+0000","last_fullsized":"2024-04-16T15:35:54.368841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082789+0000","last_change":"2024-04-16T15:35:46.903005+0000","last_active":"2024-04-16T15:35:55.082789+0000","last_peered":"2024-04-16T15:35:55.082789+0000","last_clean":"2024-04-16T15:35:55.082789+0000","last_became_active":"2024-04-16T15:35:46.902690+0000","last_became_peered":"2024-04-16T15:35:46.902690+0000","last_unstale":"2024-04-16T15:35:55.082789+0000","last_undegraded":"2024-04-16T15:35:55.082789+0000","last_fullsized":"2024-04-16T15:35:55.082789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931392+0000","last_change":"2024-04-16T15:35:51.944672+0000","last_active":"2024-04-16T15:35:53.931392+0000","last_peered":"2024-04-16T15:35:53.931392+0000","last_clean":"2024-04-16T15:35:53.931392+0000","last_became_active":"2024-04-16T15:35:51.943902+0000","last_became_peered":"2024-04-16T15:35:51.943902+0000","last_unstale":"2024-04-16T15:35:53.931392+0000","last_undegraded":"2024-04-16T15:35:53.931392+0000","last_fullsized":"2024-04-16T15:35:53.931392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927970+0000","last_change":"2024-04-16T15:35:47.911396+0000","last_active":"2024-04-16T15:35:53.927970+0000","last_peered":"2024-04-16T15:35:53.927970+0000","last_clean":"2024-04-16T15:35:53.927970+0000","last_became_active":"2024-04-16T15:35:47.910994+0000","last_became_peered":"2024-04-16T15:35:47.910994+0000","last_unstale":"2024-04-16T15:35:53.927970+0000","last_undegraded":"2024-04-16T15:35:53.927970+0000","last_fullsized":"2024-04-16T15:35:53.927970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084084+0000","last_change":"2024-04-16T15:35:46.900976+0000","last_active":"2024-04-16T15:35:55.084084+0000","last_peered":"2024-04-16T15:35:55.084084+0000","last_clean":"2024-04-16T15:35:55.084084+0000","last_became_active":"2024-04-16T15:35:46.900725+0000","last_became_peered":"2024-04-16T15:35:46.900725+0000","last_unstale":"2024-04-16T15:35:55.084084+0000","last_undegraded":"2024-04-16T15:35:55.084084+0000","last_fullsized":"2024-04-16T15:35:55.084084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931016+0000","last_change":"2024-04-16T15:35:51.941220+0000","last_active":"2024-04-16T15:35:53.931016+0000","last_peered":"2024-04-16T15:35:53.931016+0000","last_clean":"2024-04-16T15:35:53.931016+0000","last_became_active":"2024-04-16T15:35:51.940585+0000","last_became_peered":"2024-04-16T15:35:51.940585+0000","last_unstale":"2024-04-16T15:35:53.931016+0000","last_undegraded":"2024-04-16T15:35:53.931016+0000","last_fullsized":"2024-04-16T15:35:53.931016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927961+0000","last_change":"2024-04-16T15:35:47.911281+0000","last_active":"2024-04-16T15:35:53.927961+0000","last_peered":"2024-04-16T15:35:53.927961+0000","last_clean":"2024-04-16T15:35:53.927961+0000","last_became_active":"2024-04-16T15:35:47.910748+0000","last_became_peered":"2024-04-16T15:35:47.910748+0000","last_unstale":"2024-04-16T15:35:53.927961+0000","last_undegraded":"2024-04-16T15:35:53.927961+0000","last_fullsized":"2024-04-16T15:35:53.927961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083203+0000","last_change":"2024-04-16T15:35:46.902533+0000","last_active":"2024-04-16T15:35:55.083203+0000","last_peered":"2024-04-16T15:35:55.083203+0000","last_clean":"2024-04-16T15:35:55.083203+0000","last_became_active":"2024-04-16T15:35:46.902221+0000","last_became_peered":"2024-04-16T15:35:46.902221+0000","last_unstale":"2024-04-16T15:35:55.083203+0000","last_undegraded":"2024-04-16T15:35:55.083203+0000","last_fullsized":"2024-04-16T15:35:55.083203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:27.330306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083349+0000","last_change":"2024-04-16T15:35:52.664607+0000","last_active":"2024-04-16T15:35:55.083349+0000","last_peered":"2024-04-16T15:35:55.083349+0000","last_clean":"2024-04-16T15:35:55.083349+0000","last_became_active":"2024-04-16T15:35:52.664234+0000","last_became_peered":"2024-04-16T15:35:52.664234+0000","last_unstale":"2024-04-16T15:35:55.083349+0000","last_undegraded":"2024-04-16T15:35:55.083349+0000","last_fullsized":"2024-04-16T15:35:55.083349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930192+0000","last_change":"2024-04-16T15:35:47.913469+0000","last_active":"2024-04-16T15:35:53.930192+0000","last_peered":"2024-04-16T15:35:53.930192+0000","last_clean":"2024-04-16T15:35:53.930192+0000","last_became_active":"2024-04-16T15:35:47.912952+0000","last_became_peered":"2024-04-16T15:35:47.912952+0000","last_unstale":"2024-04-16T15:35:53.930192+0000","last_undegraded":"2024-04-16T15:35:53.930192+0000","last_fullsized":"2024-04-16T15:35:53.930192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:16:12.452242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083012+0000","last_change":"2024-04-16T15:35:46.903630+0000","last_active":"2024-04-16T15:35:55.083012+0000","last_peered":"2024-04-16T15:35:55.083012+0000","last_clean":"2024-04-16T15:35:55.083012+0000","last_became_active":"2024-04-16T15:35:46.903282+0000","last_became_peered":"2024-04-16T15:35:46.903282+0000","last_unstale":"2024-04-16T15:35:55.083012+0000","last_undegraded":"2024-04-16T15:35:55.083012+0000","last_fullsized":"2024-04-16T15:35:55.083012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930012+0000","last_change":"2024-04-16T15:35:51.944348+0000","last_active":"2024-04-16T15:35:53.930012+0000","last_peered":"2024-04-16T15:35:53.930012+0000","last_clean":"2024-04-16T15:35:53.930012+0000","last_became_active":"2024-04-16T15:35:51.943917+0000","last_became_peered":"2024-04-16T15:35:51.943917+0000","last_unstale":"2024-04-16T15:35:53.930012+0000","last_undegraded":"2024-04-16T15:35:53.930012+0000","last_fullsized":"2024-04-16T15:35:53.930012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083778+0000","last_change":"2024-04-16T15:35:47.909155+0000","last_active":"2024-04-16T15:35:55.083778+0000","last_peered":"2024-04-16T15:35:55.083778+0000","last_clean":"2024-04-16T15:35:55.083778+0000","last_became_active":"2024-04-16T15:35:47.908864+0000","last_became_peered":"2024-04-16T15:35:47.908864+0000","last_unstale":"2024-04-16T15:35:55.083778+0000","last_undegraded":"2024-04-16T15:35:55.083778+0000","last_fullsized":"2024-04-16T15:35:55.083778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369537+0000","last_change":"2024-04-16T15:35:46.899721+0000","last_active":"2024-04-16T15:35:54.369537+0000","last_peered":"2024-04-16T15:35:54.369537+0000","last_clean":"2024-04-16T15:35:54.369537+0000","last_became_active":"2024-04-16T15:35:46.899479+0000","last_became_peered":"2024-04-16T15:35:46.899479+0000","last_unstale":"2024-04-16T15:35:54.369537+0000","last_undegraded":"2024-04-16T15:35:54.369537+0000","last_fullsized":"2024-04-16T15:35:54.369537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929961+0000","last_change":"2024-04-16T15:35:52.664780+0000","last_active":"2024-04-16T15:35:53.929961+0000","last_peered":"2024-04-16T15:35:53.929961+0000","last_clean":"2024-04-16T15:35:53.929961+0000","last_became_active":"2024-04-16T15:35:52.664358+0000","last_became_peered":"2024-04-16T15:35:52.664358+0000","last_unstale":"2024-04-16T15:35:53.929961+0000","last_undegraded":"2024-04-16T15:35:53.929961+0000","last_fullsized":"2024-04-16T15:35:53.929961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928626+0000","last_change":"2024-04-16T15:35:47.919497+0000","last_active":"2024-04-16T15:35:53.928626+0000","last_peered":"2024-04-16T15:35:53.928626+0000","last_clean":"2024-04-16T15:35:53.928626+0000","last_became_active":"2024-04-16T15:35:47.919212+0000","last_became_peered":"2024-04-16T15:35:47.919212+0000","last_unstale":"2024-04-16T15:35:53.928626+0000","last_undegraded":"2024-04-16T15:35:53.928626+0000","last_fullsized":"2024-04-16T15:35:53.928626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082805+0000","last_change":"2024-04-16T15:35:46.900937+0000","last_active":"2024-04-16T15:35:55.082805+0000","last_peered":"2024-04-16T15:35:55.082805+0000","last_clean":"2024-04-16T15:35:55.082805+0000","last_became_active":"2024-04-16T15:35:46.900654+0000","last_became_peered":"2024-04-16T15:35:46.900654+0000","last_unstale":"2024-04-16T15:35:55.082805+0000","last_undegraded":"2024-04-16T15:35:55.082805+0000","last_fullsized":"2024-04-16T15:35:55.082805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927710+0000","last_change":"2024-04-16T15:35:52.665635+0000","last_active":"2024-04-16T15:35:53.927710+0000","last_peered":"2024-04-16T15:35:53.927710+0000","last_clean":"2024-04-16T15:35:53.927710+0000","last_became_active":"2024-04-16T15:35:52.665117+0000","last_became_peered":"2024-04-16T15:35:52.665117+0000","last_unstale":"2024-04-16T15:35:53.927710+0000","last_undegraded":"2024-04-16T15:35:53.927710+0000","last_fullsized":"2024-04-16T15:35:53.927710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:14.451474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084034+0000","last_change":"2024-04-16T15:35:47.911904+0000","last_active":"2024-04-16T15:35:55.084034+0000","last_peered":"2024-04-16T15:35:55.084034+0000","last_clean":"2024-04-16T15:35:55.084034+0000","last_became_active":"2024-04-16T15:35:47.911640+0000","last_became_peered":"2024-04-16T15:35:47.911640+0000","last_unstale":"2024-04-16T15:35:55.084034+0000","last_undegraded":"2024-04-16T15:35:55.084034+0000","last_fullsized":"2024-04-16T15:35:55.084034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083711+0000","last_change":"2024-04-16T15:35:46.903622+0000","last_active":"2024-04-16T15:35:55.083711+0000","last_peered":"2024-04-16T15:35:55.083711+0000","last_clean":"2024-04-16T15:35:55.083711+0000","last_became_active":"2024-04-16T15:35:46.903301+0000","last_became_peered":"2024-04-16T15:35:46.903301+0000","last_unstale":"2024-04-16T15:35:55.083711+0000","last_undegraded":"2024-04-16T15:35:55.083711+0000","last_fullsized":"2024-04-16T15:35:55.083711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:48.644355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083996+0000","last_change":"2024-04-16T15:35:52.662090+0000","last_active":"2024-04-16T15:35:55.083996+0000","last_peered":"2024-04-16T15:35:55.083996+0000","last_clean":"2024-04-16T15:35:55.083996+0000","last_became_active":"2024-04-16T15:35:52.661689+0000","last_became_peered":"2024-04-16T15:35:52.661689+0000","last_unstale":"2024-04-16T15:35:55.083996+0000","last_undegraded":"2024-04-16T15:35:55.083996+0000","last_fullsized":"2024-04-16T15:35:55.083996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931070+0000","last_change":"2024-04-16T15:35:47.912680+0000","last_active":"2024-04-16T15:35:53.931070+0000","last_peered":"2024-04-16T15:35:53.931070+0000","last_clean":"2024-04-16T15:35:53.931070+0000","last_became_active":"2024-04-16T15:35:47.912362+0000","last_became_peered":"2024-04-16T15:35:47.912362+0000","last_unstale":"2024-04-16T15:35:53.931070+0000","last_undegraded":"2024-04-16T15:35:53.931070+0000","last_fullsized":"2024-04-16T15:35:53.931070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084115+0000","last_change":"2024-04-16T15:35:46.902183+0000","last_active":"2024-04-16T15:35:55.084115+0000","last_peered":"2024-04-16T15:35:55.084115+0000","last_clean":"2024-04-16T15:35:55.084115+0000","last_became_active":"2024-04-16T15:35:46.901974+0000","last_became_peered":"2024-04-16T15:35:46.901974+0000","last_unstale":"2024-04-16T15:35:55.084115+0000","last_undegraded":"2024-04-16T15:35:55.084115+0000","last_fullsized":"2024-04-16T15:35:55.084115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084296+0000","last_change":"2024-04-16T15:35:51.944263+0000","last_active":"2024-04-16T15:35:55.084296+0000","last_peered":"2024-04-16T15:35:55.084296+0000","last_clean":"2024-04-16T15:35:55.084296+0000","last_became_active":"2024-04-16T15:35:51.943863+0000","last_became_peered":"2024-04-16T15:35:51.943863+0000","last_unstale":"2024-04-16T15:35:55.084296+0000","last_undegraded":"2024-04-16T15:35:55.084296+0000","last_fullsized":"2024-04-16T15:35:55.084296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930852+0000","last_change":"2024-04-16T15:35:47.904118+0000","last_active":"2024-04-16T15:35:53.930852+0000","last_peered":"2024-04-16T15:35:53.930852+0000","last_clean":"2024-04-16T15:35:53.930852+0000","last_became_active":"2024-04-16T15:35:47.903698+0000","last_became_peered":"2024-04-16T15:35:47.903698+0000","last_unstale":"2024-04-16T15:35:53.930852+0000","last_undegraded":"2024-04-16T15:35:53.930852+0000","last_fullsized":"2024-04-16T15:35:53.930852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930850+0000","last_change":"2024-04-16T15:35:46.902362+0000","last_active":"2024-04-16T15:35:53.930850+0000","last_peered":"2024-04-16T15:35:53.930850+0000","last_clean":"2024-04-16T15:35:53.930850+0000","last_became_active":"2024-04-16T15:35:46.902062+0000","last_became_peered":"2024-04-16T15:35:46.902062+0000","last_unstale":"2024-04-16T15:35:53.930850+0000","last_undegraded":"2024-04-16T15:35:53.930850+0000","last_fullsized":"2024-04-16T15:35:53.930850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083986+0000","last_change":"2024-04-16T15:35:51.947084+0000","last_active":"2024-04-16T15:35:55.083986+0000","last_peered":"2024-04-16T15:35:55.083986+0000","last_clean":"2024-04-16T15:35:55.083986+0000","last_became_active":"2024-04-16T15:35:51.946724+0000","last_became_peered":"2024-04-16T15:35:51.946724+0000","last_unstale":"2024-04-16T15:35:55.083986+0000","last_undegraded":"2024-04-16T15:35:55.083986+0000","last_fullsized":"2024-04-16T15:35:55.083986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083003+0000","last_change":"2024-04-16T15:35:47.912577+0000","last_active":"2024-04-16T15:35:55.083003+0000","last_peered":"2024-04-16T15:35:55.083003+0000","last_clean":"2024-04-16T15:35:55.083003+0000","last_became_active":"2024-04-16T15:35:47.911408+0000","last_became_peered":"2024-04-16T15:35:47.911408+0000","last_unstale":"2024-04-16T15:35:55.083003+0000","last_undegraded":"2024-04-16T15:35:55.083003+0000","last_fullsized":"2024-04-16T15:35:55.083003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571080+0000","last_change":"2024-04-16T15:35:46.894699+0000","last_active":"2024-04-16T15:35:54.571080+0000","last_peered":"2024-04-16T15:35:54.571080+0000","last_clean":"2024-04-16T15:35:54.571080+0000","last_became_active":"2024-04-16T15:35:46.894408+0000","last_became_peered":"2024-04-16T15:35:46.894408+0000","last_unstale":"2024-04-16T15:35:54.571080+0000","last_undegraded":"2024-04-16T15:35:54.571080+0000","last_fullsized":"2024-04-16T15:35:54.571080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083498+0000","last_change":"2024-04-16T15:35:51.941063+0000","last_active":"2024-04-16T15:35:55.083498+0000","last_peered":"2024-04-16T15:35:55.083498+0000","last_clean":"2024-04-16T15:35:55.083498+0000","last_became_active":"2024-04-16T15:35:51.940669+0000","last_became_peered":"2024-04-16T15:35:51.940669+0000","last_unstale":"2024-04-16T15:35:55.083498+0000","last_undegraded":"2024-04-16T15:35:55.083498+0000","last_fullsized":"2024-04-16T15:35:55.083498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083196+0000","last_change":"2024-04-16T15:35:47.904932+0000","last_active":"2024-04-16T15:35:55.083196+0000","last_peered":"2024-04-16T15:35:55.083196+0000","last_clean":"2024-04-16T15:35:55.083196+0000","last_became_active":"2024-04-16T15:35:47.902287+0000","last_became_peered":"2024-04-16T15:35:47.902287+0000","last_unstale":"2024-04-16T15:35:55.083196+0000","last_undegraded":"2024-04-16T15:35:55.083196+0000","last_fullsized":"2024-04-16T15:35:55.083196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:46.901553+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:46.901306+0000","last_became_peered":"2024-04-16T15:35:46.901306+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083417+0000","last_change":"2024-04-16T15:35:52.664769+0000","last_active":"2024-04-16T15:35:55.083417+0000","last_peered":"2024-04-16T15:35:55.083417+0000","last_clean":"2024-04-16T15:35:55.083417+0000","last_became_active":"2024-04-16T15:35:52.664412+0000","last_became_peered":"2024-04-16T15:35:52.664412+0000","last_unstale":"2024-04-16T15:35:55.083417+0000","last_undegraded":"2024-04-16T15:35:55.083417+0000","last_fullsized":"2024-04-16T15:35:55.083417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:29.608473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927849+0000","last_change":"2024-04-16T15:35:47.922561+0000","last_active":"2024-04-16T15:35:53.927849+0000","last_peered":"2024-04-16T15:35:53.927849+0000","last_clean":"2024-04-16T15:35:53.927849+0000","last_became_active":"2024-04-16T15:35:47.922290+0000","last_became_peered":"2024-04-16T15:35:47.922290+0000","last_unstale":"2024-04-16T15:35:53.927849+0000","last_undegraded":"2024-04-16T15:35:53.927849+0000","last_fullsized":"2024-04-16T15:35:53.927849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930657+0000","last_change":"2024-04-16T15:35:46.896323+0000","last_active":"2024-04-16T15:35:53.930657+0000","last_peered":"2024-04-16T15:35:53.930657+0000","last_clean":"2024-04-16T15:35:53.930657+0000","last_became_active":"2024-04-16T15:35:46.895810+0000","last_became_peered":"2024-04-16T15:35:46.895810+0000","last_unstale":"2024-04-16T15:35:53.930657+0000","last_undegraded":"2024-04-16T15:35:53.930657+0000","last_fullsized":"2024-04-16T15:35:53.930657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083251+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:35:55.083251+0000","last_peered":"2024-04-16T15:35:55.083251+0000","last_clean":"2024-04-16T15:35:55.083251+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:35:55.083251+0000","last_undegraded":"2024-04-16T15:35:55.083251+0000","last_fullsized":"2024-04-16T15:35:55.083251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369307+0000","last_change":"2024-04-16T15:35:52.664786+0000","last_active":"2024-04-16T15:35:54.369307+0000","last_peered":"2024-04-16T15:35:54.369307+0000","last_clean":"2024-04-16T15:35:54.369307+0000","last_became_active":"2024-04-16T15:35:52.664391+0000","last_became_peered":"2024-04-16T15:35:52.664391+0000","last_unstale":"2024-04-16T15:35:54.369307+0000","last_undegraded":"2024-04-16T15:35:54.369307+0000","last_fullsized":"2024-04-16T15:35:54.369307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:21.105306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083545+0000","last_change":"2024-04-16T15:35:47.922117+0000","last_active":"2024-04-16T15:35:55.083545+0000","last_peered":"2024-04-16T15:35:55.083545+0000","last_clean":"2024-04-16T15:35:55.083545+0000","last_became_active":"2024-04-16T15:35:47.921710+0000","last_became_peered":"2024-04-16T15:35:47.921710+0000","last_unstale":"2024-04-16T15:35:55.083545+0000","last_undegraded":"2024-04-16T15:35:55.083545+0000","last_fullsized":"2024-04-16T15:35:55.083545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571271+0000","last_change":"2024-04-16T15:35:46.896754+0000","last_active":"2024-04-16T15:35:54.571271+0000","last_peered":"2024-04-16T15:35:54.571271+0000","last_clean":"2024-04-16T15:35:54.571271+0000","last_became_active":"2024-04-16T15:35:46.896444+0000","last_became_peered":"2024-04-16T15:35:46.896444+0000","last_unstale":"2024-04-16T15:35:54.571271+0000","last_undegraded":"2024-04-16T15:35:54.571271+0000","last_fullsized":"2024-04-16T15:35:54.571271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368973+0000","last_change":"2024-04-16T15:35:52.662295+0000","last_active":"2024-04-16T15:35:54.368973+0000","last_peered":"2024-04-16T15:35:54.368973+0000","last_clean":"2024-04-16T15:35:54.368973+0000","last_became_active":"2024-04-16T15:35:52.661789+0000","last_became_peered":"2024-04-16T15:35:52.661789+0000","last_unstale":"2024-04-16T15:35:54.368973+0000","last_undegraded":"2024-04-16T15:35:54.368973+0000","last_fullsized":"2024-04-16T15:35:54.368973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:33.374368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930470+0000","last_change":"2024-04-16T15:35:47.915448+0000","last_active":"2024-04-16T15:35:53.930470+0000","last_peered":"2024-04-16T15:35:53.930470+0000","last_clean":"2024-04-16T15:35:53.930470+0000","last_became_active":"2024-04-16T15:35:47.915151+0000","last_became_peered":"2024-04-16T15:35:47.915151+0000","last_unstale":"2024-04-16T15:35:53.930470+0000","last_undegraded":"2024-04-16T15:35:53.930470+0000","last_fullsized":"2024-04-16T15:35:53.930470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082565+0000","last_change":"2024-04-16T15:35:46.897447+0000","last_active":"2024-04-16T15:35:55.082565+0000","last_peered":"2024-04-16T15:35:55.082565+0000","last_clean":"2024-04-16T15:35:55.082565+0000","last_became_active":"2024-04-16T15:35:46.897179+0000","last_became_peered":"2024-04-16T15:35:46.897179+0000","last_unstale":"2024-04-16T15:35:55.082565+0000","last_undegraded":"2024-04-16T15:35:55.082565+0000","last_fullsized":"2024-04-16T15:35:55.082565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:02.023151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084143+0000","last_change":"2024-04-16T15:35:51.944235+0000","last_active":"2024-04-16T15:35:55.084143+0000","last_peered":"2024-04-16T15:35:55.084143+0000","last_clean":"2024-04-16T15:35:55.084143+0000","last_became_active":"2024-04-16T15:35:51.943896+0000","last_became_peered":"2024-04-16T15:35:51.943896+0000","last_unstale":"2024-04-16T15:35:55.084143+0000","last_undegraded":"2024-04-16T15:35:55.084143+0000","last_fullsized":"2024-04-16T15:35:55.084143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:25.887161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083827+0000","last_change":"2024-04-16T15:35:47.918103+0000","last_active":"2024-04-16T15:35:55.083827+0000","last_peered":"2024-04-16T15:35:55.083827+0000","last_clean":"2024-04-16T15:35:55.083827+0000","last_became_active":"2024-04-16T15:35:47.917822+0000","last_became_peered":"2024-04-16T15:35:47.917822+0000","last_unstale":"2024-04-16T15:35:55.083827+0000","last_undegraded":"2024-04-16T15:35:55.083827+0000","last_fullsized":"2024-04-16T15:35:55.083827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:11:17.070863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571348+0000","last_change":"2024-04-16T15:35:46.894341+0000","last_active":"2024-04-16T15:35:54.571348+0000","last_peered":"2024-04-16T15:35:54.571348+0000","last_clean":"2024-04-16T15:35:54.571348+0000","last_became_active":"2024-04-16T15:35:46.894073+0000","last_became_peered":"2024-04-16T15:35:46.894073+0000","last_unstale":"2024-04-16T15:35:54.571348+0000","last_undegraded":"2024-04-16T15:35:54.571348+0000","last_fullsized":"2024-04-16T15:35:54.571348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929370+0000","last_change":"2024-04-16T15:35:52.662624+0000","last_active":"2024-04-16T15:35:53.929370+0000","last_peered":"2024-04-16T15:35:53.929370+0000","last_clean":"2024-04-16T15:35:53.929370+0000","last_became_active":"2024-04-16T15:35:52.661957+0000","last_became_peered":"2024-04-16T15:35:52.661957+0000","last_unstale":"2024-04-16T15:35:53.929370+0000","last_undegraded":"2024-04-16T15:35:53.929370+0000","last_fullsized":"2024-04-16T15:35:53.929370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:34:11.065769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083699+0000","last_change":"2024-04-16T15:35:47.918195+0000","last_active":"2024-04-16T15:35:55.083699+0000","last_peered":"2024-04-16T15:35:55.083699+0000","last_clean":"2024-04-16T15:35:55.083699+0000","last_became_active":"2024-04-16T15:35:47.917803+0000","last_became_peered":"2024-04-16T15:35:47.917803+0000","last_unstale":"2024-04-16T15:35:55.083699+0000","last_undegraded":"2024-04-16T15:35:55.083699+0000","last_fullsized":"2024-04-16T15:35:55.083699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930244+0000","last_change":"2024-04-16T15:35:46.899018+0000","last_active":"2024-04-16T15:35:53.930244+0000","last_peered":"2024-04-16T15:35:53.930244+0000","last_clean":"2024-04-16T15:35:53.930244+0000","last_became_active":"2024-04-16T15:35:46.898729+0000","last_became_peered":"2024-04-16T15:35:46.898729+0000","last_unstale":"2024-04-16T15:35:53.930244+0000","last_undegraded":"2024-04-16T15:35:53.930244+0000","last_fullsized":"2024-04-16T15:35:53.930244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929608+0000","last_change":"2024-04-16T15:35:51.941144+0000","last_active":"2024-04-16T15:35:53.929608+0000","last_peered":"2024-04-16T15:35:53.929608+0000","last_clean":"2024-04-16T15:35:53.929608+0000","last_became_active":"2024-04-16T15:35:51.940597+0000","last_became_peered":"2024-04-16T15:35:51.940597+0000","last_unstale":"2024-04-16T15:35:53.929608+0000","last_undegraded":"2024-04-16T15:35:53.929608+0000","last_fullsized":"2024-04-16T15:35:53.929608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:41.324458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083262+0000","last_change":"2024-04-16T15:35:47.914496+0000","last_active":"2024-04-16T15:35:55.083262+0000","last_peered":"2024-04-16T15:35:55.083262+0000","last_clean":"2024-04-16T15:35:55.083262+0000","last_became_active":"2024-04-16T15:35:47.913786+0000","last_became_peered":"2024-04-16T15:35:47.913786+0000","last_unstale":"2024-04-16T15:35:55.083262+0000","last_undegraded":"2024-04-16T15:35:55.083262+0000","last_fullsized":"2024-04-16T15:35:55.083262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570927+0000","last_change":"2024-04-16T15:35:46.897628+0000","last_active":"2024-04-16T15:35:54.570927+0000","last_peered":"2024-04-16T15:35:54.570927+0000","last_clean":"2024-04-16T15:35:54.570927+0000","last_became_active":"2024-04-16T15:35:46.897367+0000","last_became_peered":"2024-04-16T15:35:46.897367+0000","last_unstale":"2024-04-16T15:35:54.570927+0000","last_undegraded":"2024-04-16T15:35:54.570927+0000","last_fullsized":"2024-04-16T15:35:54.570927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:11.764968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083283+0000","last_change":"2024-04-16T15:35:51.945992+0000","last_active":"2024-04-16T15:35:55.083283+0000","last_peered":"2024-04-16T15:35:55.083283+0000","last_clean":"2024-04-16T15:35:55.083283+0000","last_became_active":"2024-04-16T15:35:51.945596+0000","last_became_peered":"2024-04-16T15:35:51.945596+0000","last_unstale":"2024-04-16T15:35:55.083283+0000","last_undegraded":"2024-04-16T15:35:55.083283+0000","last_fullsized":"2024-04-16T15:35:55.083283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:38.493284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368868+0000","last_change":"2024-04-16T15:35:47.910686+0000","last_active":"2024-04-16T15:35:54.368868+0000","last_peered":"2024-04-16T15:35:54.368868+0000","last_clean":"2024-04-16T15:35:54.368868+0000","last_became_active":"2024-04-16T15:35:47.910289+0000","last_became_peered":"2024-04-16T15:35:47.910289+0000","last_unstale":"2024-04-16T15:35:54.368868+0000","last_undegraded":"2024-04-16T15:35:54.368868+0000","last_fullsized":"2024-04-16T15:35:54.368868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368949+0000","last_change":"2024-04-16T15:35:46.899316+0000","last_active":"2024-04-16T15:35:54.368949+0000","last_peered":"2024-04-16T15:35:54.368949+0000","last_clean":"2024-04-16T15:35:54.368949+0000","last_became_active":"2024-04-16T15:35:46.899031+0000","last_became_peered":"2024-04-16T15:35:46.899031+0000","last_unstale":"2024-04-16T15:35:54.368949+0000","last_undegraded":"2024-04-16T15:35:54.368949+0000","last_fullsized":"2024-04-16T15:35:54.368949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928588+0000","last_change":"2024-04-16T15:35:52.665294+0000","last_active":"2024-04-16T15:35:53.928588+0000","last_peered":"2024-04-16T15:35:53.928588+0000","last_clean":"2024-04-16T15:35:53.928588+0000","last_became_active":"2024-04-16T15:35:52.664948+0000","last_became_peered":"2024-04-16T15:35:52.664948+0000","last_unstale":"2024-04-16T15:35:53.928588+0000","last_undegraded":"2024-04-16T15:35:53.928588+0000","last_fullsized":"2024-04-16T15:35:53.928588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:52.935866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083368+0000","last_change":"2024-04-16T15:35:47.921106+0000","last_active":"2024-04-16T15:35:55.083368+0000","last_peered":"2024-04-16T15:35:55.083368+0000","last_clean":"2024-04-16T15:35:55.083368+0000","last_became_active":"2024-04-16T15:35:47.920831+0000","last_became_peered":"2024-04-16T15:35:47.920831+0000","last_unstale":"2024-04-16T15:35:55.083368+0000","last_undegraded":"2024-04-16T15:35:55.083368+0000","last_fullsized":"2024-04-16T15:35:55.083368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:05:58.152811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930813+0000","last_change":"2024-04-16T15:35:46.894785+0000","last_active":"2024-04-16T15:35:53.930813+0000","last_peered":"2024-04-16T15:35:53.930813+0000","last_clean":"2024-04-16T15:35:53.930813+0000","last_became_active":"2024-04-16T15:35:46.894416+0000","last_became_peered":"2024-04-16T15:35:46.894416+0000","last_unstale":"2024-04-16T15:35:53.930813+0000","last_undegraded":"2024-04-16T15:35:53.930813+0000","last_fullsized":"2024-04-16T15:35:53.930813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928344+0000","last_change":"2024-04-16T15:35:52.662123+0000","last_active":"2024-04-16T15:35:53.928344+0000","last_peered":"2024-04-16T15:35:53.928344+0000","last_clean":"2024-04-16T15:35:53.928344+0000","last_became_active":"2024-04-16T15:35:52.661758+0000","last_became_peered":"2024-04-16T15:35:52.661758+0000","last_unstale":"2024-04-16T15:35:53.928344+0000","last_undegraded":"2024-04-16T15:35:53.928344+0000","last_fullsized":"2024-04-16T15:35:53.928344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:12.922280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083720+0000","last_change":"2024-04-16T15:35:47.916216+0000","last_active":"2024-04-16T15:35:55.083720+0000","last_peered":"2024-04-16T15:35:55.083720+0000","last_clean":"2024-04-16T15:35:55.083720+0000","last_became_active":"2024-04-16T15:35:47.915566+0000","last_became_peered":"2024-04-16T15:35:47.915566+0000","last_unstale":"2024-04-16T15:35:55.083720+0000","last_undegraded":"2024-04-16T15:35:55.083720+0000","last_fullsized":"2024-04-16T15:35:55.083720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082527+0000","last_change":"2024-04-16T15:35:46.897293+0000","last_active":"2024-04-16T15:35:55.082527+0000","last_peered":"2024-04-16T15:35:55.082527+0000","last_clean":"2024-04-16T15:35:55.082527+0000","last_became_active":"2024-04-16T15:35:46.897006+0000","last_became_peered":"2024-04-16T15:35:46.897006+0000","last_unstale":"2024-04-16T15:35:55.082527+0000","last_undegraded":"2024-04-16T15:35:55.082527+0000","last_fullsized":"2024-04-16T15:35:55.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931065+0000","last_change":"2024-04-16T15:35:52.664883+0000","last_active":"2024-04-16T15:35:53.931065+0000","last_peered":"2024-04-16T15:35:53.931065+0000","last_clean":"2024-04-16T15:35:53.931065+0000","last_became_active":"2024-04-16T15:35:52.664454+0000","last_became_peered":"2024-04-16T15:35:52.664454+0000","last_unstale":"2024-04-16T15:35:53.931065+0000","last_undegraded":"2024-04-16T15:35:53.931065+0000","last_fullsized":"2024-04-16T15:35:53.931065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083452+0000","last_change":"2024-04-16T15:35:47.922333+0000","last_active":"2024-04-16T15:35:55.083452+0000","last_peered":"2024-04-16T15:35:55.083452+0000","last_clean":"2024-04-16T15:35:55.083452+0000","last_became_active":"2024-04-16T15:35:47.922051+0000","last_became_peered":"2024-04-16T15:35:47.922051+0000","last_unstale":"2024-04-16T15:35:55.083452+0000","last_undegraded":"2024-04-16T15:35:55.083452+0000","last_fullsized":"2024-04-16T15:35:55.083452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:33:17.549913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:57.478864+0000","last_change":"2024-04-16T15:35:46.899953+0000","last_active":"2024-04-16T15:35:57.478864+0000","last_peered":"2024-04-16T15:35:57.478864+0000","last_clean":"2024-04-16T15:35:57.478864+0000","last_became_active":"2024-04-16T15:35:46.899684+0000","last_became_peered":"2024-04-16T15:35:46.899684+0000","last_unstale":"2024-04-16T15:35:57.478864+0000","last_undegraded":"2024-04-16T15:35:57.478864+0000","last_fullsized":"2024-04-16T15:35:57.478864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:33.266907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084387+0000","last_change":"2024-04-16T15:35:51.940461+0000","last_active":"2024-04-16T15:35:55.084387+0000","last_peered":"2024-04-16T15:35:55.084387+0000","last_clean":"2024-04-16T15:35:55.084387+0000","last_became_active":"2024-04-16T15:35:51.940074+0000","last_became_peered":"2024-04-16T15:35:51.940074+0000","last_unstale":"2024-04-16T15:35:55.084387+0000","last_undegraded":"2024-04-16T15:35:55.084387+0000","last_fullsized":"2024-04-16T15:35:55.084387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:14.302349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931115+0000","last_change":"2024-04-16T15:35:47.914523+0000","last_active":"2024-04-16T15:35:53.931115+0000","last_peered":"2024-04-16T15:35:53.931115+0000","last_clean":"2024-04-16T15:35:53.931115+0000","last_became_active":"2024-04-16T15:35:47.914263+0000","last_became_peered":"2024-04-16T15:35:47.914263+0000","last_unstale":"2024-04-16T15:35:53.931115+0000","last_undegraded":"2024-04-16T15:35:53.931115+0000","last_fullsized":"2024-04-16T15:35:53.931115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:49.648392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082701+0000","last_change":"2024-04-16T15:35:46.902816+0000","last_active":"2024-04-16T15:35:55.082701+0000","last_peered":"2024-04-16T15:35:55.082701+0000","last_clean":"2024-04-16T15:35:55.082701+0000","last_became_active":"2024-04-16T15:35:46.901873+0000","last_became_peered":"2024-04-16T15:35:46.901873+0000","last_unstale":"2024-04-16T15:35:55.082701+0000","last_undegraded":"2024-04-16T15:35:55.082701+0000","last_fullsized":"2024-04-16T15:35:55.082701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930687+0000","last_change":"2024-04-16T15:35:51.945111+0000","last_active":"2024-04-16T15:35:53.930687+0000","last_peered":"2024-04-16T15:35:53.930687+0000","last_clean":"2024-04-16T15:35:53.930687+0000","last_became_active":"2024-04-16T15:35:51.944177+0000","last_became_peered":"2024-04-16T15:35:51.944177+0000","last_unstale":"2024-04-16T15:35:53.930687+0000","last_undegraded":"2024-04-16T15:35:53.930687+0000","last_fullsized":"2024-04-16T15:35:53.930687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:36:58.152228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083788+0000","last_change":"2024-04-16T15:35:47.920026+0000","last_active":"2024-04-16T15:35:55.083788+0000","last_peered":"2024-04-16T15:35:55.083788+0000","last_clean":"2024-04-16T15:35:55.083788+0000","last_became_active":"2024-04-16T15:35:47.919754+0000","last_became_peered":"2024-04-16T15:35:47.919754+0000","last_unstale":"2024-04-16T15:35:55.083788+0000","last_undegraded":"2024-04-16T15:35:55.083788+0000","last_fullsized":"2024-04-16T15:35:55.083788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929875+0000","last_change":"2024-04-16T15:35:46.901151+0000","last_active":"2024-04-16T15:35:53.929875+0000","last_peered":"2024-04-16T15:35:53.929875+0000","last_clean":"2024-04-16T15:35:53.929875+0000","last_became_active":"2024-04-16T15:35:46.900666+0000","last_became_peered":"2024-04-16T15:35:46.900666+0000","last_unstale":"2024-04-16T15:35:53.929875+0000","last_undegraded":"2024-04-16T15:35:53.929875+0000","last_fullsized":"2024-04-16T15:35:53.929875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:54.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927908+0000","last_change":"2024-04-16T15:35:51.942012+0000","last_active":"2024-04-16T15:35:53.927908+0000","last_peered":"2024-04-16T15:35:53.927908+0000","last_clean":"2024-04-16T15:35:53.927908+0000","last_became_active":"2024-04-16T15:35:51.941666+0000","last_became_peered":"2024-04-16T15:35:51.941666+0000","last_unstale":"2024-04-16T15:35:53.927908+0000","last_undegraded":"2024-04-16T15:35:53.927908+0000","last_fullsized":"2024-04-16T15:35:53.927908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:07.372834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929764+0000","last_change":"2024-04-16T15:35:47.916230+0000","last_active":"2024-04-16T15:35:53.929764+0000","last_peered":"2024-04-16T15:35:53.929764+0000","last_clean":"2024-04-16T15:35:53.929764+0000","last_became_active":"2024-04-16T15:35:47.915930+0000","last_became_peered":"2024-04-16T15:35:47.915930+0000","last_unstale":"2024-04-16T15:35:53.929764+0000","last_undegraded":"2024-04-16T15:35:53.929764+0000","last_fullsized":"2024-04-16T15:35:53.929764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369463+0000","last_change":"2024-04-16T15:35:46.899249+0000","last_active":"2024-04-16T15:35:54.369463+0000","last_peered":"2024-04-16T15:35:54.369463+0000","last_clean":"2024-04-16T15:35:54.369463+0000","last_became_active":"2024-04-16T15:35:46.898904+0000","last_became_peered":"2024-04-16T15:35:46.898904+0000","last_unstale":"2024-04-16T15:35:54.369463+0000","last_undegraded":"2024-04-16T15:35:54.369463+0000","last_fullsized":"2024-04-16T15:35:54.369463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928158+0000","last_change":"2024-04-16T15:35:52.664770+0000","last_active":"2024-04-16T15:35:53.928158+0000","last_peered":"2024-04-16T15:35:53.928158+0000","last_clean":"2024-04-16T15:35:53.928158+0000","last_became_active":"2024-04-16T15:35:52.664405+0000","last_became_peered":"2024-04-16T15:35:52.664405+0000","last_unstale":"2024-04-16T15:35:53.928158+0000","last_undegraded":"2024-04-16T15:35:53.928158+0000","last_fullsized":"2024-04-16T15:35:53.928158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:13:44.943582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083145+0000","last_change":"2024-04-16T15:35:52.664928+0000","last_active":"2024-04-16T15:35:55.083145+0000","last_peered":"2024-04-16T15:35:55.083145+0000","last_clean":"2024-04-16T15:35:55.083145+0000","last_became_active":"2024-04-16T15:35:52.664390+0000","last_became_peered":"2024-04-16T15:35:52.664390+0000","last_unstale":"2024-04-16T15:35:55.083145+0000","last_undegraded":"2024-04-16T15:35:55.083145+0000","last_fullsized":"2024-04-16T15:35:55.083145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083042+0000","last_change":"2024-04-16T15:35:47.913302+0000","last_active":"2024-04-16T15:35:55.083042+0000","last_peered":"2024-04-16T15:35:55.083042+0000","last_clean":"2024-04-16T15:35:55.083042+0000","last_became_active":"2024-04-16T15:35:47.912246+0000","last_became_peered":"2024-04-16T15:35:47.912246+0000","last_unstale":"2024-04-16T15:35:55.083042+0000","last_undegraded":"2024-04-16T15:35:55.083042+0000","last_fullsized":"2024-04-16T15:35:55.083042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929579+0000","last_change":"2024-04-16T15:35:46.895206+0000","last_active":"2024-04-16T15:35:53.929579+0000","last_peered":"2024-04-16T15:35:53.929579+0000","last_clean":"2024-04-16T15:35:53.929579+0000","last_became_active":"2024-04-16T15:35:46.894912+0000","last_became_peered":"2024-04-16T15:35:46.894912+0000","last_unstale":"2024-04-16T15:35:53.929579+0000","last_undegraded":"2024-04-16T15:35:53.929579+0000","last_fullsized":"2024-04-16T15:35:53.929579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:33:50.991966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369422+0000","last_change":"2024-04-16T15:35:51.941806+0000","last_active":"2024-04-16T15:35:54.369422+0000","last_peered":"2024-04-16T15:35:54.369422+0000","last_clean":"2024-04-16T15:35:54.369422+0000","last_became_active":"2024-04-16T15:35:51.941433+0000","last_became_peered":"2024-04-16T15:35:51.941433+0000","last_unstale":"2024-04-16T15:35:54.369422+0000","last_undegraded":"2024-04-16T15:35:54.369422+0000","last_fullsized":"2024-04-16T15:35:54.369422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:46:02.607917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928093+0000","last_change":"2024-04-16T15:35:47.911758+0000","last_active":"2024-04-16T15:35:53.928093+0000","last_peered":"2024-04-16T15:35:53.928093+0000","last_clean":"2024-04-16T15:35:53.928093+0000","last_became_active":"2024-04-16T15:35:47.911245+0000","last_became_peered":"2024-04-16T15:35:47.911245+0000","last_unstale":"2024-04-16T15:35:53.928093+0000","last_undegraded":"2024-04-16T15:35:53.928093+0000","last_fullsized":"2024-04-16T15:35:53.928093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928041+0000","last_change":"2024-04-16T15:35:46.900742+0000","last_active":"2024-04-16T15:35:53.928041+0000","last_peered":"2024-04-16T15:35:53.928041+0000","last_clean":"2024-04-16T15:35:53.928041+0000","last_became_active":"2024-04-16T15:35:46.900416+0000","last_became_peered":"2024-04-16T15:35:46.900416+0000","last_unstale":"2024-04-16T15:35:53.928041+0000","last_undegraded":"2024-04-16T15:35:53.928041+0000","last_fullsized":"2024-04-16T15:35:53.928041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:22:57.663043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369097+0000","last_change":"2024-04-16T15:35:46.895563+0000","last_active":"2024-04-16T15:35:54.369097+0000","last_peered":"2024-04-16T15:35:54.369097+0000","last_clean":"2024-04-16T15:35:54.369097+0000","last_became_active":"2024-04-16T15:35:46.895267+0000","last_became_peered":"2024-04-16T15:35:46.895267+0000","last_unstale":"2024-04-16T15:35:54.369097+0000","last_undegraded":"2024-04-16T15:35:54.369097+0000","last_fullsized":"2024-04-16T15:35:54.369097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:41.417361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084188+0000","last_change":"2024-04-16T15:35:47.904515+0000","last_active":"2024-04-16T15:35:55.084188+0000","last_peered":"2024-04-16T15:35:55.084188+0000","last_clean":"2024-04-16T15:35:55.084188+0000","last_became_active":"2024-04-16T15:35:47.902329+0000","last_became_peered":"2024-04-16T15:35:47.902329+0000","last_unstale":"2024-04-16T15:35:55.084188+0000","last_undegraded":"2024-04-16T15:35:55.084188+0000","last_fullsized":"2024-04-16T15:35:55.084188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571221+0000","last_change":"2024-04-16T15:35:51.942716+0000","last_active":"2024-04-16T15:35:54.571221+0000","last_peered":"2024-04-16T15:35:54.571221+0000","last_clean":"2024-04-16T15:35:54.571221+0000","last_became_active":"2024-04-16T15:35:51.942306+0000","last_became_peered":"2024-04-16T15:35:51.942306+0000","last_unstale":"2024-04-16T15:35:54.571221+0000","last_undegraded":"2024-04-16T15:35:54.571221+0000","last_fullsized":"2024-04-16T15:35:54.571221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:21.643419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928089+0000","last_change":"2024-04-16T15:35:46.903607+0000","last_active":"2024-04-16T15:35:53.928089+0000","last_peered":"2024-04-16T15:35:53.928089+0000","last_clean":"2024-04-16T15:35:53.928089+0000","last_became_active":"2024-04-16T15:35:46.903329+0000","last_became_peered":"2024-04-16T15:35:46.903329+0000","last_unstale":"2024-04-16T15:35:53.928089+0000","last_undegraded":"2024-04-16T15:35:53.928089+0000","last_fullsized":"2024-04-16T15:35:53.928089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:45.873030+0000","last_clean_scrub_stamp":"2024-04-16T15:35:45.873030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:00:07.156490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.903874+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.903605+0000","last_became_peered":"2024-04-16T15:35:47.903605+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:34.270943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928371+0000","last_change":"2024-04-16T15:35:51.941375+0000","last_active":"2024-04-16T15:35:53.928371+0000","last_peered":"2024-04-16T15:35:53.928371+0000","last_clean":"2024-04-16T15:35:53.928371+0000","last_became_active":"2024-04-16T15:35:51.940976+0000","last_became_peered":"2024-04-16T15:35:51.940976+0000","last_unstale":"2024-04-16T15:35:53.928371+0000","last_undegraded":"2024-04-16T15:35:53.928371+0000","last_fullsized":"2024-04-16T15:35:53.928371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:50.911510+0000","last_clean_scrub_stamp":"2024-04-16T15:35:50.911510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:26.365805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.368749+0000","last_change":"2024-04-16T15:35:47.911340+0000","last_active":"2024-04-16T15:35:54.368749+0000","last_peered":"2024-04-16T15:35:54.368749+0000","last_clean":"2024-04-16T15:35:54.368749+0000","last_became_active":"2024-04-16T15:35:47.910024+0000","last_became_peered":"2024-04-16T15:35:47.910024+0000","last_unstale":"2024-04-16T15:35:54.368749+0000","last_undegraded":"2024-04-16T15:35:54.368749+0000","last_fullsized":"2024-04-16T15:35:54.368749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.570957+0000","last_change":"2024-04-16T15:35:47.921417+0000","last_active":"2024-04-16T15:35:54.570957+0000","last_peered":"2024-04-16T15:35:54.570957+0000","last_clean":"2024-04-16T15:35:54.570957+0000","last_became_active":"2024-04-16T15:35:47.921049+0000","last_became_peered":"2024-04-16T15:35:47.921049+0000","last_unstale":"2024-04-16T15:35:54.570957+0000","last_undegraded":"2024-04-16T15:35:54.570957+0000","last_fullsized":"2024-04-16T15:35:54.570957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930709+0000","last_change":"2024-04-16T15:35:47.921766+0000","last_active":"2024-04-16T15:35:53.930709+0000","last_peered":"2024-04-16T15:35:53.930709+0000","last_clean":"2024-04-16T15:35:53.930709+0000","last_became_active":"2024-04-16T15:35:47.921491+0000","last_became_peered":"2024-04-16T15:35:47.921491+0000","last_unstale":"2024-04-16T15:35:53.930709+0000","last_undegraded":"2024-04-16T15:35:53.930709+0000","last_fullsized":"2024-04-16T15:35:53.930709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:47:38.918494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.084075+0000","last_change":"2024-04-16T15:35:47.913693+0000","last_active":"2024-04-16T15:35:55.084075+0000","last_peered":"2024-04-16T15:35:55.084075+0000","last_clean":"2024-04-16T15:35:55.084075+0000","last_became_active":"2024-04-16T15:35:47.912712+0000","last_became_peered":"2024-04-16T15:35:47.912712+0000","last_unstale":"2024-04-16T15:35:55.084075+0000","last_undegraded":"2024-04-16T15:35:55.084075+0000","last_fullsized":"2024-04-16T15:35:55.084075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928318+0000","last_change":"2024-04-16T15:35:47.910738+0000","last_active":"2024-04-16T15:35:53.928318+0000","last_peered":"2024-04-16T15:35:53.928318+0000","last_clean":"2024-04-16T15:35:53.928318+0000","last_became_active":"2024-04-16T15:35:47.910305+0000","last_became_peered":"2024-04-16T15:35:47.910305+0000","last_unstale":"2024-04-16T15:35:53.928318+0000","last_undegraded":"2024-04-16T15:35:53.928318+0000","last_fullsized":"2024-04-16T15:35:53.928318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.082815+0000","last_change":"2024-04-16T15:35:47.912617+0000","last_active":"2024-04-16T15:35:55.082815+0000","last_peered":"2024-04-16T15:35:55.082815+0000","last_clean":"2024-04-16T15:35:55.082815+0000","last_became_active":"2024-04-16T15:35:47.912319+0000","last_became_peered":"2024-04-16T15:35:47.912319+0000","last_unstale":"2024-04-16T15:35:55.082815+0000","last_undegraded":"2024-04-16T15:35:55.082815+0000","last_fullsized":"2024-04-16T15:35:55.082815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:31.520886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369503+0000","last_change":"2024-04-16T15:35:47.914226+0000","last_active":"2024-04-16T15:35:54.369503+0000","last_peered":"2024-04-16T15:35:54.369503+0000","last_clean":"2024-04-16T15:35:54.369503+0000","last_became_active":"2024-04-16T15:35:47.913944+0000","last_became_peered":"2024-04-16T15:35:47.913944+0000","last_unstale":"2024-04-16T15:35:54.369503+0000","last_undegraded":"2024-04-16T15:35:54.369503+0000","last_fullsized":"2024-04-16T15:35:54.369503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:38.986347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.928560+0000","last_change":"2024-04-16T15:35:47.910810+0000","last_active":"2024-04-16T15:35:53.928560+0000","last_peered":"2024-04-16T15:35:53.928560+0000","last_clean":"2024-04-16T15:35:53.928560+0000","last_became_active":"2024-04-16T15:35:47.910509+0000","last_became_peered":"2024-04-16T15:35:47.910509+0000","last_unstale":"2024-04-16T15:35:53.928560+0000","last_undegraded":"2024-04-16T15:35:53.928560+0000","last_fullsized":"2024-04-16T15:35:53.928560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:32.868401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929472+0000","last_change":"2024-04-16T15:35:47.921447+0000","last_active":"2024-04-16T15:35:53.929472+0000","last_peered":"2024-04-16T15:35:53.929472+0000","last_clean":"2024-04-16T15:35:53.929472+0000","last_became_active":"2024-04-16T15:35:47.921165+0000","last_became_peered":"2024-04-16T15:35:47.921165+0000","last_unstale":"2024-04-16T15:35:53.929472+0000","last_undegraded":"2024-04-16T15:35:53.929472+0000","last_fullsized":"2024-04-16T15:35:53.929472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927957+0000","last_change":"2024-04-16T15:35:47.909329+0000","last_active":"2024-04-16T15:35:53.927957+0000","last_peered":"2024-04-16T15:35:53.927957+0000","last_clean":"2024-04-16T15:35:53.927957+0000","last_became_active":"2024-04-16T15:35:47.908921+0000","last_became_peered":"2024-04-16T15:35:47.908921+0000","last_unstale":"2024-04-16T15:35:53.927957+0000","last_undegraded":"2024-04-16T15:35:53.927957+0000","last_fullsized":"2024-04-16T15:35:53.927957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930611+0000","last_change":"2024-04-16T15:35:47.916529+0000","last_active":"2024-04-16T15:35:53.930611+0000","last_peered":"2024-04-16T15:35:53.930611+0000","last_clean":"2024-04-16T15:35:53.930611+0000","last_became_active":"2024-04-16T15:35:47.916272+0000","last_became_peered":"2024-04-16T15:35:47.916272+0000","last_unstale":"2024-04-16T15:35:53.930611+0000","last_undegraded":"2024-04-16T15:35:53.930611+0000","last_fullsized":"2024-04-16T15:35:53.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083999+0000","last_change":"2024-04-16T15:35:47.916637+0000","last_active":"2024-04-16T15:35:55.083999+0000","last_peered":"2024-04-16T15:35:55.083999+0000","last_clean":"2024-04-16T15:35:55.083999+0000","last_became_active":"2024-04-16T15:35:47.915756+0000","last_became_peered":"2024-04-16T15:35:47.915756+0000","last_unstale":"2024-04-16T15:35:55.083999+0000","last_undegraded":"2024-04-16T15:35:55.083999+0000","last_fullsized":"2024-04-16T15:35:55.083999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369168+0000","last_change":"2024-04-16T15:35:47.905523+0000","last_active":"2024-04-16T15:35:54.369168+0000","last_peered":"2024-04-16T15:35:54.369168+0000","last_clean":"2024-04-16T15:35:54.369168+0000","last_became_active":"2024-04-16T15:35:47.905101+0000","last_became_peered":"2024-04-16T15:35:47.905101+0000","last_unstale":"2024-04-16T15:35:54.369168+0000","last_undegraded":"2024-04-16T15:35:54.369168+0000","last_fullsized":"2024-04-16T15:35:54.369168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:54.869351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083700+0000","last_change":"2024-04-16T15:35:47.917168+0000","last_active":"2024-04-16T15:35:55.083700+0000","last_peered":"2024-04-16T15:35:55.083700+0000","last_clean":"2024-04-16T15:35:55.083700+0000","last_became_active":"2024-04-16T15:35:47.914760+0000","last_became_peered":"2024-04-16T15:35:47.914760+0000","last_unstale":"2024-04-16T15:35:55.083700+0000","last_undegraded":"2024-04-16T15:35:55.083700+0000","last_fullsized":"2024-04-16T15:35:55.083700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:58.573474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.571311+0000","last_change":"2024-04-16T15:35:47.906661+0000","last_active":"2024-04-16T15:35:54.571311+0000","last_peered":"2024-04-16T15:35:54.571311+0000","last_clean":"2024-04-16T15:35:54.571311+0000","last_became_active":"2024-04-16T15:35:47.906376+0000","last_became_peered":"2024-04-16T15:35:47.906376+0000","last_unstale":"2024-04-16T15:35:54.571311+0000","last_undegraded":"2024-04-16T15:35:54.571311+0000","last_fullsized":"2024-04-16T15:35:54.571311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:28.334343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930697+0000","last_change":"2024-04-16T15:35:47.918857+0000","last_active":"2024-04-16T15:35:53.930697+0000","last_peered":"2024-04-16T15:35:53.930697+0000","last_clean":"2024-04-16T15:35:53.930697+0000","last_became_active":"2024-04-16T15:35:47.918601+0000","last_became_peered":"2024-04-16T15:35:47.918601+0000","last_unstale":"2024-04-16T15:35:53.930697+0000","last_undegraded":"2024-04-16T15:35:53.930697+0000","last_fullsized":"2024-04-16T15:35:53.930697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.929331+0000","last_change":"2024-04-16T15:35:47.903123+0000","last_active":"2024-04-16T15:35:53.929331+0000","last_peered":"2024-04-16T15:35:53.929331+0000","last_clean":"2024-04-16T15:35:53.929331+0000","last_became_active":"2024-04-16T15:35:47.902519+0000","last_became_peered":"2024-04-16T15:35:47.902519+0000","last_unstale":"2024-04-16T15:35:53.929331+0000","last_undegraded":"2024-04-16T15:35:53.929331+0000","last_fullsized":"2024-04-16T15:35:53.929331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:29.339925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083120+0000","last_change":"2024-04-16T15:35:47.906920+0000","last_active":"2024-04-16T15:35:55.083120+0000","last_peered":"2024-04-16T15:35:55.083120+0000","last_clean":"2024-04-16T15:35:55.083120+0000","last_became_active":"2024-04-16T15:35:47.906647+0000","last_became_peered":"2024-04-16T15:35:47.906647+0000","last_unstale":"2024-04-16T15:35:55.083120+0000","last_undegraded":"2024-04-16T15:35:55.083120+0000","last_fullsized":"2024-04-16T15:35:55.083120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:05.870038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083651+0000","last_change":"2024-04-16T15:35:47.903897+0000","last_active":"2024-04-16T15:35:55.083651+0000","last_peered":"2024-04-16T15:35:55.083651+0000","last_clean":"2024-04-16T15:35:55.083651+0000","last_became_active":"2024-04-16T15:35:47.903636+0000","last_became_peered":"2024-04-16T15:35:47.903636+0000","last_unstale":"2024-04-16T15:35:55.083651+0000","last_undegraded":"2024-04-16T15:35:55.083651+0000","last_fullsized":"2024-04-16T15:35:55.083651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:17.608976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927930+0000","last_change":"2024-04-16T15:35:47.919522+0000","last_active":"2024-04-16T15:35:53.927930+0000","last_peered":"2024-04-16T15:35:53.927930+0000","last_clean":"2024-04-16T15:35:53.927930+0000","last_became_active":"2024-04-16T15:35:47.919224+0000","last_became_peered":"2024-04-16T15:35:47.919224+0000","last_unstale":"2024-04-16T15:35:53.927930+0000","last_undegraded":"2024-04-16T15:35:53.927930+0000","last_fullsized":"2024-04-16T15:35:53.927930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.931084+0000","last_change":"2024-04-16T15:35:47.904535+0000","last_active":"2024-04-16T15:35:53.931084+0000","last_peered":"2024-04-16T15:35:53.931084+0000","last_clean":"2024-04-16T15:35:53.931084+0000","last_became_active":"2024-04-16T15:35:47.904263+0000","last_became_peered":"2024-04-16T15:35:47.904263+0000","last_unstale":"2024-04-16T15:35:53.931084+0000","last_undegraded":"2024-04-16T15:35:53.931084+0000","last_fullsized":"2024-04-16T15:35:53.931084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:03.027188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369248+0000","last_change":"2024-04-16T15:35:47.908367+0000","last_active":"2024-04-16T15:35:54.369248+0000","last_peered":"2024-04-16T15:35:54.369248+0000","last_clean":"2024-04-16T15:35:54.369248+0000","last_became_active":"2024-04-16T15:35:47.908073+0000","last_became_peered":"2024-04-16T15:35:47.908073+0000","last_unstale":"2024-04-16T15:35:54.369248+0000","last_undegraded":"2024-04-16T15:35:54.369248+0000","last_fullsized":"2024-04-16T15:35:54.369248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:54.369451+0000","last_change":"2024-04-16T15:35:47.907751+0000","last_active":"2024-04-16T15:35:54.369451+0000","last_peered":"2024-04-16T15:35:54.369451+0000","last_clean":"2024-04-16T15:35:54.369451+0000","last_became_active":"2024-04-16T15:35:47.907492+0000","last_became_peered":"2024-04-16T15:35:47.907492+0000","last_unstale":"2024-04-16T15:35:54.369451+0000","last_undegraded":"2024-04-16T15:35:54.369451+0000","last_fullsized":"2024-04-16T15:35:54.369451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:37:01.659832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083822+0000","last_change":"2024-04-16T15:35:47.922537+0000","last_active":"2024-04-16T15:35:55.083822+0000","last_peered":"2024-04-16T15:35:55.083822+0000","last_clean":"2024-04-16T15:35:55.083822+0000","last_became_active":"2024-04-16T15:35:47.922261+0000","last_became_peered":"2024-04-16T15:35:47.922261+0000","last_unstale":"2024-04-16T15:35:55.083822+0000","last_undegraded":"2024-04-16T15:35:55.083822+0000","last_fullsized":"2024-04-16T15:35:55.083822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:21:37.290015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.927732+0000","last_change":"2024-04-16T15:35:47.921897+0000","last_active":"2024-04-16T15:35:53.927732+0000","last_peered":"2024-04-16T15:35:53.927732+0000","last_clean":"2024-04-16T15:35:53.927732+0000","last_became_active":"2024-04-16T15:35:47.921646+0000","last_became_peered":"2024-04-16T15:35:47.921646+0000","last_unstale":"2024-04-16T15:35:53.927732+0000","last_undegraded":"2024-04-16T15:35:53.927732+0000","last_fullsized":"2024-04-16T15:35:53.927732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:22.565952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083179+0000","last_change":"2024-04-16T15:35:47.920391+0000","last_active":"2024-04-16T15:35:55.083179+0000","last_peered":"2024-04-16T15:35:55.083179+0000","last_clean":"2024-04-16T15:35:55.083179+0000","last_became_active":"2024-04-16T15:35:47.920071+0000","last_became_peered":"2024-04-16T15:35:47.920071+0000","last_unstale":"2024-04-16T15:35:55.083179+0000","last_undegraded":"2024-04-16T15:35:55.083179+0000","last_fullsized":"2024-04-16T15:35:55.083179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930585+0000","last_change":"2024-04-16T15:35:47.903213+0000","last_active":"2024-04-16T15:35:53.930585+0000","last_peered":"2024-04-16T15:35:53.930585+0000","last_clean":"2024-04-16T15:35:53.930585+0000","last_became_active":"2024-04-16T15:35:47.902785+0000","last_became_peered":"2024-04-16T15:35:47.902785+0000","last_unstale":"2024-04-16T15:35:53.930585+0000","last_undegraded":"2024-04-16T15:35:53.930585+0000","last_fullsized":"2024-04-16T15:35:53.930585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:09:08.753722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083264+0000","last_change":"2024-04-16T15:35:47.914772+0000","last_active":"2024-04-16T15:35:55.083264+0000","last_peered":"2024-04-16T15:35:55.083264+0000","last_clean":"2024-04-16T15:35:55.083264+0000","last_became_active":"2024-04-16T15:35:47.913751+0000","last_became_peered":"2024-04-16T15:35:47.913751+0000","last_unstale":"2024-04-16T15:35:55.083264+0000","last_undegraded":"2024-04-16T15:35:55.083264+0000","last_fullsized":"2024-04-16T15:35:55.083264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:54.025092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:53.930257+0000","last_change":"2024-04-16T15:35:47.914826+0000","last_active":"2024-04-16T15:35:53.930257+0000","last_peered":"2024-04-16T15:35:53.930257+0000","last_clean":"2024-04-16T15:35:53.930257+0000","last_became_active":"2024-04-16T15:35:47.913014+0000","last_became_peered":"2024-04-16T15:35:47.913014+0000","last_unstale":"2024-04-16T15:35:53.930257+0000","last_undegraded":"2024-04-16T15:35:53.930257+0000","last_fullsized":"2024-04-16T15:35:53.930257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:08.804945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083035+0000","last_change":"2024-04-16T15:35:47.907911+0000","last_active":"2024-04-16T15:35:55.083035+0000","last_peered":"2024-04-16T15:35:55.083035+0000","last_clean":"2024-04-16T15:35:55.083035+0000","last_became_active":"2024-04-16T15:35:47.907655+0000","last_became_peered":"2024-04-16T15:35:47.907655+0000","last_unstale":"2024-04-16T15:35:55.083035+0000","last_undegraded":"2024-04-16T15:35:55.083035+0000","last_fullsized":"2024-04-16T15:35:55.083035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:17.369195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083534+0000","last_change":"2024-04-16T15:35:47.907719+0000","last_active":"2024-04-16T15:35:55.083534+0000","last_peered":"2024-04-16T15:35:55.083534+0000","last_clean":"2024-04-16T15:35:55.083534+0000","last_became_active":"2024-04-16T15:35:47.907381+0000","last_became_peered":"2024-04-16T15:35:47.907381+0000","last_unstale":"2024-04-16T15:35:55.083534+0000","last_undegraded":"2024-04-16T15:35:55.083534+0000","last_fullsized":"2024-04-16T15:35:55.083534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:49.007517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T15:35:55.083718+0000","last_change":"2024-04-16T15:35:47.913767+0000","last_active":"2024-04-16T15:35:55.083718+0000","last_peered":"2024-04-16T15:35:55.083718+0000","last_clean":"2024-04-16T15:35:55.083718+0000","last_became_active":"2024-04-16T15:35:47.913475+0000","last_became_peered":"2024-04-16T15:35:47.913475+0000","last_unstale":"2024-04-16T15:35:55.083718+0000","last_undegraded":"2024-04-16T15:35:55.083718+0000","last_fullsized":"2024-04-16T15:35:55.083718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:46.877067+0000","last_clean_scrub_stamp":"2024-04-16T15:35:46.877067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:05:51.178925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:36:09.695 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T15:36:09.695 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T15:36:09.695 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T15:36:09.695 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T15:36:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.835+0000 7f2cc5860640 1 Processor -- start 2024-04-16T15:36:09.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.835+0000 7f2cc5860640 1 -- start start 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cc5860640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cc015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cc5860640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc00cfc10 con 0x7f2cc015ef80 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cc5860640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc00cfeb0 con 0x7f2cc00cf780 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cc5860640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc0162900 con 0x7f2cc00d1450 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cb67fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2cc015ef80 0x7f2cc00d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34008/0 (socket says 172.21.15.80:34008) 2024-04-16T15:36:09.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cb67fc640 1 -- 172.21.15.80:0/2696763787 learned_addr learned my addr 172.21.15.80:0/2696763787 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cc015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129443490 0 0) 0x7f2cc00cfc10 con 0x7f2cc015ef80 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cac003520 con 0x7f2cc015ef80 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228634890 0 0) 0x7f2cc00cfeb0 con 0x7f2cc00cf780 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc00cfc10 con 0x7f2cc00cf780 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037367789 0 0) 0x7f2cac003520 con 0x7f2cc015ef80 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 msgr2=0x7f2cc015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cc015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 >> v1:172.21.15.87:6789/0 conn(0x7f2cc00cf780 legacy=0x7f2cc00d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00d0190 con 0x7f2cc015ef80 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f2ca8001690 con 0x7f2cc015ef80 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 >> v1:172.21.15.80:6789/0 conn(0x7f2cc015ef80 legacy=0x7f2cc00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cac003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cac004800 0x7f2cac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cac0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0162900 con 0x7f2cac003b70 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac00bad0 con 0x7f2cac004800 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac00bcd0 con 0x7f2cc00d1450 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.836+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cac003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cb67fc640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cac004800 0x7f2cac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbf7fe640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cac0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 -- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 msgr2=0x7f2cac0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc00d1450 0x7f2cac0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 -- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cac004800 msgr2=0x7f2cac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cac004800 0x7f2cac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 -- 172.21.15.80:0/2696763787 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac003520 con 0x7f2cac003b70 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.837+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cac003f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009ac0 tx=0x7f2cac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a157bfd88aa762 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0039070 con 0x7f2cac003b70 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb002c6b0 con 0x7f2cac003b70 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cbe7fc640 1 -- 172.21.15.80:0/2696763787 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0009690 con 0x7f2cac003b70 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 -- 172.21.15.80:0/2696763787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 msgr2=0x7f2cac003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 --2- 172.21.15.80:0/2696763787 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cac003f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009ac0 tx=0x7f2cac005830 comp rx=0 tx=0).stop 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cbf7fe640 1 -- 172.21.15.80:0/2696763787 reap_dead start 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 -- 172.21.15.80:0/2696763787 shutdown_connections 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 -- 172.21.15.80:0/2696763787 >> 172.21.15.80:0/2696763787 conn(0x7f2cc006ce20 msgr2=0x7f2cc006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 -- 172.21.15.80:0/2696763787 shutdown_connections 2024-04-16T15:36:09.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.838+0000 7f2cc5860640 1 -- 172.21.15.80:0/2696763787 wait complete. 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.839+0000 7f2cc5860640 1 Processor -- start 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 -- start start 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc0151860 0x7f2cc01f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc00c8250 0x7f2cc00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc015fe60 con 0x7f2cac003b70 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0162ec0 con 0x7f2cc00c8250 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cc5860640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc015ffe0 con 0x7f2cc0151860 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cbeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cbeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35062/0 (socket says 172.21.15.80:35062) 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.840+0000 7f2cbeffd640 1 -- 172.21.15.80:0/3444520257 learned_addr learned my addr 172.21.15.80:0/3444520257 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cb67fc640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc0151860 0x7f2cc01f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbf7fe640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc00c8250 0x7f2cc00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 -- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc0151860 msgr2=0x7f2cc01f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc0151860 0x7f2cc01f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 -- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc00c8250 msgr2=0x7f2cc00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc00c8250 0x7f2cc00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 -- 172.21.15.80:0/3444520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc01f8c30 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbeffd640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0037040 tx=0x7f2cb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0042020 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb003a040 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc01f8f10 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0039070 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.841+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc00ccab0 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.842+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc0068a40 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.843+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cb0045020 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.843+0000 7f2cbcff9640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 0x7f2ca006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.843+0000 7f2cb67fc640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 0x7f2ca006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.843+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2cb00ad650 con 0x7f2cac003b70 2024-04-16T15:36:09.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.844+0000 7f2cb67fc640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 0x7f2ca006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cc015acd0 tx=0x7f2ca8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:09.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:09.848+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2cb004c030 con 0x7f2cac003b70 2024-04-16T15:36:10.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.059+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cc0162120 con 0x7f2cac003b70 2024-04-16T15:36:10.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.059+0000 7f2cbcff9640 1 -- 172.21.15.80:0/3444520257 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2cb007b740 con 0x7f2cac003b70 2024-04-16T15:36:10.058 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:10.058 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 msgr2=0x7f2ca006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 0x7f2ca006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2cc015acd0 tx=0x7f2ca8009040 comp rx=0 tx=0).stop 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 msgr2=0x7f2cc01f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0037040 tx=0x7f2cb0004730 comp rx=0 tx=0).stop 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 shutdown_connections 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2cc00c8250 0x7f2cc00ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2ca006c920 0x7f2ca006ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2cc0151860 0x7f2cc01f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 --2- 172.21.15.80:0/3444520257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2cac003b70 0x7f2cc01f4db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 >> 172.21.15.80:0/3444520257 conn(0x7f2cc006ce20 msgr2=0x7f2cc00b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 shutdown_connections 2024-04-16T15:36:10.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.061+0000 7f2cc5860640 1 -- 172.21.15.80:0/3444520257 wait complete. 2024-04-16T15:36:10.070 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T15:36:10.071 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.175+0000 7fc1ac81b640 1 Processor -- start 2024-04-16T15:36:10.174 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.175+0000 7fc1ac81b640 1 -- start start 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1ac81b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1a815e980 0x7fc1a809b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1ac81b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80d19d0 con 0x7fc1a80ccae0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1ac81b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a8070f90 con 0x7fc1a80709f0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1ac81b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a80d05b0 con 0x7fc1a815e980 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1a6d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc1a80ccae0 0x7fc1a809aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34012/0 (socket says 172.21.15.80:34012) 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.176+0000 7fc1a6d9d640 1 -- 172.21.15.80:0/1996812826 learned_addr learned my addr 172.21.15.80:0/1996812826 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398528762 0 0) 0x7fc1a80d19d0 con 0x7fc1a80ccae0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc194003520 con 0x7fc1a80ccae0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a659c640 1 --2- 172.21.15.80:0/1996812826 >> v2:172.21.15.87:3300/0 conn(0x7fc1a815e980 0x7fc1a809b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3936270683 0 0) 0x7fc194003520 con 0x7fc1a80ccae0 2024-04-16T15:36:10.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 >> v2:172.21.15.87:3300/0 conn(0x7fc1a815e980 msgr2=0x7fc1a809b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 --2- 172.21.15.80:0/1996812826 >> v2:172.21.15.87:3300/0 conn(0x7fc1a815e980 0x7fc1a809b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 >> v1:172.21.15.87:6789/0 conn(0x7fc1a80709f0 legacy=0x7fc1a80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a80d07e0 con 0x7fc1a80ccae0 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fc1a0001670 con 0x7fc1a80ccae0 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 >> v1:172.21.15.80:6789/0 conn(0x7fc1a80ccae0 legacy=0x7fc1a809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1940039b0 0x7fc194003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 0x7fc194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1940051c0 0x7fc19400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc19400c0e0 con 0x7fc194004800 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc19400c290 con 0x7fc1940039b0 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc19400c490 con 0x7fc1940051c0 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 0x7fc194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a659c640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1940039b0 0x7fc194003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a6d9d640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1940051c0 0x7fc19400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1940051c0 msgr2=0x7fc19400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1940051c0 0x7fc19400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1940039b0 msgr2=0x7fc194003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1940039b0 0x7fc194003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/1996812826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc194003520 con 0x7fc194004800 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.177+0000 7fc1a6d9d640 1 -- 172.21.15.80:0/1996812826 reap_dead start 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.178+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 0x7fc194004c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc190001750 tx=0x7fc194005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be8766da5cdfb15 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.178+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190001370 con 0x7fc194004800 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.178+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1900052d0 con 0x7fc194004800 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.178+0000 7fc1a559a640 1 -- 172.21.15.80:0/1996812826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190003830 con 0x7fc194004800 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 -- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 msgr2=0x7fc194004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 0x7fc194004c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc190001750 tx=0x7fc194005830 comp rx=0 tx=0).stop 2024-04-16T15:36:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 -- 172.21.15.80:0/1996812826 shutdown_connections 2024-04-16T15:36:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/1996812826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc194004800 0x7fc194004c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 -- 172.21.15.80:0/1996812826 >> 172.21.15.80:0/1996812826 conn(0x7fc1a80b3f80 msgr2=0x7fc1a80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 -- 172.21.15.80:0/1996812826 shutdown_connections 2024-04-16T15:36:10.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.179+0000 7fc1ac81b640 1 -- 172.21.15.80:0/1996812826 wait complete. 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.180+0000 7fc1ac81b640 1 Processor -- start 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 -- start start 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc194004800 0x7fc1a8158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1a80c9560 0x7fc1a80c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80d0da0 con 0x7fc1a815efe0 2024-04-16T15:36:10.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8071270 con 0x7fc194004800 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.181+0000 7fc1ac81b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a815ed60 con 0x7fc1a80c9560 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35070/0 (socket says 172.21.15.80:35070) 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/2618368591 learned_addr learned my addr 172.21.15.80:0/2618368591 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a6d9d640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1a80c9560 0x7fc1a80c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a659c640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc194004800 0x7fc1a8158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1a80c9560 msgr2=0x7fc1a80c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1a80c9560 0x7fc1a80c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc194004800 msgr2=0x7fc1a8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc194004800 0x7fc1a8158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 -- 172.21.15.80:0/2618368591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a815fa80 con 0x7fc1a815efe0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1a5d9b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc190000c00 tx=0x7fc190001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190041020 con 0x7fc1a815efe0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc190005480 con 0x7fc1a815efe0 2024-04-16T15:36:10.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a815fd60 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190007a30 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.182+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a8160320 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.183+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a8069150 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.184+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc190044020 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.184+0000 7fc19effd640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 0x7fc18806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.184+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1900ad760 con 0x7fc1a815efe0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.184+0000 7fc1a659c640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 0x7fc18806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.185+0000 7fc1a659c640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 0x7fc18806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc198003bc0 tx=0x7fc198009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.189+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc19004b030 con 0x7fc1a815efe0 2024-04-16T15:36:10.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.364+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1a80d1fd0 con 0x7fc1a815efe0 2024-04-16T15:36:10.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.365+0000 7fc19effd640 1 -- 172.21.15.80:0/2618368591 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fc190006e20 con 0x7fc1a815efe0 2024-04-16T15:36:10.364 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:10.364 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 msgr2=0x7fc18806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 0x7fc18806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc198003bc0 tx=0x7fc198009760 comp rx=0 tx=0).stop 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 msgr2=0x7fc1a815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc190000c00 tx=0x7fc190001120 comp rx=0 tx=0).stop 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 shutdown_connections 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc18806c8f0 0x7fc18806edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc1a80c9560 0x7fc1a80c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc1a815efe0 0x7fc1a815f440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 --2- 172.21.15.80:0/2618368591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc194004800 0x7fc1a8158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 >> 172.21.15.80:0/2618368591 conn(0x7fc1a80b3f80 msgr2=0x7fc1a8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 shutdown_connections 2024-04-16T15:36:10.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.367+0000 7fc1ac81b640 1 -- 172.21.15.80:0/2618368591 wait complete. 2024-04-16T15:36:10.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:10.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.484+0000 7f754b5f4640 1 Processor -- start 2024-04-16T15:36:10.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.484+0000 7f754b5f4640 1 -- start start 2024-04-16T15:36:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f754b5f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f75440cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f754b5f4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754406bad0 con 0x7f75440d03d0 2024-04-16T15:36:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f754b5f4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f754406bdb0 con 0x7f75440ccdb0 2024-04-16T15:36:10.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f754b5f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f754406c090 con 0x7f75440cf8e0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f7549b91640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f75440d03d0 0x7f754406c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34016/0 (socket says 172.21.15.80:34016) 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f7549b91640 1 -- 172.21.15.80:0/2500278162 learned_addr learned my addr 172.21.15.80:0/2500278162 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f7549390640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f75440cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993604736 0 0) 0x7f754406bad0 con 0x7f75440d03d0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7530003520 con 0x7f75440d03d0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044237515 0 0) 0x7f754406bdb0 con 0x7f75440ccdb0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f754406bad0 con 0x7f75440ccdb0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495724690 0 0) 0x7f7530003520 con 0x7f75440d03d0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 msgr2=0x7f75440cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f75440cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 >> v1:172.21.15.87:6789/0 conn(0x7f75440ccdb0 legacy=0x7f75440cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754406c370 con 0x7f75440d03d0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f753c001670 con 0x7f75440d03d0 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f7549390640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f75440cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:10.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.485+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 >> v1:172.21.15.80:6789/0 conn(0x7f75440d03d0 legacy=0x7f754406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f7530003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7530004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7530004d40 0x7f75300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f754406c090 con 0x7f7530004100 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f753000bc00 con 0x7f7530004d40 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f753000be00 con 0x7f75440cf8e0 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7530004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7549390640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f7530003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7549b91640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7530004d40 0x7f75300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 -- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 msgr2=0x7f7530003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f75440cf8e0 0x7f7530003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 -- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7530004d40 msgr2=0x7f75300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7530004d40 0x7f75300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.488 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.486+0000 7f7548b8f640 1 -- 172.21.15.80:0/2500278162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530003520 con 0x7f7530004100 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f7548b8f640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7530004800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75340018d0 tx=0x7f7530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119f8a90bc0694a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534037070 con 0x7f7530004100 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75340052d0 con 0x7f7530004100 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f753bfff640 1 -- 172.21.15.80:0/2500278162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75340014f0 con 0x7f7530004100 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 -- 172.21.15.80:0/2500278162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 msgr2=0x7f7530004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 --2- 172.21.15.80:0/2500278162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7530004800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75340018d0 tx=0x7f7530005830 comp rx=0 tx=0).stop 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f7549b91640 1 -- 172.21.15.80:0/2500278162 reap_dead start 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 -- 172.21.15.80:0/2500278162 shutdown_connections 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 -- 172.21.15.80:0/2500278162 >> 172.21.15.80:0/2500278162 conn(0x7f75440d0c30 msgr2=0x7f75440d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 -- 172.21.15.80:0/2500278162 shutdown_connections 2024-04-16T15:36:10.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.487+0000 7f754b5f4640 1 -- 172.21.15.80:0/2500278162 wait complete. 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 Processor -- start 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 -- start start 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f754415bed0 0x7f75441f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75441f7ff0 0x7f75441f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f75440b00f0 con 0x7f7530004100 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f75440ce2b0 con 0x7f75441f7ff0 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f754b5f4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f75441590a0 con 0x7f754415bed0 2024-04-16T15:36:10.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f7549390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f7549390640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35090/0 (socket says 172.21.15.80:35090) 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.489+0000 7f7549390640 1 -- 172.21.15.80:0/4001958058 learned_addr learned my addr 172.21.15.80:0/4001958058 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7548b8f640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f754415bed0 0x7f75441f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549b91640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75441f7ff0 0x7f75441f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 -- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f754415bed0 msgr2=0x7f75441f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f754415bed0 0x7f75441f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 -- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75441f7ff0 msgr2=0x7f75441f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75441f7ff0 0x7f75441f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 -- 172.21.15.80:0/4001958058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75441598b0 con 0x7f7530004100 2024-04-16T15:36:10.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7549390640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7540011e00 tx=0x7f754000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540015630 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75400157d0 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75441592f0 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540015ba0 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.490+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75440ad9f0 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.491+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7544068a40 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.492+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f754001d400 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.492+0000 7f7539ffb640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 0x7f752806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.492+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f754008cf30 con 0x7f7530004100 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.492+0000 7f7548b8f640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 0x7f752806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.492+0000 7f7548b8f640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 0x7f752806ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7534034000 tx=0x7f7534031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.496+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7540019030 con 0x7f7530004100 2024-04-16T15:36:10.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.669+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75440d1810 con 0x7f7530004100 2024-04-16T15:36:10.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.669+0000 7f7539ffb640 1 -- 172.21.15.80:0/4001958058 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f7540010040 con 0x7f7530004100 2024-04-16T15:36:10.668 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 msgr2=0x7f752806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 0x7f752806ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7534034000 tx=0x7f7534031000 comp rx=0 tx=0).stop 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 msgr2=0x7f7544159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7540011e00 tx=0x7f754000f580 comp rx=0 tx=0).stop 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 shutdown_connections 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75441f7ff0 0x7f75441f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f752806c920 0x7f752806ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f754415bed0 0x7f75441f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 --2- 172.21.15.80:0/4001958058 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7530004100 0x7f7544159fc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 >> 172.21.15.80:0/4001958058 conn(0x7f75440d0c30 msgr2=0x7f75440cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 shutdown_connections 2024-04-16T15:36:10.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.671+0000 7f754b5f4640 1 -- 172.21.15.80:0/4001958058 wait complete. 2024-04-16T15:36:10.681 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 Processor -- start 2024-04-16T15:36:10.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 -- start start 2024-04-16T15:36:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c68161f20 0x7f0c680cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c680cfd90 con 0x7f0c680d1700 2024-04-16T15:36:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c680d0050 con 0x7f0c680b74e0 2024-04-16T15:36:10.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.788+0000 7f0c6e7f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0c680d0330 con 0x7f0c68161f20 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c67fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0c68161f20 0x7f0c680cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c6cd8f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0c680d1700 0x7f0c680d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34032/0 (socket says 172.21.15.80:34032) 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c6cd8f640 1 -- 172.21.15.80:0/20967646 learned_addr learned my addr 172.21.15.80:0/20967646 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c67fff640 1 -- 172.21.15.80:0/20967646 >> v1:172.21.15.87:6789/0 conn(0x7f0c680b74e0 legacy=0x7f0c680d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c67fff640 1 -- 172.21.15.80:0/20967646 >> v1:172.21.15.80:6789/0 conn(0x7f0c680d1700 legacy=0x7f0c680d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c66ffd640 1 -- 172.21.15.80:0/20967646 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212257235 0 0) 0x7f0c680cfd90 con 0x7f0c680d1700 2024-04-16T15:36:10.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.789+0000 7f0c67fff640 1 -- 172.21.15.80:0/20967646 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c680d0610 con 0x7f0c68161f20 2024-04-16T15:36:10.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c67fff640 1 --2- 172.21.15.80:0/20967646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c68161f20 0x7f0c680cf230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097a0 tx=0x7f0c5802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730c1651f0ec27f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c66ffd640 1 -- 172.21.15.80:0/20967646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58034070 con 0x7f0c68161f20 2024-04-16T15:36:10.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c66ffd640 1 -- 172.21.15.80:0/20967646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c58030610 con 0x7f0c68161f20 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c66ffd640 1 -- 172.21.15.80:0/20967646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c580309e0 con 0x7f0c68161f20 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/20967646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c68161f20 msgr2=0x7f0c680cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/20967646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c68161f20 0x7f0c680cf230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097a0 tx=0x7f0c5802b960 comp rx=0 tx=0).stop 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/20967646 shutdown_connections 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/20967646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c68161f20 0x7f0c680cf230 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/20967646 >> 172.21.15.80:0/20967646 conn(0x7f0c6808c000 msgr2=0x7f0c680d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/20967646 shutdown_connections 2024-04-16T15:36:10.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.790+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/20967646 wait complete. 2024-04-16T15:36:10.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 Processor -- start 2024-04-16T15:36:10.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 -- start start 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 0x7f0c680cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c68161f20 0x7f0c681f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680cf770 con 0x7f0c680b74e0 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680b5730 con 0x7f0c680d1700 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.792+0000 7f0c6e7f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0c680cf8f0 con 0x7f0c68161f20 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35106/0 (socket says 172.21.15.80:35106) 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 -- 172.21.15.80:0/1088310251 learned_addr learned my addr 172.21.15.80:0/1088310251 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c6cd8f640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c68161f20 0x7f0c681f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c677fe640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 0x7f0c680cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 -- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c68161f20 msgr2=0x7f0c681f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c68161f20 0x7f0c681f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 -- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 msgr2=0x7f0c680cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 0x7f0c680cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 -- 172.21.15.80:0/1088310251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6815ef00 con 0x7f0c680b74e0 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c677fe640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 0x7f0c680cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c67fff640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000c00 tx=0x7f0c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58034040 con 0x7f0c680b74e0 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c58004030 con 0x7f0c680b74e0 2024-04-16T15:36:10.794 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6815f1e0 con 0x7f0c680b74e0 2024-04-16T15:36:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004420 con 0x7f0c680b74e0 2024-04-16T15:36:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.793+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6815f7a0 con 0x7f0c680b74e0 2024-04-16T15:36:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.794+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6808e170 con 0x7f0c680b74e0 2024-04-16T15:36:10.795 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.795+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c5804c060 con 0x7f0c680b74e0 2024-04-16T15:36:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.795+0000 7f0c64ff9640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 0x7f0c5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.795+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c580adb30 con 0x7f0c680b74e0 2024-04-16T15:36:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.795+0000 7f0c677fe640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 0x7f0c5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:10.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.796+0000 7f0c677fe640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 0x7f0c5406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b5cf0 tx=0x7f0c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.799+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c6808e170 con 0x7f0c680b74e0 2024-04-16T15:36:10.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.976+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0c68161a60 con 0x7f0c680b74e0 2024-04-16T15:36:10.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.976+0000 7f0c64ff9640 1 -- 172.21.15.80:0/1088310251 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f0c5807bc20 con 0x7f0c680b74e0 2024-04-16T15:36:10.975 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 msgr2=0x7f0c5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 0x7f0c5406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b5cf0 tx=0x7f0c5c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 msgr2=0x7f0c680ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c58000c00 tx=0x7f0c580046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 shutdown_connections 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0c5406c8f0 0x7f0c5406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0c68161f20 0x7f0c681f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0c680d1700 0x7f0c680cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 --2- 172.21.15.80:0/1088310251 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c680b74e0 0x7f0c680ca170 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:10.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 >> 172.21.15.80:0/1088310251 conn(0x7f0c6808c000 msgr2=0x7f0c680b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:10.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 shutdown_connections 2024-04-16T15:36:10.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:10.978+0000 7f0c6e7f2640 1 -- 172.21.15.80:0/1088310251 wait complete. 2024-04-16T15:36:10.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.094+0000 7fb998088640 1 Processor -- start 2024-04-16T15:36:11.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.094+0000 7fb998088640 1 -- start start 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb998088640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb9900b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb998088640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99015b970 con 0x7fb990072660 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb998088640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99015bc50 con 0x7fb9900cd110 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb998088640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb99015c210 con 0x7fb99006de30 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb995e24640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb990072660 0x7fb99015b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34034/0 (socket says 172.21.15.80:34034) 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb995e24640 1 -- 172.21.15.80:0/2380237165 learned_addr learned my addr 172.21.15.80:0/2380237165 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:11.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb996625640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb9900b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182045743 0 0) 0x7fb99015b970 con 0x7fb990072660 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.095+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb97c003440 con 0x7fb990072660 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109235343 0 0) 0x7fb99015bc50 con 0x7fb9900cd110 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99015b970 con 0x7fb9900cd110 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1461159075 0 0) 0x7fb97c003440 con 0x7fb990072660 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 msgr2=0x7fb9900b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb9900b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 >> v1:172.21.15.87:6789/0 conn(0x7fb9900cd110 legacy=0x7fb990072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99015bf30 con 0x7fb990072660 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb996625640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb9900b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fb98c0019f0 con 0x7fb990072660 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 >> v1:172.21.15.80:6789/0 conn(0x7fb990072660 legacy=0x7fb99015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c003c60 0x7fb97c008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb97c00ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c00b2e0 0x7fb97c00d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb99015c210 con 0x7fb97c003c60 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c00dc70 con 0x7fb97c00b2e0 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c00de70 con 0x7fb99006de30 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c003c60 0x7fb97c008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995623640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb97c00ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb996625640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c00b2e0 0x7fb97c00d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 -- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 msgr2=0x7fb97c00ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb99006de30 0x7fb97c00ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 -- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c00b2e0 msgr2=0x7fb97c00d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c00b2e0 0x7fb97c00d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb995e24640 1 -- 172.21.15.80:0/2380237165 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c003440 con 0x7fb97c003c60 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.096+0000 7fb996625640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c00b2e0 0x7fb97c00d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb995e24640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c003c60 0x7fb97c008850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00a760 tx=0x7fb97c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d988688b2ef10a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00a3b0 con 0x7fb97c003c60 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c034630 con 0x7fb97c003c60 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb994e22640 1 -- 172.21.15.80:0/2380237165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c034a60 con 0x7fb97c003c60 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb998088640 1 -- 172.21.15.80:0/2380237165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c003c60 msgr2=0x7fb97c008850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb998088640 1 --2- 172.21.15.80:0/2380237165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c003c60 0x7fb97c008850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00a760 tx=0x7fb97c003730 comp rx=0 tx=0).stop 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.097+0000 7fb996625640 1 -- 172.21.15.80:0/2380237165 reap_dead start 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.098+0000 7fb998088640 1 -- 172.21.15.80:0/2380237165 shutdown_connections 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.098+0000 7fb998088640 1 -- 172.21.15.80:0/2380237165 >> 172.21.15.80:0/2380237165 conn(0x7fb990067d90 msgr2=0x7fb99006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.098+0000 7fb998088640 1 -- 172.21.15.80:0/2380237165 shutdown_connections 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.098+0000 7fb998088640 1 -- 172.21.15.80:0/2380237165 wait complete. 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 Processor -- start 2024-04-16T15:36:11.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 -- start start 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c003c60 0x7fb99015e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9900c5e90 0x7fb9901575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900b5a80 con 0x7fb9900cba40 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900b5900 con 0x7fb97c003c60 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.099+0000 7fb998088640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb99006e2c0 con 0x7fb9900c5e90 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35132/0 (socket says 172.21.15.80:35132) 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 -- 172.21.15.80:0/2967699900 learned_addr learned my addr 172.21.15.80:0/2967699900 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb995e24640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c003c60 0x7fb99015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb995623640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9900c5e90 0x7fb9901575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 -- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9900c5e90 msgr2=0x7fb9901575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9900c5e90 0x7fb9901575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 -- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c003c60 msgr2=0x7fb99015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c003c60 0x7fb99015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 -- 172.21.15.80:0/2967699900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9900c63c0 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb996625640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9900cd4f0 tx=0x7fb988011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988004440 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98801b070 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9900c66a0 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988003810 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.100+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9900c6c60 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.101+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb990068a40 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.102+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9880039b0 con 0x7fb9900cba40 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.102+0000 7fb9867fc640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 0x7fb97406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.102+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb98808c240 con 0x7fb9900cba40 2024-04-16T15:36:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.102+0000 7fb995e24640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 0x7fb97406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.103+0000 7fb995e24640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 0x7fb97406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb98c034000 tx=0x7fb98c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.106+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb98805a330 con 0x7fb9900cba40 2024-04-16T15:36:11.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.282+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9900c7060 con 0x7fb9900cba40 2024-04-16T15:36:11.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.283+0000 7fb9867fc640 1 -- 172.21.15.80:0/2967699900 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fb988059c30 con 0x7fb9900cba40 2024-04-16T15:36:11.281 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 msgr2=0x7fb97406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 0x7fb97406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb98c034000 tx=0x7fb98c02f000 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 msgr2=0x7fb9900cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9900cd4f0 tx=0x7fb988011920 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 shutdown_connections 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9900cba40 0x7fb9900cbeb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97406c8f0 0x7fb97406edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9900c5e90 0x7fb9901575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 --2- 172.21.15.80:0/2967699900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb97c003c60 0x7fb99015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 >> 172.21.15.80:0/2967699900 conn(0x7fb990067d90 msgr2=0x7fb990072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 shutdown_connections 2024-04-16T15:36:11.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.285+0000 7fb998088640 1 -- 172.21.15.80:0/2967699900 wait complete. 2024-04-16T15:36:11.294 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.401+0000 7f3e188f2640 1 Processor -- start 2024-04-16T15:36:11.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.401+0000 7f3e188f2640 1 -- start start 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e188f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e140d0df0 0x7f3e140d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e188f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14160430 0x7f3e1406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e188f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e140d1710 con 0x7f3e1406e3e0 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e188f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1415fb80 con 0x7f3e14160430 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e188f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1415fe60 con 0x7f3e140d0df0 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e09d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14160430 0x7f3e1406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e12d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3e1406e3e0 0x7f3e1415ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34044/0 (socket says 172.21.15.80:34044) 2024-04-16T15:36:11.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e09d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e14160430 0x7f3e1406dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35138/0 (socket says 172.21.15.80:35138) 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e12d9d640 1 -- 172.21.15.80:0/197404932 learned_addr learned my addr 172.21.15.80:0/197404932 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.402+0000 7f3e1259c640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e140d0df0 0x7f3e140d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e09d9b640 1 -- 172.21.15.80:0/197404932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e140d0df0 msgr2=0x7f3e140d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e09d9b640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e140d0df0 0x7f3e140d11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e09d9b640 1 -- 172.21.15.80:0/197404932 >> v1:172.21.15.80:6789/0 conn(0x7f3e1406e3e0 legacy=0x7f3e1415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e11d9b640 1 -- 172.21.15.80:0/197404932 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398520955 0 0) 0x7f3e140d1710 con 0x7f3e1406e3e0 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e09d9b640 1 -- 172.21.15.80:0/197404932 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1406d6a0 con 0x7f3e14160430 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.403+0000 7f3e09d9b640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14160430 0x7f3e1406dea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0097a0 tx=0x7f3dfc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5f7e5b1d44cca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e11d9b640 1 -- 172.21.15.80:0/197404932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0315a0 con 0x7f3e14160430 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e11d9b640 1 -- 172.21.15.80:0/197404932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc037070 con 0x7f3e14160430 2024-04-16T15:36:11.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e11d9b640 1 -- 172.21.15.80:0/197404932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc031960 con 0x7f3e14160430 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 -- 172.21.15.80:0/197404932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14160430 msgr2=0x7f3e1406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14160430 0x7f3e1406dea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0097a0 tx=0x7f3dfc02b840 comp rx=0 tx=0).stop 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 -- 172.21.15.80:0/197404932 shutdown_connections 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e14160430 0x7f3e1406dea0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 --2- 172.21.15.80:0/197404932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e140d0df0 0x7f3e140d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 -- 172.21.15.80:0/197404932 >> 172.21.15.80:0/197404932 conn(0x7f3e140d24e0 msgr2=0x7f3e140d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 -- 172.21.15.80:0/197404932 shutdown_connections 2024-04-16T15:36:11.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.404+0000 7f3e188f2640 1 -- 172.21.15.80:0/197404932 wait complete. 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 Processor -- start 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 -- start start 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e1406e3e0 0x7f3e141590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 0x7f3e1415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1406e850 con 0x7f3e140d0df0 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1406d350 con 0x7f3e14160430 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.406+0000 7f3e188f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1406e9d0 con 0x7f3e1406e3e0 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35152/0 (socket says 172.21.15.80:35152) 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 -- 172.21.15.80:0/445909201 learned_addr learned my addr 172.21.15.80:0/445909201 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e12d9d640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 0x7f3e1415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e1259c640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e1406e3e0 0x7f3e141590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 -- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e1406e3e0 msgr2=0x7f3e141590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e1406e3e0 0x7f3e141590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 -- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 msgr2=0x7f3e1415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 0x7f3e1415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 -- 172.21.15.80:0/445909201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e140b2630 con 0x7f3e140d0df0 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e12d9d640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 0x7f3e1415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e09d9b640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc034040 tx=0x7f3dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004230 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0043f0 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc003850 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e140b2910 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.407+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e140b2ed0 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.408+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14068a40 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.409+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dfc0039f0 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.409+0000 7f3e0b7fe640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 0x7f3df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.409+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3dfc02f030 con 0x7f3e140d0df0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.409+0000 7f3e1259c640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 0x7f3df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.410+0000 7f3e1259c640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 0x7f3df406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009970 tx=0x7f3e04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.413+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dfc0b4080 con 0x7f3e140d0df0 2024-04-16T15:36:11.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.587+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3e140d0bd0 con 0x7f3e140d0df0 2024-04-16T15:36:11.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.587+0000 7f3e0b7fe640 1 -- 172.21.15.80:0/445909201 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f3dfc041070 con 0x7f3e140d0df0 2024-04-16T15:36:11.586 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 msgr2=0x7f3df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 0x7f3df406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009970 tx=0x7f3e04008040 comp rx=0 tx=0).stop 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 msgr2=0x7f3e140b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc034040 tx=0x7f3dfc0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 shutdown_connections 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e14160430 0x7f3e1415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e140d0df0 0x7f3e140b36d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3df406c8f0 0x7f3df406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 --2- 172.21.15.80:0/445909201 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e1406e3e0 0x7f3e141590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 >> 172.21.15.80:0/445909201 conn(0x7f3e140d24e0 msgr2=0x7f3e140d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.589+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 shutdown_connections 2024-04-16T15:36:11.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.590+0000 7f3e188f2640 1 -- 172.21.15.80:0/445909201 wait complete. 2024-04-16T15:36:11.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:11.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.703+0000 7fb993855640 1 Processor -- start 2024-04-16T15:36:11.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.704+0000 7fb993855640 1 -- start start 2024-04-16T15:36:11.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.704+0000 7fb993855640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb98c0d1450 0x7fb98c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.704+0000 7fb993855640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.704+0000 7fb993855640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98c0cfeb0 con 0x7fb98c163350 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb993855640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb98c162900 con 0x7fb98c0d1450 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb993855640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c162ec0 con 0x7fb98c15ef80 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb98c0d1450 0x7fb98c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb98c0d1450 0x7fb98c15fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35160/0 (socket says 172.21.15.80:35160) 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 -- 172.21.15.80:0/1016904977 learned_addr learned my addr 172.21.15.80:0/1016904977 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb990df0640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 -- 172.21.15.80:0/1016904977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 msgr2=0x7fb98c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 -- 172.21.15.80:0/1016904977 >> v1:172.21.15.87:6789/0 conn(0x7fb98c163350 legacy=0x7fb98c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.705+0000 7fb9915f1640 1 -- 172.21.15.80:0/1016904977 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c0d0190 con 0x7fb98c0d1450 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb9915f1640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c15fe60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb980009870 tx=0x7fb98002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7342cd1e82f55d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb97ffff640 1 -- 172.21.15.80:0/1016904977 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980035020 con 0x7fb98c0d1450 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb97ffff640 1 -- 172.21.15.80:0/1016904977 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980031640 con 0x7fb98c0d1450 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb97ffff640 1 -- 172.21.15.80:0/1016904977 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98002d040 con 0x7fb98c0d1450 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 -- 172.21.15.80:0/1016904977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 msgr2=0x7fb98c15fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c15fe60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb980009870 tx=0x7fb98002b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 -- 172.21.15.80:0/1016904977 shutdown_connections 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 --2- 172.21.15.80:0/1016904977 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c15fe60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.706+0000 7fb993855640 1 -- 172.21.15.80:0/1016904977 >> 172.21.15.80:0/1016904977 conn(0x7fb98c06ce20 msgr2=0x7fb98c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.707+0000 7fb993855640 1 -- 172.21.15.80:0/1016904977 shutdown_connections 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.707+0000 7fb993855640 1 -- 172.21.15.80:0/1016904977 wait complete. 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.708+0000 7fb993855640 1 Processor -- start 2024-04-16T15:36:11.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.708+0000 7fb993855640 1 -- start start 2024-04-16T15:36:11.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.708+0000 7fb993855640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 0x7fb98c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c0d2ff0 con 0x7fb98c0d1450 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1637c0 con 0x7fb98c163350 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c0d3170 con 0x7fb98c15ef80 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35176/0 (socket says 172.21.15.80:35176) 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 -- 172.21.15.80:0/2120360844 learned_addr learned my addr 172.21.15.80:0/2120360844 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb991df2640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 0x7fb98c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb990df0640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 -- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 msgr2=0x7fb98c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 -- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 msgr2=0x7fb98c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 0x7fb98c0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 -- 172.21.15.80:0/2120360844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c15cfa0 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb991df2640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 0x7fb98c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb9915f1640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb98002b930 tx=0x7fb9800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980040070 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98003e070 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c15d280 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980035040 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.709+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c15d840 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.710+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c068a40 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.711+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb980038020 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.711+0000 7fb97dffb640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 0x7fb97006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.711+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb9800ad940 con 0x7fb98c0d1450 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.711+0000 7fb990df0640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 0x7fb97006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:11.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.712+0000 7fb990df0640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 0x7fb97006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ce9a0 tx=0x7fb988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:11.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.716+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb98007b9a0 con 0x7fb98c0d1450 2024-04-16T15:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.929+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb98c0d2920 con 0x7fb98c0d1450 2024-04-16T15:36:11.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.930+0000 7fb97dffb640 1 -- 172.21.15.80:0/2120360844 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fb98007b2a0 con 0x7fb98c0d1450 2024-04-16T15:36:11.928 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:11.929 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:11.929 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 msgr2=0x7fb97006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 0x7fb97006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ce9a0 tx=0x7fb988008040 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 msgr2=0x7fb98c0d3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb98002b930 tx=0x7fb9800046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 shutdown_connections 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb98c163350 0x7fb98c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb97006c920 0x7fb97006ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb98c15ef80 0x7fb98c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 --2- 172.21.15.80:0/2120360844 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb98c0d1450 0x7fb98c0d3af0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 >> 172.21.15.80:0/2120360844 conn(0x7fb98c06ce20 msgr2=0x7fb98c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 shutdown_connections 2024-04-16T15:36:11.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:11.932+0000 7fb993855640 1 -- 172.21.15.80:0/2120360844 wait complete. 2024-04-16T15:36:11.941 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:12.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.047+0000 7f577b9bd640 1 Processor -- start 2024-04-16T15:36:12.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.047+0000 7f577b9bd640 1 -- start start 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f577b9bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f57740b6030 0x7f57740ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f577b9bd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f57740cea50 0x7f577415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f577b9bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5774161270 con 0x7f577413f7c0 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f577b9bd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f57740a95e0 con 0x7f57740cea50 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f577b9bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5774160de0 con 0x7f57740b6030 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779759640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f577413f7c0 0x7f57740b5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34058/0 (socket says 172.21.15.80:34058) 2024-04-16T15:36:12.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779759640 1 -- 172.21.15.80:0/2406569122 learned_addr learned my addr 172.21.15.80:0/2406569122 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779f5a640 1 --2- 172.21.15.80:0/2406569122 >> v2:172.21.15.80:3300/0 conn(0x7f57740cea50 0x7f577415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5778f58640 1 --2- 172.21.15.80:0/2406569122 >> v2:172.21.15.87:3300/0 conn(0x7f57740b6030 0x7f57740ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f576bfff640 1 -- 172.21.15.80:0/2406569122 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371730246 0 0) 0x7f5774161270 con 0x7f577413f7c0 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f576bfff640 1 -- 172.21.15.80:0/2406569122 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5760003520 con 0x7f577413f7c0 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779f5a640 1 -- 172.21.15.80:0/2406569122 >> v2:172.21.15.87:3300/0 conn(0x7f57740b6030 msgr2=0x7f57740ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779f5a640 1 --2- 172.21.15.80:0/2406569122 >> v2:172.21.15.87:3300/0 conn(0x7f57740b6030 0x7f57740ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779f5a640 1 -- 172.21.15.80:0/2406569122 >> v1:172.21.15.80:6789/0 conn(0x7f577413f7c0 legacy=0x7f57740b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.048+0000 7f5779f5a640 1 -- 172.21.15.80:0/2406569122 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577413fe10 con 0x7f57740cea50 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.049+0000 7f5779f5a640 1 --2- 172.21.15.80:0/2406569122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577415ccd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5774073160 tx=0x7f576c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837988c3b21fe56a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.049+0000 7f576bfff640 1 -- 172.21.15.80:0/2406569122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c034070 con 0x7f57740cea50 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.049+0000 7f576bfff640 1 -- 172.21.15.80:0/2406569122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c030610 con 0x7f57740cea50 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.049+0000 7f576bfff640 1 -- 172.21.15.80:0/2406569122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0309e0 con 0x7f57740cea50 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 -- 172.21.15.80:0/2406569122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 msgr2=0x7f577415ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 --2- 172.21.15.80:0/2406569122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577415ccd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5774073160 tx=0x7f576c02b960 comp rx=0 tx=0).stop 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 -- 172.21.15.80:0/2406569122 shutdown_connections 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 --2- 172.21.15.80:0/2406569122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577415ccd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.052 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 --2- 172.21.15.80:0/2406569122 >> v2:172.21.15.87:3300/0 conn(0x7f57740b6030 0x7f57740ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 -- 172.21.15.80:0/2406569122 >> 172.21.15.80:0/2406569122 conn(0x7f57740b2940 msgr2=0x7f577406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 -- 172.21.15.80:0/2406569122 shutdown_connections 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.050+0000 7f577b9bd640 1 -- 172.21.15.80:0/2406569122 wait complete. 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.051+0000 7f577b9bd640 1 Processor -- start 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.051+0000 7f577b9bd640 1 -- start start 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 0x7f57741f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f577413f7c0 0x7f5774155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5774160790 con 0x7f57740cea50 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f57741604b0 con 0x7f57740b6030 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f577b9bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f5774160a70 con 0x7f577413f7c0 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35184/0 (socket says 172.21.15.80:35184) 2024-04-16T15:36:12.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 -- 172.21.15.80:0/3176876498 learned_addr learned my addr 172.21.15.80:0/3176876498 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5779759640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 0x7f57741f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5779f5a640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f577413f7c0 0x7f5774155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 -- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f577413f7c0 msgr2=0x7f5774155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f577413f7c0 0x7f5774155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 -- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 msgr2=0x7f57741f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 0x7f57741f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 -- 172.21.15.80:0/3176876498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57741f60a0 con 0x7f57740cea50 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5779759640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 0x7f57741f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5778f58640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f576400d830 tx=0x7f576400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.052+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576400b6c0 con 0x7f57740cea50 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.053+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5764019070 con 0x7f57740cea50 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.053+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57741f6380 con 0x7f57740cea50 2024-04-16T15:36:12.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.053+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576400ba80 con 0x7f57740cea50 2024-04-16T15:36:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.053+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57741f6940 con 0x7f57740cea50 2024-04-16T15:36:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.054+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5774072fd0 con 0x7f57740cea50 2024-04-16T15:36:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.054+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f576401e460 con 0x7f57740cea50 2024-04-16T15:36:12.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.055+0000 7f5769ffb640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 0x7f575806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.055+0000 7f5779759640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 0x7f575806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.055+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f576408c4d0 con 0x7f57740cea50 2024-04-16T15:36:12.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.055+0000 7f5779759640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 0x7f575806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5770005c00 tx=0x7f5770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.059+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5774072fd0 con 0x7f57740cea50 2024-04-16T15:36:12.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.236+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5774068a40 con 0x7f57740cea50 2024-04-16T15:36:12.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.237+0000 7f5769ffb640 1 -- 172.21.15.80:0/3176876498 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f576405a650 con 0x7f57740cea50 2024-04-16T15:36:12.236 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:12.236 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 msgr2=0x7f575806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 0x7f575806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5770005c00 tx=0x7f5770009040 comp rx=0 tx=0).stop 2024-04-16T15:36:12.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 msgr2=0x7f577413ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f576400d830 tx=0x7f576400dcf0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 shutdown_connections 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f575806c8f0 0x7f575806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f577413f7c0 0x7f5774155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f57740cea50 0x7f577413ec00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.239+0000 7f577b9bd640 1 --2- 172.21.15.80:0/3176876498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57740b6030 0x7f57741f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.240+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 >> 172.21.15.80:0/3176876498 conn(0x7f57740b2940 msgr2=0x7f57740b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.240+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 shutdown_connections 2024-04-16T15:36:12.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.240+0000 7f577b9bd640 1 -- 172.21.15.80:0/3176876498 wait complete. 2024-04-16T15:36:12.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:12.249 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:12.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.356+0000 7f90f19db640 1 Processor -- start 2024-04-16T15:36:12.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.356+0000 7f90f19db640 1 -- start start 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90f19db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90ec09b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90f19db640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec0cdd10 con 0x7f90ec0d0120 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90f19db640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec0cdff0 con 0x7f90ec09b180 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90f19db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec0ce2d0 con 0x7f90ec15fee0 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90ea7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f90ec0d0120 0x7f90ec09aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34070/0 (socket says 172.21.15.80:34070) 2024-04-16T15:36:12.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90ea7fc640 1 -- 172.21.15.80:0/3745650702 learned_addr learned my addr 172.21.15.80:0/3745650702 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.357+0000 7f90eaffd640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90ec09b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623004551 0 0) 0x7f90ec0cdd10 con 0x7f90ec0d0120 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d4003520 con 0x7f90ec0d0120 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107457555 0 0) 0x7f90d4003520 con 0x7f90ec0d0120 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 msgr2=0x7f90ec09b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90ec09b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 >> v1:172.21.15.87:6789/0 conn(0x7f90ec09b180 legacy=0x7f90ec0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec09bc00 con 0x7f90ec0d0120 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f90e0001670 con 0x7f90ec0d0120 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 >> v1:172.21.15.80:6789/0 conn(0x7f90ec0d0120 legacy=0x7f90ec09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d40039e0 0x7f90d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.359 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0ce2d0 con 0x7f90d4004d40 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90d400b9c0 con 0x7f90d40039e0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f90d400bbc0 con 0x7f90ec15fee0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eaffd640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d40039e0 0x7f90d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90ea7fc640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 -- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 msgr2=0x7f90d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec15fee0 0x7f90d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 -- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d40039e0 msgr2=0x7f90d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90d40039e0 0x7f90d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.358+0000 7f90eb7fe640 1 -- 172.21.15.80:0/3745650702 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d4003520 con 0x7f90d4004d40 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.359+0000 7f90eb7fe640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90d40051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90ec074620 tx=0x7f90d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f02e2c8d0ed3dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.359+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4038070 con 0x7f90d4004d40 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.359+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e4033630 con 0x7f90d4004d40 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.359+0000 7f90e9ffb640 1 -- 172.21.15.80:0/3745650702 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e402f050 con 0x7f90d4004d40 2024-04-16T15:36:12.360 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 -- 172.21.15.80:0/3745650702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 msgr2=0x7f90d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 --2- 172.21.15.80:0/3745650702 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90d40051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90ec074620 tx=0x7f90d4005830 comp rx=0 tx=0).stop 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90eb7fe640 1 -- 172.21.15.80:0/3745650702 reap_dead start 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 -- 172.21.15.80:0/3745650702 shutdown_connections 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 -- 172.21.15.80:0/3745650702 >> 172.21.15.80:0/3745650702 conn(0x7f90ec0b4040 msgr2=0x7f90ec0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 -- 172.21.15.80:0/3745650702 shutdown_connections 2024-04-16T15:36:12.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.360+0000 7f90f19db640 1 -- 172.21.15.80:0/3745650702 wait complete. 2024-04-16T15:36:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.361+0000 7f90f19db640 1 Processor -- start 2024-04-16T15:36:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.361+0000 7f90f19db640 1 -- start start 2024-04-16T15:36:12.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec06d6c0 0x7f90ec06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb5a0 0x7f90ec0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec09b8d0 con 0x7f90d4004d40 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec09bdd0 con 0x7f90ec06d6c0 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec09ba50 con 0x7f90ec0cb5a0 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35198/0 (socket says 172.21.15.80:35198) 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 -- 172.21.15.80:0/912846409 learned_addr learned my addr 172.21.15.80:0/912846409 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90ea7fc640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec06d6c0 0x7f90ec06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 -- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb5a0 msgr2=0x7f90ec0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb5a0 0x7f90ec0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 -- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec06d6c0 msgr2=0x7f90ec06db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec06d6c0 0x7f90ec06db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 -- 172.21.15.80:0/912846409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec0c9750 con 0x7f90d4004d40 2024-04-16T15:36:12.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90eaffd640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90dc011e60 tx=0x7f90dc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc015630 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90dc0157d0 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec0c9a30 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.362+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc015ba0 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.363+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec0c9ff0 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.363+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec15f790 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.364+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90dc01d400 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.364+0000 7f90d3fff640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 0x7f90d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.364+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f90dc08cf80 con 0x7f90d4004d40 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.364+0000 7f90ea7fc640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 0x7f90d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.365+0000 7f90ea7fc640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 0x7f90d806ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0c4ea0 tx=0x7f90e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.369+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f90ec15f790 con 0x7f90d4004d40 2024-04-16T15:36:12.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.544+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90ec069150 con 0x7f90d4004d40 2024-04-16T15:36:12.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.544+0000 7f90d3fff640 1 -- 172.21.15.80:0/912846409 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f90dc019030 con 0x7f90d4004d40 2024-04-16T15:36:12.543 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 msgr2=0x7f90d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 0x7f90d806ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0c4ea0 tx=0x7f90e0009040 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 msgr2=0x7f90ec0b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90dc011e60 tx=0x7f90dc00f580 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 shutdown_connections 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f90d806c920 0x7f90d806ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f90ec0cb5a0 0x7f90ec0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90ec06d6c0 0x7f90ec06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 --2- 172.21.15.80:0/912846409 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f90d4004d40 0x7f90ec0b63e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.546+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 >> 172.21.15.80:0/912846409 conn(0x7f90ec0b4040 msgr2=0x7f90ec15cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.547+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 shutdown_connections 2024-04-16T15:36:12.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.547+0000 7f90f19db640 1 -- 172.21.15.80:0/912846409 wait complete. 2024-04-16T15:36:12.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:12.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.663+0000 7f01ffba8640 1 Processor -- start 2024-04-16T15:36:12.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.663+0000 7f01ffba8640 1 -- start start 2024-04-16T15:36:12.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01ffba8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f8145020 0x7f01f806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01ffba8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01f80cd9f0 0x7f01f815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01ffba8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f815bd50 con 0x7f01f806f480 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01ffba8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f01f815c030 con 0x7f01f80cd9f0 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01ffba8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f01f815c310 con 0x7f01f8145020 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fe145640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f01f80cd9f0 0x7f01f815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fd143640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f01f806f480 0x7f01f80cd2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34078/0 (socket says 172.21.15.80:34078) 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fd143640 1 -- 172.21.15.80:0/1932408429 learned_addr learned my addr 172.21.15.80:0/1932408429 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fd944640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f8145020 0x7f01f806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fe145640 1 -- 172.21.15.80:0/1932408429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f8145020 msgr2=0x7f01f806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fe145640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f8145020 0x7f01f806ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fe145640 1 -- 172.21.15.80:0/1932408429 >> v1:172.21.15.80:6789/0 conn(0x7f01f806f480 legacy=0x7f01f80cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fe145640 1 -- 172.21.15.80:0/1932408429 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f815c5f0 con 0x7f01f80cd9f0 2024-04-16T15:36:12.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.664+0000 7f01fc942640 1 -- 172.21.15.80:0/1932408429 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645710828 0 0) 0x7f01f815bd50 con 0x7f01f806f480 2024-04-16T15:36:12.664 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01fe145640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f80cd9f0 0x7f01f815f230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae273c5e6b6961f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01fc942640 1 -- 172.21.15.80:0/1932408429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0039070 con 0x7f01f80cd9f0 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01fc942640 1 -- 172.21.15.80:0/1932408429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f002cc50 con 0x7f01f80cd9f0 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01fc942640 1 -- 172.21.15.80:0/1932408429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0034440 con 0x7f01f80cd9f0 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01ffba8640 1 -- 172.21.15.80:0/1932408429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f80cd9f0 msgr2=0x7f01f815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.665+0000 7f01ffba8640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f80cd9f0 0x7f01f815f230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f002bea0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 -- 172.21.15.80:0/1932408429 shutdown_connections 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f80cd9f0 0x7f01f815f230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 --2- 172.21.15.80:0/1932408429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f8145020 0x7f01f806ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 -- 172.21.15.80:0/1932408429 >> 172.21.15.80:0/1932408429 conn(0x7f01f8067d90 msgr2=0x7f01f806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 -- 172.21.15.80:0/1932408429 shutdown_connections 2024-04-16T15:36:12.665 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.666+0000 7f01ffba8640 1 -- 172.21.15.80:0/1932408429 wait complete. 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.667+0000 7f01ffba8640 1 Processor -- start 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.667+0000 7f01ffba8640 1 -- start start 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f80cd9f0 0x7f01f815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 0x7f01f8159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01f815f8f0 con 0x7f01f806f480 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01f815f770 con 0x7f01f8145020 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f01f815fa70 con 0x7f01f80cd9f0 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35208/0 (socket says 172.21.15.80:35208) 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 -- 172.21.15.80:0/2304917957 learned_addr learned my addr 172.21.15.80:0/2304917957 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd143640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f80cd9f0 0x7f01f815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.668 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fe145640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 0x7f01f8159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 -- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f80cd9f0 msgr2=0x7f01f815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f80cd9f0 0x7f01f815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 -- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 msgr2=0x7f01f8159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 0x7f01f8159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 -- 172.21.15.80:0/2304917957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f815ba60 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fe145640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 0x7f01f8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01fd944640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d5f0 tx=0x7f01f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40125f0 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4019070 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40129d0 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f815e540 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.668+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f815da60 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.669+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f8068a40 con 0x7f01f806f480 2024-04-16T15:36:12.669 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.670+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01f4012b70 con 0x7f01f806f480 2024-04-16T15:36:12.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.670+0000 7f01ea7fc640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 0x7f01dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.670+0000 7f01fd143640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 0x7f01dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.670+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f01f408c1f0 con 0x7f01f806f480 2024-04-16T15:36:12.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.670+0000 7f01fd143640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 0x7f01dc06ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01f81f5ac0 tx=0x7f01ec007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.674+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01f405a2e0 con 0x7f01f806f480 2024-04-16T15:36:12.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.848+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f01f80cfab0 con 0x7f01f806f480 2024-04-16T15:36:12.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.848+0000 7f01ea7fc640 1 -- 172.21.15.80:0/2304917957 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f01f4059be0 con 0x7f01f806f480 2024-04-16T15:36:12.847 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 msgr2=0x7f01dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 0x7f01dc06ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01f81f5ac0 tx=0x7f01ec007d50 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 msgr2=0x7f01f8157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d5f0 tx=0x7f01f400dab0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 shutdown_connections 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f01f8145020 0x7f01f8159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f01dc06c920 0x7f01dc06ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f01f80cd9f0 0x7f01f815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 --2- 172.21.15.80:0/2304917957 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f01f806f480 0x7f01f8157570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 >> 172.21.15.80:0/2304917957 conn(0x7f01f8067d90 msgr2=0x7f01f80b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 shutdown_connections 2024-04-16T15:36:12.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.850+0000 7f01ffba8640 1 -- 172.21.15.80:0/2304917957 wait complete. 2024-04-16T15:36:12.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:12.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.967+0000 7fef9ee4a640 1 Processor -- start 2024-04-16T15:36:12.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.967+0000 7fef9ee4a640 1 -- start start 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9ee4a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef9815ccf0 0x7fef98071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9ee4a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef980726f0 con 0x7fef98145ea0 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9cbe6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef98145ea0 0x7fef981601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34086/0 (socket says 172.21.15.80:34086) 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9cbe6640 1 -- 172.21.15.80:0/3650931724 learned_addr learned my addr 172.21.15.80:0/3650931724 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef98161120 con 0x7fef98072310 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fef98160900 con 0x7fef9815ccf0 2024-04-16T15:36:12.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8ffff640 1 --2- 172.21.15.80:0/3650931724 >> v2:172.21.15.87:3300/0 conn(0x7fef9815ccf0 0x7fef98071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471216523 0 0) 0x7fef980726f0 con 0x7fef98145ea0 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef80003520 con 0x7fef98145ea0 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887843331 0 0) 0x7fef98161120 con 0x7fef98072310 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef980726f0 con 0x7fef98072310 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8ffff640 1 -- 172.21.15.80:0/3650931724 >> v1:172.21.15.87:6789/0 conn(0x7fef98072310 legacy=0x7fef9815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8ffff640 1 -- 172.21.15.80:0/3650931724 >> v1:172.21.15.80:6789/0 conn(0x7fef98145ea0 legacy=0x7fef981601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.968+0000 7fef8ffff640 1 -- 172.21.15.80:0/3650931724 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef98160b60 con 0x7fef9815ccf0 2024-04-16T15:36:12.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.969+0000 7fef8ffff640 1 --2- 172.21.15.80:0/3650931724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef98071dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef880097a0 tx=0x7fef8802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43054baa95416a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.969+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88035020 con 0x7fef9815ccf0 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.969+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef88031830 con 0x7fef9815ccf0 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.969+0000 7fef8f7fe640 1 -- 172.21.15.80:0/3650931724 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88031c00 con 0x7fef9815ccf0 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 msgr2=0x7fef98071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/3650931724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef98071dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef880097a0 tx=0x7fef8802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 shutdown_connections 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/3650931724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef98071dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 >> 172.21.15.80:0/3650931724 conn(0x7fef98067d90 msgr2=0x7fef9806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:12.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 shutdown_connections 2024-04-16T15:36:12.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.970+0000 7fef9ee4a640 1 -- 172.21.15.80:0/3650931724 wait complete. 2024-04-16T15:36:12.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.971+0000 7fef9ee4a640 1 Processor -- start 2024-04-16T15:36:12.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.971+0000 7fef9ee4a640 1 -- start start 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef98145ea0 0x7fef9815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef9815af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef98146280 con 0x7fef98072310 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef9815de60 con 0x7fef9815ccf0 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9ee4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fef9815ed70 con 0x7fef98145ea0 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35222/0 (socket says 172.21.15.80:35222) 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 -- 172.21.15.80:0/721234255 learned_addr learned my addr 172.21.15.80:0/721234255 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef8ffff640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef98145ea0 0x7fef9815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9d3e7640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef9815af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 -- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef98145ea0 msgr2=0x7fef9815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef98145ea0 0x7fef9815a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 -- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 msgr2=0x7fef9815af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef9815af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9cbe6640 1 -- 172.21.15.80:0/721234255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9815acf0 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.972+0000 7fef9d3e7640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef9815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef9cbe6640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef9400cbc0 tx=0x7fef9400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94017070 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9400ad40 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94012600 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef980b3bf0 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.973+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef980b41b0 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.974+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef98068a40 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.974+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef9401a070 con 0x7fef98072310 2024-04-16T15:36:12.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.975+0000 7fef8d7fa640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 0x7fef8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.975+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef9408bb70 con 0x7fef98072310 2024-04-16T15:36:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.975+0000 7fef8ffff640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 0x7fef8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:12.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.975+0000 7fef8ffff640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 0x7fef8406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef88036000 tx=0x7fef8803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:12.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:12.979+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef940596a0 con 0x7fef98072310 2024-04-16T15:36:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.155+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fef98072e80 con 0x7fef98072310 2024-04-16T15:36:13.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.156+0000 7fef8d7fa640 1 -- 172.21.15.80:0/721234255 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fef9405d9a0 con 0x7fef98072310 2024-04-16T15:36:13.155 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 msgr2=0x7fef8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 0x7fef8406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef88036000 tx=0x7fef8803c040 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 msgr2=0x7fef980b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef9400cbc0 tx=0x7fef9400a430 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 shutdown_connections 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef9815ccf0 0x7fef9815af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef8406c8f0 0x7fef8406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef98145ea0 0x7fef9815a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 --2- 172.21.15.80:0/721234255 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef98072310 0x7fef980b3610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 >> 172.21.15.80:0/721234255 conn(0x7fef98067d90 msgr2=0x7fef98143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 shutdown_connections 2024-04-16T15:36:13.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.158+0000 7fef9ee4a640 1 -- 172.21.15.80:0/721234255 wait complete. 2024-04-16T15:36:13.168 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:13.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.276+0000 7f03365db640 1 Processor -- start 2024-04-16T15:36:13.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.276+0000 7f03365db640 1 -- start start 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f03365db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03300b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f03365db640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03300d1a20 0x7f03300cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f03365db640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0330163560 con 0x7f033015ed30 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f03365db640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f03300b8090 con 0x7f03300d1a20 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f03365db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0330162fa0 con 0x7f033015e950 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f033015ed30 0x7f0330162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34096/0 (socket says 172.21.15.80:34096) 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032f7fe640 1 -- 172.21.15.80:0/1877563333 learned_addr learned my addr 172.21.15.80:0/1877563333 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032ffff640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03300b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f0334b78640 1 --2- 172.21.15.80:0/1877563333 >> v2:172.21.15.87:3300/0 conn(0x7f03300d1a20 0x7f03300cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736244571 0 0) 0x7f0330163560 con 0x7f033015ed30 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0318003520 con 0x7f033015ed30 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452115409 0 0) 0x7f0318003520 con 0x7f033015ed30 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 msgr2=0x7f03300b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03300b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 >> v2:172.21.15.87:3300/0 conn(0x7f03300d1a20 msgr2=0x7f03300cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 --2- 172.21.15.80:0/1877563333 >> v2:172.21.15.87:3300/0 conn(0x7f03300d1a20 0x7f03300cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0330163280 con 0x7f033015ed30 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f0324001670 con 0x7f033015ed30 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 >> v1:172.21.15.80:6789/0 conn(0x7f033015ed30 legacy=0x7f0330162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0318003f30 0x7f0318004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0318004d40 0x7f03180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03300b8090 con 0x7f0318004d40 2024-04-16T15:36:13.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0330162fa0 con 0x7f0318003f30 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.277+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f031800b9c0 con 0x7f033015e950 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0318004d40 0x7f03180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f032ffff640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f032f7fe640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0318003f30 0x7f0318004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 -- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 msgr2=0x7f03180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f033015e950 0x7f03180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 -- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0318003f30 msgr2=0x7f0318004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0318003f30 0x7f0318004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 -- 172.21.15.80:0/1877563333 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0318003520 con 0x7f0318004d40 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.278+0000 7f0334b78640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0318004d40 0x7f03180051c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0328009f90 tx=0x7f0318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb19746b5c2e5e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328039070 con 0x7f0318004d40 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032802cc00 con 0x7f0318004d40 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f032effd640 1 -- 172.21.15.80:0/1877563333 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328009c10 con 0x7f0318004d40 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 -- 172.21.15.80:0/1877563333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0318004d40 msgr2=0x7f03180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 --2- 172.21.15.80:0/1877563333 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0318004d40 0x7f03180051c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0328009f90 tx=0x7f0318005830 comp rx=0 tx=0).stop 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f0334b78640 1 -- 172.21.15.80:0/1877563333 reap_dead start 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 -- 172.21.15.80:0/1877563333 shutdown_connections 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 -- 172.21.15.80:0/1877563333 >> 172.21.15.80:0/1877563333 conn(0x7f03300b6430 msgr2=0x7f03300b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 -- 172.21.15.80:0/1877563333 shutdown_connections 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.279+0000 7f03365db640 1 -- 172.21.15.80:0/1877563333 wait complete. 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.280+0000 7f03365db640 1 Processor -- start 2024-04-16T15:36:13.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 -- start start 2024-04-16T15:36:13.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0318004d40 0x7f03300cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 0x7f03301538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f03300b7b50 con 0x7f0330154d70 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f03300d2bc0 con 0x7f033015b950 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f03365db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f03300b7cd0 con 0x7f0318004d40 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f032f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f032f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35236/0 (socket says 172.21.15.80:35236) 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.281+0000 7f032f7fe640 1 -- 172.21.15.80:0/2846032552 learned_addr learned my addr 172.21.15.80:0/2846032552 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032ffff640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0318004d40 0x7f03300cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f0334b78640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 0x7f03301538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 -- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0318004d40 msgr2=0x7f03300cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0318004d40 0x7f03300cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 -- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 msgr2=0x7f03301538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 0x7f03301538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 -- 172.21.15.80:0/2846032552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0330155950 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f0334b78640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 0x7f03301538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032f7fe640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0324007340 tx=0x7f0324007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400f8e0 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0324018070 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400fce0 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0330155c30 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.282+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03301561f0 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.283+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033015bd60 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.283+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f032401d460 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.284+0000 7f032cff9640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 0x7f031c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.284+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f032408c020 con 0x7f0330154d70 2024-04-16T15:36:13.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.284+0000 7f032ffff640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 0x7f031c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.284+0000 7f032ffff640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 0x7f031c06ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0320009b00 tx=0x7f0320008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.288+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f033015bd60 con 0x7f0330154d70 2024-04-16T15:36:13.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.462+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f03300d2620 con 0x7f0330154d70 2024-04-16T15:36:13.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.462+0000 7f032cff9640 1 -- 172.21.15.80:0/2846032552 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f032405a080 con 0x7f0330154d70 2024-04-16T15:36:13.461 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 msgr2=0x7f031c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 0x7f031c06ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0320009b00 tx=0x7f0320008040 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 msgr2=0x7f033015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0324007340 tx=0x7f0324007800 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 shutdown_connections 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f033015b950 0x7f03301538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0330154d70 0x7f033015b410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f031c06c920 0x7f031c06ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 --2- 172.21.15.80:0/2846032552 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0318004d40 0x7f03300cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 >> 172.21.15.80:0/2846032552 conn(0x7f03300b6430 msgr2=0x7f033015c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 shutdown_connections 2024-04-16T15:36:13.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.464+0000 7f03365db640 1 -- 172.21.15.80:0/2846032552 wait complete. 2024-04-16T15:36:13.474 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:13.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.579+0000 7f55a7574640 1 Processor -- start 2024-04-16T15:36:13.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.579+0000 7f55a7574640 1 -- start start 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a7574640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55a015ecc0 0x7f55a00b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a7574640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f55a00b4d80 0x7f55a00b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a7574640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a00b3960 con 0x7f55a00b2580 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a7574640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f55a009be20 con 0x7f55a00b4d80 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a7574640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55a00b2990 con 0x7f55a015ecc0 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a4b0f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f55a00b4d80 0x7f55a00b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a5b11640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55a00b2580 0x7f55a00d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34106/0 (socket says 172.21.15.80:34106) 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a5b11640 1 -- 172.21.15.80:0/195128437 learned_addr learned my addr 172.21.15.80:0/195128437 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.580+0000 7f55a5310640 1 --2- 172.21.15.80:0/195128437 >> v2:172.21.15.87:3300/0 conn(0x7f55a015ecc0 0x7f55a00b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f55a4b0f640 1 -- 172.21.15.80:0/195128437 >> v2:172.21.15.87:3300/0 conn(0x7f55a015ecc0 msgr2=0x7f55a00b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/195128437 >> v2:172.21.15.87:3300/0 conn(0x7f55a015ecc0 0x7f55a00b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f55a4b0f640 1 -- 172.21.15.80:0/195128437 >> v1:172.21.15.80:6789/0 conn(0x7f55a00b2580 legacy=0x7f55a00d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f55a4b0f640 1 -- 172.21.15.80:0/195128437 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a00b3c00 con 0x7f55a00b4d80 2024-04-16T15:36:13.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f5597fff640 1 -- 172.21.15.80:0/195128437 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206317766 0 0) 0x7f55a00b3960 con 0x7f55a00b2580 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/195128437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b4d80 0x7f55a00b2040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f55a0073540 tx=0x7f559002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47893a27666e55e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f5597fff640 1 -- 172.21.15.80:0/195128437 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590034070 con 0x7f55a00b4d80 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f5597fff640 1 -- 172.21.15.80:0/195128437 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5590030610 con 0x7f55a00b4d80 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.581+0000 7f5597fff640 1 -- 172.21.15.80:0/195128437 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900309e0 con 0x7f55a00b4d80 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 -- 172.21.15.80:0/195128437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b4d80 msgr2=0x7f55a00b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 --2- 172.21.15.80:0/195128437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b4d80 0x7f55a00b2040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f55a0073540 tx=0x7f559002b960 comp rx=0 tx=0).stop 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 -- 172.21.15.80:0/195128437 shutdown_connections 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 --2- 172.21.15.80:0/195128437 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b4d80 0x7f55a00b2040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 --2- 172.21.15.80:0/195128437 >> v2:172.21.15.87:3300/0 conn(0x7f55a015ecc0 0x7f55a00b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 -- 172.21.15.80:0/195128437 >> 172.21.15.80:0/195128437 conn(0x7f55a00b4030 msgr2=0x7f55a00b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 -- 172.21.15.80:0/195128437 shutdown_connections 2024-04-16T15:36:13.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.582+0000 7f55a7574640 1 -- 172.21.15.80:0/195128437 wait complete. 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.583+0000 7f55a7574640 1 Processor -- start 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.583+0000 7f55a7574640 1 -- start start 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 0x7f55a01f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 0x7f55a00b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55a015f0a0 con 0x7f55a00b2580 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55a009b900 con 0x7f55a00b4d80 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a7574640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f55a006e080 con 0x7f55a015ecc0 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35252/0 (socket says 172.21.15.80:35252) 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 -- 172.21.15.80:0/3620505080 learned_addr learned my addr 172.21.15.80:0/3620505080 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:13.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5b11640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 0x7f55a00b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 0x7f55a01f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 -- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 msgr2=0x7f55a00b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 0x7f55a00b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 -- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 msgr2=0x7f55a01f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 0x7f55a01f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 -- 172.21.15.80:0/3620505080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a00b7ac0 con 0x7f55a00b2580 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 0x7f55a01f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5b11640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 0x7f55a00b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.584+0000 7f55a5310640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e870 tx=0x7f559c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.585+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c017070 con 0x7f55a00b2580 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.585+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c00c940 con 0x7f55a00b2580 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.585+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a00b7da0 con 0x7f55a00b2580 2024-04-16T15:36:13.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.585+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00cd30 con 0x7f55a00b2580 2024-04-16T15:36:13.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.585+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a009eaf0 con 0x7f55a00b2580 2024-04-16T15:36:13.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.586+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a00b7f70 con 0x7f55a00b2580 2024-04-16T15:36:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.586+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f559c01a070 con 0x7f55a00b2580 2024-04-16T15:36:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.586+0000 7f5595ffb640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 0x7f558406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.587+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f559c08c0f0 con 0x7f55a00b2580 2024-04-16T15:36:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.587+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 0x7f558406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.587+0000 7f55a4b0f640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 0x7f558406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5590036000 tx=0x7f559003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.591+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f559c05a1e0 con 0x7f55a00b2580 2024-04-16T15:36:13.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.802+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55a0068a40 con 0x7f55a00b2580 2024-04-16T15:36:13.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.803+0000 7f5595ffb640 1 -- 172.21.15.80:0/3620505080 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f559c059ae0 con 0x7f55a00b2580 2024-04-16T15:36:13.801 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:13.801 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:13.802 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:13.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 msgr2=0x7f558406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 0x7f558406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5590036000 tx=0x7f559003b040 comp rx=0 tx=0).stop 2024-04-16T15:36:13.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 msgr2=0x7f55a01f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e870 tx=0x7f559c00ed30 comp rx=0 tx=0).stop 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 shutdown_connections 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f558406c8f0 0x7f558406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55a015ecc0 0x7f55a00b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55a00b4d80 0x7f55a01f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 --2- 172.21.15.80:0/3620505080 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55a00b2580 0x7f55a01f79b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 >> 172.21.15.80:0/3620505080 conn(0x7f55a00b4030 msgr2=0x7f55a006e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 shutdown_connections 2024-04-16T15:36:13.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.805+0000 7f55a7574640 1 -- 172.21.15.80:0/3620505080 wait complete. 2024-04-16T15:36:13.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.918+0000 7f6d34d59640 1 Processor -- start 2024-04-16T15:36:13.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.918+0000 7f6d34d59640 1 -- start start 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d34d59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 0x7f6d3015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d34d59640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3015ef80 0x7f6d300cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d34d59640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d300cfeb0 con 0x7f6d30163350 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d34d59640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6d30162900 con 0x7f6d3015ef80 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d34d59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d30162ec0 con 0x7f6d300d1450 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d2dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3015ef80 0x7f6d300cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d2dd9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6d3015ef80 0x7f6d300cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35262/0 (socket says 172.21.15.80:35262) 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.919+0000 7f6d2dd9b640 1 -- 172.21.15.80:0/569370545 learned_addr learned my addr 172.21.15.80:0/569370545 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2e59c640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 0x7f6d3015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2dd9b640 1 -- 172.21.15.80:0/569370545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 msgr2=0x7f6d3015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:13.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2dd9b640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 0x7f6d3015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2dd9b640 1 -- 172.21.15.80:0/569370545 >> v1:172.21.15.87:6789/0 conn(0x7f6d30163350 legacy=0x7f6d300d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2dd9b640 1 -- 172.21.15.80:0/569370545 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d300d0190 con 0x7f6d3015ef80 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2e59c640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 0x7f6d3015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.920+0000 7f6d2dd9b640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3015ef80 0x7f6d300cf780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d712198eee52fd6f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d2d59a640 1 -- 172.21.15.80:0/569370545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24035020 con 0x7f6d3015ef80 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d2d59a640 1 -- 172.21.15.80:0/569370545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24031640 con 0x7f6d3015ef80 2024-04-16T15:36:13.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d2d59a640 1 -- 172.21.15.80:0/569370545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2402d040 con 0x7f6d3015ef80 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 -- 172.21.15.80:0/569370545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3015ef80 msgr2=0x7f6d300cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3015ef80 0x7f6d300cf780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009870 tx=0x7f6d2402b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 -- 172.21.15.80:0/569370545 shutdown_connections 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d3015ef80 0x7f6d300cf780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 --2- 172.21.15.80:0/569370545 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d300d1450 0x7f6d3015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 -- 172.21.15.80:0/569370545 >> 172.21.15.80:0/569370545 conn(0x7f6d3006ce20 msgr2=0x7f6d3006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:13.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 -- 172.21.15.80:0/569370545 shutdown_connections 2024-04-16T15:36:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.921+0000 7f6d34d59640 1 -- 172.21.15.80:0/569370545 wait complete. 2024-04-16T15:36:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 Processor -- start 2024-04-16T15:36:13.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 -- start start 2024-04-16T15:36:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d300d1450 0x7f6d3015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 0x7f6d301f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d300d2ff0 con 0x7f6d30163350 2024-04-16T15:36:13.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d301637c0 con 0x7f6d300d1450 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d34d59640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d300d3170 con 0x7f6d3015ef80 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.923+0000 7f6d2ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35268/0 (socket says 172.21.15.80:35268) 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 -- 172.21.15.80:0/3418527726 learned_addr learned my addr 172.21.15.80:0/3418527726 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2dd9b640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 0x7f6d301f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2e59c640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d300d1450 0x7f6d3015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 -- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 msgr2=0x7f6d301f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 0x7f6d301f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 -- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d300d1450 msgr2=0x7f6d3015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d300d1450 0x7f6d3015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 -- 172.21.15.80:0/3418527726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3015e230 con 0x7f6d30163350 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2dd9b640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 0x7f6d301f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d2ed9d640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c3c0 tx=0x7f6d2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28017070 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d280052d0 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d300ca940 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28003810 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.924+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3015b3d0 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.925+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d30068a40 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.926+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d2801a070 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.926+0000 7f6d1effd640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.926+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d2808b0c0 con 0x7f6d30163350 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.926+0000 7f6d2e59c640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:13.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.927+0000 7f6d2e59c640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 0x7f6d1006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d3015a880 tx=0x7f6d20003a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:13.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:13.930+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d28059240 con 0x7f6d30163350 2024-04-16T15:36:14.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.105+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d300d2370 con 0x7f6d30163350 2024-04-16T15:36:14.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.106+0000 7f6d1effd640 1 -- 172.21.15.80:0/3418527726 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f6d28058b40 con 0x7f6d30163350 2024-04-16T15:36:14.105 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:14.105 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 msgr2=0x7f6d1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 0x7f6d1006ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d3015a880 tx=0x7f6d20003a10 comp rx=0 tx=0).stop 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 msgr2=0x7f6d300cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c3c0 tx=0x7f6d2800c880 comp rx=0 tx=0).stop 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 shutdown_connections 2024-04-16T15:36:14.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d30163350 0x7f6d300cd230 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d3015ef80 0x7f6d301f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 --2- 172.21.15.80:0/3418527726 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d300d1450 0x7f6d3015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.108+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 >> 172.21.15.80:0/3418527726 conn(0x7f6d3006ce20 msgr2=0x7f6d30161920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.109+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 shutdown_connections 2024-04-16T15:36:14.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.109+0000 7f6d34d59640 1 -- 172.21.15.80:0/3418527726 wait complete. 2024-04-16T15:36:14.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 Processor -- start 2024-04-16T15:36:14.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 -- start start 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f865815e930 0x7f86580cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f86580d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86580d2280 con 0x7f86580d3600 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f86580d3170 con 0x7f865815e930 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.223+0000 7f865ce35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f86580d2560 con 0x7f86580d17d0 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f864ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f86580d3600 0x7f86580d10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:34112/0 (socket says 172.21.15.80:34112) 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f864ffff640 1 -- 172.21.15.80:0/3893269690 learned_addr learned my addr 172.21.15.80:0/3893269690 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8656d9d640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f86580d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f865659c640 1 --2- 172.21.15.80:0/3893269690 >> v2:172.21.15.87:3300/0 conn(0x7f865815e930 0x7f86580cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759124823 0 0) 0x7f86580d2280 con 0x7f86580d3600 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8644003520 con 0x7f86580d3600 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2346656666 0 0) 0x7f8644003520 con 0x7f86580d3600 2024-04-16T15:36:14.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 msgr2=0x7f86580d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f86580d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 >> v2:172.21.15.87:3300/0 conn(0x7f865815e930 msgr2=0x7f86580cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 --2- 172.21.15.80:0/3893269690 >> v2:172.21.15.87:3300/0 conn(0x7f865815e930 0x7f86580cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86580d2840 con 0x7f86580d3600 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f8640001670 con 0x7f86580d3600 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 >> v1:172.21.15.80:6789/0 conn(0x7f86580d3600 legacy=0x7f86580d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f8644003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f8644004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8644004d40 0x7f86440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f86580d3170 con 0x7f8644004d40 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86580d2560 con 0x7f86440039b0 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f864400b9f0 con 0x7f86580d17d0 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f865659c640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f8644003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f8656d9d640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8644004d40 0x7f86440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.224+0000 7f864ffff640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f8644004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 -- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 msgr2=0x7f8644004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86580d17d0 0x7f8644004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 -- 172.21.15.80:0/3893269690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8644004d40 msgr2=0x7f86440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8644004d40 0x7f86440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 -- 172.21.15.80:0/3893269690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8644003520 con 0x7f86440039b0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f8656d9d640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8644004d40 0x7f86440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.225+0000 7f865659c640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f8644003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8648009ac0 tx=0x7f8644005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe74ee9d6415fad server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648039070 con 0x7f86440039b0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864802c710 con 0x7f86440039b0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f8655d9b640 1 -- 172.21.15.80:0/3893269690 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648009690 con 0x7f86440039b0 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 -- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 msgr2=0x7f8644003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 --2- 172.21.15.80:0/3893269690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f8644003dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8648009ac0 tx=0x7f8644005830 comp rx=0 tx=0).stop 2024-04-16T15:36:14.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f8656d9d640 1 -- 172.21.15.80:0/3893269690 reap_dead start 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 -- 172.21.15.80:0/3893269690 shutdown_connections 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 -- 172.21.15.80:0/3893269690 >> 172.21.15.80:0/3893269690 conn(0x7f865808c000 msgr2=0x7f86580d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 -- 172.21.15.80:0/3893269690 shutdown_connections 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.226+0000 7f865ce35640 1 -- 172.21.15.80:0/3893269690 wait complete. 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 Processor -- start 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 -- start start 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f865814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 0x7f86581f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f865815ed10 con 0x7f865809e390 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86580d2e00 con 0x7f86440039b0 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.228+0000 7f865ce35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f86580cd1e0 con 0x7f86581f86e0 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35288/0 (socket says 172.21.15.80:35288) 2024-04-16T15:36:14.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 -- 172.21.15.80:0/2561837587 learned_addr learned my addr 172.21.15.80:0/2561837587 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f865659c640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f865814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f8656d9d640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 0x7f86581f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 -- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 msgr2=0x7f86581f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 0x7f86581f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 -- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 msgr2=0x7f865814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f865814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 -- 172.21.15.80:0/2561837587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86580cd4c0 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f8656d9d640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 0x7f86581f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864ffff640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8640004f70 tx=0x7f86400074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864000f750 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8640018070 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864000fb30 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86580cd7a0 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.229+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86580cdd60 con 0x7f865809e390 2024-04-16T15:36:14.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.230+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86580cdf60 con 0x7f865809e390 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.231+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f864000fcd0 con 0x7f865809e390 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.231+0000 7f864effd640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 0x7f863806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.231+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f864008bd30 con 0x7f865809e390 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.231+0000 7f865659c640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 0x7f863806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.232+0000 7f865659c640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 0x7f863806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8648036000 tx=0x7f8648030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.235+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86580cdf60 con 0x7f865809e390 2024-04-16T15:36:14.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.447+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8658069150 con 0x7f865809e390 2024-04-16T15:36:14.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.447+0000 7f864effd640 1 -- 172.21.15.80:0/2561837587 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f8640059eb0 con 0x7f865809e390 2024-04-16T15:36:14.446 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:14.446 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 msgr2=0x7f863806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 0x7f863806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8648036000 tx=0x7f8648030000 comp rx=0 tx=0).stop 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 msgr2=0x7f86581f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8640004f70 tx=0x7f86400074f0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 shutdown_connections 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f863806c920 0x7f863806ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f86581f86e0 0x7f86581f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f865809e390 0x7f86581f81a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 --2- 172.21.15.80:0/2561837587 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86440039b0 0x7f865814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.449+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 >> 172.21.15.80:0/2561837587 conn(0x7f865808c000 msgr2=0x7f86580b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.450+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 shutdown_connections 2024-04-16T15:36:14.449 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.450+0000 7f865ce35640 1 -- 172.21.15.80:0/2561837587 wait complete. 2024-04-16T15:36:14.862 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T15:35:47.236177+0000', 'modified': '2024-04-16T15:36:03.311946+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2875259766', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6833', 'nonce': 2875259766}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2875259766}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4299, 'qdb_cluster': [4299]} 2024-04-16T15:36:14.862 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T15:36:14.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-16T15:36:14.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.968+0000 7fb7d1cb3640 1 Processor -- start 2024-04-16T15:36:14.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.968+0000 7fb7d1cb3640 1 -- start start 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7d1cb3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 0x7fb7cc0cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7d1cb3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7cc0cd820 0x7fb7cc15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7d1cb3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc15bd50 con 0x7fb7cc145020 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7d1cb3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc15c030 con 0x7fb7cc0cd820 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7d1cb3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc15c310 con 0x7fb7cc06f650 2024-04-16T15:36:14.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7cbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7cc0cd820 0x7fb7cc15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7cbfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb7cc0cd820 0x7fb7cc15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36928/0 (socket says 172.21.15.80:36928) 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7cbfff640 1 -- 172.21.15.80:0/668799711 learned_addr learned my addr 172.21.15.80:0/668799711 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7caffd640 1 --2- 172.21.15.80:0/668799711 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 0x7fb7cc0cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.969+0000 7fb7cbfff640 1 -- 172.21.15.80:0/668799711 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 msgr2=0x7fb7cc0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/668799711 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 0x7fb7cc0cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7cbfff640 1 -- 172.21.15.80:0/668799711 >> v1:172.21.15.87:6789/0 conn(0x7fb7cc145020 legacy=0x7fb7cc06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7cbfff640 1 -- 172.21.15.80:0/668799711 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc15c5f0 con 0x7fb7cc0cd820 2024-04-16T15:36:14.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7caffd640 1 --2- 172.21.15.80:0/668799711 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 0x7fb7cc0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:14.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/668799711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc15f230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc06fc20 tx=0x7fb7c402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9562404c75502063 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7ca7fc640 1 -- 172.21.15.80:0/668799711 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c403b070 con 0x7fb7cc0cd820 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7ca7fc640 1 -- 172.21.15.80:0/668799711 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4036440 con 0x7fb7cc0cd820 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.970+0000 7fb7ca7fc640 1 -- 172.21.15.80:0/668799711 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4036810 con 0x7fb7cc0cd820 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/668799711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 msgr2=0x7fb7cc15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/668799711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc15f230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc06fc20 tx=0x7fb7c402e0e0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/668799711 shutdown_connections 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/668799711 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc15f230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/668799711 >> v2:172.21.15.87:3300/0 conn(0x7fb7cc06f650 0x7fb7cc0cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/668799711 >> 172.21.15.80:0/668799711 conn(0x7fb7cc067d90 msgr2=0x7fb7cc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/668799711 shutdown_connections 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.971+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/668799711 wait complete. 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.972+0000 7fb7d1cb3640 1 Processor -- start 2024-04-16T15:36:14.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.972+0000 7fb7d1cb3640 1 -- start start 2024-04-16T15:36:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc06f650 0x7fb7cc15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc145020 0x7fb7cc1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b3f90 con 0x7fb7cc0cd820 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b3e10 con 0x7fb7cc06f650 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7d1cb3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc15f770 con 0x7fb7cc145020 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36942/0 (socket says 172.21.15.80:36942) 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 -- 172.21.15.80:0/1150247224 learned_addr learned my addr 172.21.15.80:0/1150247224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc06f650 0x7fb7cc15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc145020 0x7fb7cc1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 -- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc145020 msgr2=0x7fb7cc1f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc145020 0x7fb7cc1f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 -- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc06f650 msgr2=0x7fb7cc15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc06f650 0x7fb7cc15a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.973+0000 7fb7caffd640 1 -- 172.21.15.80:0/1150247224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc15ccb0 con 0x7fb7cc0cd820 2024-04-16T15:36:14.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c7f0 tx=0x7fb7c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7b3fff640 1 -- 172.21.15.80:0/1150247224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0015070 con 0x7fb7cc0cd820 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7b3fff640 1 -- 172.21.15.80:0/1150247224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0007a30 con 0x7fb7cc0cd820 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc13df80 con 0x7fb7cc0cd820 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7b3fff640 1 -- 172.21.15.80:0/1150247224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0007e00 con 0x7fb7cc0cd820 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.974+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc13e540 con 0x7fb7cc0cd820 2024-04-16T15:36:14.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.975+0000 7fb7b3fff640 1 -- 172.21.15.80:0/1150247224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7c0018070 con 0x7fb7cc0cd820 2024-04-16T15:36:14.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.976+0000 7fb7b3fff640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 0x7fb7b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.976+0000 7fb7b3fff640 1 -- 172.21.15.80:0/1150247224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7c008bd30 con 0x7fb7cc0cd820 2024-04-16T15:36:14.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.976+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 0x7fb7b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.976+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 0x7fb7b806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00b450 tx=0x7fb7bc00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.977+0000 7fb7d497b740 1 Processor -- start 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.977+0000 7fb7d497b740 1 -- start start 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceef0af0 0x55e9ceef0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceeee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e9cee2a9c0 con 0x55e9ceec0b10 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9cedd1650 con 0x55e9ceef0af0 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55e9cee26980 con 0x55e9ceec4670 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36956/0 (socket says 172.21.15.80:36956) 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 -- 172.21.15.80:0/1733831300 learned_addr learned my addr 172.21.15.80:0/1733831300 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceef0af0 0x55e9ceef0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceeee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 -- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 msgr2=0x55e9ceeee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceeee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 -- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceef0af0 msgr2=0x55e9ceef0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceef0af0 0x55e9ceef0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 -- 172.21.15.80:0/1733831300 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ceb3d2d0 con 0x55e9ceec0b10 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0055cc0 tx=0x7fb7c00599a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8a0b384da6e070 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7b17fa640 1 -- 172.21.15.80:0/1733831300 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c001f070 con 0x55e9ceec0b10 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7b17fa640 1 -- 172.21.15.80:0/1733831300 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0057b60 con 0x55e9ceec0b10 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.978+0000 7fb7b17fa640 1 -- 172.21.15.80:0/1733831300 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00600c0 con 0x55e9ceec0b10 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 -- 172.21.15.80:0/1733831300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 msgr2=0x55e9ceeedd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0055cc0 tx=0x7fb7c00599a0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 -- 172.21.15.80:0/1733831300 shutdown_connections 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceeee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec0b10 0x55e9ceeedd60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1733831300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceef0af0 0x55e9ceef0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 -- 172.21.15.80:0/1733831300 >> 172.21.15.80:0/1733831300 conn(0x55e9ceec2d80 msgr2=0x55e9cef0b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 -- 172.21.15.80:0/1733831300 shutdown_connections 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.979+0000 7fb7d497b740 1 -- 172.21.15.80:0/1733831300 wait complete. 2024-04-16T15:36:14.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 -- start start 2024-04-16T15:36:14.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 Processor -- start 2024-04-16T15:36:14.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceee95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.984 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceef29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e9ceec5820 con 0x55e9ceef0af0 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9cede4a10 con 0x55e9ceee9b10 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55e9ceec4c10 con 0x55e9ceec4670 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.980+0000 7fb7d497b740 10 client.0 _ll_register_callbacks cb 0x55e9cede4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36960/0 (socket says 172.21.15.80:36960) 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 -- 172.21.15.80:0/1721245410 learned_addr learned my addr 172.21.15.80:0/1721245410 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceee95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceef29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 -- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 msgr2=0x55e9ceee95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceee95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 -- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 msgr2=0x55e9ceef29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:14.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceef29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 -- 172.21.15.80:0/1721245410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cec076b0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7caffd640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0007410 tx=0x7fb7c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c7143a78e88aee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0058eb0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7c005aae0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7c0057b60 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb7c005ace0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7d497b740 10 client.4860 fetch_fsmap learned FSMap version 9 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e9ceeebba0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0057b60 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fb7c00555b0 con 0x55e9ceef0af0 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.981+0000 7fb7d497b740 10 client.4860 fetch_fsmap finished waiting for FSMap version 9 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7d497b740 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7d497b740 20 client.4860 populate_metadata read hostname 'smithi080' 2024-04-16T15:36:14.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef257c0 0x55e9cef29970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7d497b740 4 client.4860 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 --> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9cee383e0 con 0x55e9cef257c0 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef257c0 0x55e9cef29970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7aa7fc640 10 client.4860 ms_handle_connect on v2:172.21.15.87:6833/2875259766 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.982+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef257c0 0x55e9cef29970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f63408e8cb9d9d08 server_cookie=24cdfd970c503bb3 in_seq=0 out_seq=0 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/1721245410 <== mds.0 v2:172.21.15.87:6833/2875259766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9cee383e0 con 0x55e9cef257c0 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7aa7fc640 10 client.4860 handle_command_reply: tid=0 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 client.4860 shutdown 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 msgr2=0x55e9ceef24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0007410 tx=0x7fb7c0000bc0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 shutdown_connections 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef257c0 0x55e9cef29970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceef29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7aa7fc640 0 client.4860 ms_handle_reset on v2:172.21.15.87:6833/2875259766 2024-04-16T15:36:14.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9ceef24b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 --2- 172.21.15.80:0/1721245410 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceee95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:14.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 >> 172.21.15.80:0/1721245410 conn(0x55e9ceec0b10 msgr2=0x55e9cef0cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:14.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 shutdown_connections 2024-04-16T15:36:14.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 1 -- 172.21.15.80:0/1721245410 wait complete. 2024-04-16T15:36:14.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:14.983+0000 7fb7d497b740 20 client.4860 trim_cache size 0 max 16384 2024-04-16T15:36:15.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.002+0000 7fb7d497b740 1 Processor -- start 2024-04-16T15:36:15.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.002+0000 7fb7d497b740 1 -- start start 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceedbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceebffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc2013f0 con 0x55e9ceef0af0 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc200750 con 0x55e9ceee9b10 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc200da0 con 0x55e9ceec4670 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36966/0 (socket says 172.21.15.80:36966) 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 -- 172.21.15.80:0/2193219816 learned_addr learned my addr 172.21.15.80:0/2193219816 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:15.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceedbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7caffd640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceebffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 -- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 msgr2=0x55e9ceedbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceedbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 -- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 msgr2=0x55e9ceebffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceebffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 -- 172.21.15.80:0/2193219816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ceef1240 con 0x55e9ceef0af0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7caffd640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceebffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7cbfff640 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4008010 tx=0x7fb7c4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc0faacfa0faf3d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7b0ff9640 1 -- 172.21.15.80:0/2193219816 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c403b040 con 0x55e9ceef0af0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7b0ff9640 1 -- 172.21.15.80:0/2193219816 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4036800 con 0x55e9ceef0af0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.003+0000 7fb7b0ff9640 1 -- 172.21.15.80:0/2193219816 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4036bd0 con 0x55e9ceef0af0 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 -- 172.21.15.80:0/2193219816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 msgr2=0x55e9cef0b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4008010 tx=0x7fb7c4030000 comp rx=0 tx=0).stop 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 -- 172.21.15.80:0/2193219816 shutdown_connections 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceef0af0 0x55e9cef0b480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9ceebffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 --2- 172.21.15.80:0/2193219816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceec4670 0x55e9ceedbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 -- 172.21.15.80:0/2193219816 >> 172.21.15.80:0/2193219816 conn(0x55e9ceec0b10 msgr2=0x55e9ceef1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 -- 172.21.15.80:0/2193219816 shutdown_connections 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.004+0000 7fb7d497b740 1 -- 172.21.15.80:0/2193219816 wait complete. 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 -- start start 2024-04-16T15:36:15.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 Processor -- start 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9cef0f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceef0af0 0x55e9ceee6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.005+0000 7fb7d497b740 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x55e9ceec5820 con 0x55e9ceec4670 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x55e9ceec4c10 con 0x55e9ceee9b10 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x55e9cede4a10 con 0x55e9ceef0af0 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 10 client.0 _ll_register_callbacks cb 0x7fb7c000ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36972/0 (socket says 172.21.15.80:36972) 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 -- 172.21.15.80:0/814179040 learned_addr learned my addr 172.21.15.80:0/814179040 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 -- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceef0af0 msgr2=0x55e9ceee6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:15.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceef0af0 0x55e9ceee6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 -- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 msgr2=0x55e9cef0f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9cef0f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 -- 172.21.15.80:0/814179040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9cef0d080 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7cb7fe640 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e9ceeea020 tx=0x7fb7bc004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde457983cd72b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.80:3300/0 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0288a0 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7bc031df0 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7c4036800 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb7bc00ae30 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 10 client.4866 fetch_fsmap learned FSMap version 9 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e9cef2e950 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mon.0 v2:172.21.15.80:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c4036800 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mon.0 v2:172.21.15.80:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7fb7bc003970 con 0x55e9ceec4670 2024-04-16T15:36:15.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.006+0000 7fb7d497b740 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7d497b740 10 client.4866 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7d497b740 20 client.4866 populate_metadata read hostname 'smithi080' 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef1de40 0x55e9cef1e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7d497b740 4 client.4866 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 --> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] -- command(tid 0: {"prefix": "status"}) -- 0x55e9ceec2470 con 0x55e9cef1de40 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7caffd640 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef1de40 0x55e9cef1e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7caffd640 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef1de40 0x55e9cef1e220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89aa17a1d577986 server_cookie=7c75643a8c3ab051 in_seq=0 out_seq=0 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.007+0000 7fb7aa7fc640 10 client.4866 ms_handle_connect on v2:172.21.15.87:6833/2875259766 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7aa7fc640 1 -- 172.21.15.80:0/814179040 <== mds.0 v2:172.21.15.87:6833/2875259766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55e9ceec2470 con 0x55e9cef1de40 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7aa7fc640 10 client.4866 handle_command_reply: tid=0 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 client.4866 shutdown 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 msgr2=0x55e9cef88a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55e9ceeea020 tx=0x7fb7bc004a70 comp rx=0 tx=0).stop 2024-04-16T15:36:15.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 shutdown_connections 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x55e9ceef0af0 0x55e9ceee6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:6833/2875259766,v1:172.21.15.87:6835/2875259766] conn(0x55e9cef1de40 0x55e9cef1e220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x55e9ceee9b10 0x55e9cef0f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7aa7fc640 0 client.4866 ms_handle_reset on v2:172.21.15.87:6833/2875259766 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 --2- 172.21.15.80:0/814179040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55e9ceec4670 0x55e9cef88a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 >> 172.21.15.80:0/814179040 conn(0x55e9ceec0b10 msgr2=0x55e9ceeeda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 shutdown_connections 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 1 -- 172.21.15.80:0/814179040 wait complete. 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d497b740 20 client.4866 trim_cache size 0 max 16384 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:36:15.012 INFO:teuthology.orchestra.run.smithi080.stdout: "cluster_fsid": "a7d324ba-fc74-42df-88c0-3e8f3a7e8eab", 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "whoami": 0, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4299, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "want_state": "up:active", 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "state": "up:active", 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs", 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "rank_uptime": 27.109407809, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "mdsmap_epoch": 9, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch": 25, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "osdmap_epoch_barrier": 25, 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout: "uptime": 34.183694074000002 2024-04-16T15:36:15.013 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:36:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 msgr2=0x7fb7b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 0x7fb7b806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00b450 tx=0x7fb7bc00d040 comp rx=0 tx=0).stop 2024-04-16T15:36:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 msgr2=0x7fb7cc0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.008+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c7f0 tx=0x7fb7c000cbf0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.014 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 shutdown_connections 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb7b806c920 0x7fb7b806ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb7cc145020 0x7fb7cc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb7cc0cd820 0x7fb7cc0ce2b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 --2- 172.21.15.80:0/1150247224 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc06f650 0x7fb7cc15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 >> 172.21.15.80:0/1150247224 conn(0x7fb7cc067d90 msgr2=0x7fb7cc158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 shutdown_connections 2024-04-16T15:36:15.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.009+0000 7fb7d1cb3640 1 -- 172.21.15.80:0/1150247224 wait complete. 2024-04-16T15:36:15.018 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T15:36:15.028 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T15:36:15.028 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T15:36:15.028 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T15:36:15.028 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-16T15:36:15.066 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-16T15:36:15.066 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-16T15:36:15.066 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-16T15:36:15.066 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:36:15.066 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:15.066 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-16T15:36:15.066 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:36:15.066 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:15.066 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-16T15:36:15.066 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:36:15.067 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:15.067 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-16T15:36:15.067 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T15:36:15.067 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:15.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.067 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-16T15:36:15.083 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-16T15:36:15.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T15:36:15.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.194 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-16T15:36:15.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.263 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-16T15:36:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-04-16T15:36:15.359 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-04-16T15:36:15.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:36:15.360 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-16T15:36:15.361 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:36:15.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.467+0000 7fcb091d4640 1 Processor -- start 2024-04-16T15:36:15.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.467+0000 7fcb091d4640 1 -- start start 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb091d4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb0415f9f0 0x7fcb0415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb091d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb04141b10 0x7fcb0415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb091d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb0415cc20 con 0x7fcb0415c200 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb091d4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fcb0413eb70 con 0x7fcb0415f9f0 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb091d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0415c690 con 0x7fcb04141b10 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb0415f9f0 0x7fcb0415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fcb0415f9f0 0x7fcb0415fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36984/0 (socket says 172.21.15.80:36984) 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 -- 172.21.15.80:0/3794617914 learned_addr learned my addr 172.21.15.80:0/3794617914 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcafa59c640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb04141b10 0x7fcb0415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 -- 172.21.15.80:0/3794617914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb04141b10 msgr2=0x7fcb0415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb04141b10 0x7fcb0415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 -- 172.21.15.80:0/3794617914 >> v1:172.21.15.87:6789/0 conn(0x7fcb0415c200 legacy=0x7fcb040b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.468+0000 7fcb02d9d640 1 -- 172.21.15.80:0/3794617914 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0415c940 con 0x7fcb0415f9f0 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb02d9d640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb0415fdd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400bb10 tx=0x7fcaf402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da6735e3f281b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb0259c640 1 -- 172.21.15.80:0/3794617914 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf403b070 con 0x7fcb0415f9f0 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb0259c640 1 -- 172.21.15.80:0/3794617914 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf4036440 con 0x7fcb0415f9f0 2024-04-16T15:36:15.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb0259c640 1 -- 172.21.15.80:0/3794617914 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4036810 con 0x7fcb0415f9f0 2024-04-16T15:36:15.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb091d4640 1 -- 172.21.15.80:0/3794617914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 msgr2=0x7fcb0415fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.469+0000 7fcb091d4640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb0415fdd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400bb10 tx=0x7fcaf402e0c0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 -- 172.21.15.80:0/3794617914 shutdown_connections 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb04141b10 0x7fcb0415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 --2- 172.21.15.80:0/3794617914 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb0415fdd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 -- 172.21.15.80:0/3794617914 >> 172.21.15.80:0/3794617914 conn(0x7fcb040b2940 msgr2=0x7fcb0406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 -- 172.21.15.80:0/3794617914 shutdown_connections 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.470+0000 7fcb091d4640 1 -- 172.21.15.80:0/3794617914 wait complete. 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.471+0000 7fcb091d4640 1 Processor -- start 2024-04-16T15:36:15.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.471+0000 7fcb091d4640 1 -- start start 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb04141b10 0x7fcb04144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb0415c200 0x7fcb0415d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fcb041415f0 con 0x7fcb0415f9f0 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04141310 con 0x7fcb04141b10 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb091d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fcb040b6070 con 0x7fcb0415c200 2024-04-16T15:36:15.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37000/0 (socket says 172.21.15.80:37000) 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 -- 172.21.15.80:0/1057836709 learned_addr learned my addr 172.21.15.80:0/1057836709 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcafa59c640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb0415c200 0x7fcb0415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb02d9d640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb04141b10 0x7fcb04144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 -- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb0415c200 msgr2=0x7fcb0415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb0415c200 0x7fcb0415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 -- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb04141b10 msgr2=0x7fcb04144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb04141b10 0x7fcb04144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 -- 172.21.15.80:0/1057836709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb04143340 con 0x7fcb0415f9f0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcb0359e640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00c7a0 tx=0x7fcafc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.472+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc003b70 con 0x7fcb0415f9f0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.473+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcafc003d30 con 0x7fcb0415f9f0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.473+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00aa30 con 0x7fcb0415f9f0 2024-04-16T15:36:15.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.473+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb04143620 con 0x7fcb0415f9f0 2024-04-16T15:36:15.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.473+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb04144640 con 0x7fcb0415f9f0 2024-04-16T15:36:15.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.474+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb04068a40 con 0x7fcb0415f9f0 2024-04-16T15:36:15.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.474+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcafc00abd0 con 0x7fcb0415f9f0 2024-04-16T15:36:15.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.474+0000 7fcafbfff640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:15.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.475+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcafc08bd10 con 0x7fcb0415f9f0 2024-04-16T15:36:15.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.475+0000 7fcb02d9d640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:15.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.475+0000 7fcb02d9d640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 0x7fcae406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4038000 tx=0x7fcaf4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:15.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.479+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcafc059e90 con 0x7fcb0415f9f0 2024-04-16T15:36:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.691+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcb0415f440 con 0x7fcb0415f9f0 2024-04-16T15:36:15.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.692+0000 7fcafbfff640 1 -- 172.21.15.80:0/1057836709 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fcafc059790 con 0x7fcb0415f9f0 2024-04-16T15:36:15.690 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T15:36:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.693+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 msgr2=0x7fcae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.693+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 0x7fcae406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4038000 tx=0x7fcaf4032000 comp rx=0 tx=0).stop 2024-04-16T15:36:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.693+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 msgr2=0x7fcb040b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:15.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.693+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00c7a0 tx=0x7fcafc00cc60 comp rx=0 tx=0).stop 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 shutdown_connections 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcb0415f9f0 0x7fcb040b11d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fcae406c8f0 0x7fcae406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fcb0415c200 0x7fcb0415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 --2- 172.21.15.80:0/1057836709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb04141b10 0x7fcb04144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 >> 172.21.15.80:0/1057836709 conn(0x7fcb040b2940 msgr2=0x7fcb0413fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 shutdown_connections 2024-04-16T15:36:15.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15.694+0000 7fcb091d4640 1 -- 172.21.15.80:0/1057836709 wait complete. 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:15.703 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:36:15.704 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:36:15.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:36:15.704 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T15:36:15.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.704 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-16T15:36:15.720 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-04-16T15:36:15.721 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:15.721 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T15:36:15.721 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:15.721 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:15.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add name ceph-brx type bridge 2024-04-16T15:36:15.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr flush dev ceph-brx 2024-04-16T15:36:15.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set ceph-brx up 2024-04-16T15:36:15.722 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T15:36:15.722 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:15.809 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:15.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:15.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.873 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:36:15.900 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-16T15:36:15.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:15.901 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-16T15:36:15.957 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-16T15:36:15.957 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:36:15.957 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:36:15.958 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:36:15.958 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:36:15.958 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:16.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:16.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:16.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:16.096 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-16T15:36:16.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:16.112 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-16T15:36:16.168 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:16.168 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:16.168 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:16.168 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T15:36:16.168 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:16.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:16.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:16.291 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T15:36:16.291 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T15:36:16.292 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:16.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:16.421 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:16.421 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:16.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.0 up 2024-04-16T15:36:16.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T15:36:16.421 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:16.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:16.500 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:16.506 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-16T15:36:16.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:16.506 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:16.534 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T15:36:16.534 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:16.534 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:16.589 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:36:16.658 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:16.714 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:36:16.714 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:36:16.714 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:36:16.715 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:36:16.716 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:36:16.717 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:16.717 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:16.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:16.717 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:36:16.769 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T15:36:16.769 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-16T15:36:16.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:36:16.812 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:36:16.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:36:16.841 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:36:16.897 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:16.898 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:16.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:16.900 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:36:16.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi080.stderr:2024-04-16T15:36:16.903+0000 7f3ebc648480 -1 init, newargv = 0x562747740dc0 newargc=15 2024-04-16T15:36:16.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi080.stderr:ceph-fuse[48349]: starting ceph client 2024-04-16T15:36:16.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi080.stderr:ceph-fuse[48349]: starting fuse 2024-04-16T15:36:16.917 INFO:teuthology.orchestra.run.smithi080.stdout:41 2024-04-16T15:36:16.918 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> import re 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> import os 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:16.918 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2024-04-16T15:36:16.919 DEBUG:teuthology.orchestra.run.smithi080:> return f 2024-04-16T15:36:16.920 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:36:16.920 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:16.920 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.0")) 2024-04-16T15:36:16.920 DEBUG:teuthology.orchestra.run.smithi080:> ' 2024-04-16T15:36:17.042 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.0.48349.asok 2024-04-16T15:36:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:17.053 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48349.asok 2024-04-16T15:36:17.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.053 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48349.asok status 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "0", 2024-04-16T15:36:17.193 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "48349", 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4881, 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-16T15:36:17.194 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 4881 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2565333902 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2565333902 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.4881 192.168.0.1:0/2565333902", 2024-04-16T15:36:17.195 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "192.168.0.1:0/2565333902", 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 9, 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 25, 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2024-04-16T15:36:17.196 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:36:17.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:36:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.307+0000 7f7b86a4a640 1 Processor -- start 2024-04-16T15:36:17.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.307+0000 7f7b86a4a640 1 -- start start 2024-04-16T15:36:17.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.307+0000 7f7b86a4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b8015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.307+0000 7f7b86a4a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b8015ef80 0x7f7b800cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b86a4a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b800cfeb0 con 0x7f7b80163350 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b86a4a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7b80162900 con 0x7f7b8015ef80 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b86a4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7b80162ec0 con 0x7f7b800d1450 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b8015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b77fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b8015ef80 0x7f7b800cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b84fe7640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7b80163350 0x7f7b800d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44262/0 (socket says 172.21.15.80:44262) 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b84fe7640 1 -- 172.21.15.80:0/4133216796 learned_addr learned my addr 172.21.15.80:0/4133216796 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7f7fe640 1 -- 172.21.15.80:0/4133216796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779556509 0 0) 0x7f7b800cfeb0 con 0x7f7b80163350 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7f7fe640 1 -- 172.21.15.80:0/4133216796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b6c003520 con 0x7f7b80163350 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7ffff640 1 -- 172.21.15.80:0/4133216796 >> v2:172.21.15.87:3300/0 conn(0x7f7b8015ef80 msgr2=0x7f7b800cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7ffff640 1 --2- 172.21.15.80:0/4133216796 >> v2:172.21.15.87:3300/0 conn(0x7f7b8015ef80 0x7f7b800cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7ffff640 1 -- 172.21.15.80:0/4133216796 >> v1:172.21.15.80:6789/0 conn(0x7f7b80163350 legacy=0x7f7b800d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.308+0000 7f7b7ffff640 1 -- 172.21.15.80:0/4133216796 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800d0190 con 0x7f7b800d1450 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.309+0000 7f7b7ffff640 1 --2- 172.21.15.80:0/4133216796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b8015fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b700097a0 tx=0x7f7b7002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bccbc5e2592ce9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.309+0000 7f7b7f7fe640 1 -- 172.21.15.80:0/4133216796 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b700315a0 con 0x7f7b800d1450 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.309+0000 7f7b7f7fe640 1 -- 172.21.15.80:0/4133216796 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70037070 con 0x7f7b800d1450 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.309+0000 7f7b7f7fe640 1 -- 172.21.15.80:0/4133216796 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70031940 con 0x7f7b800d1450 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 -- 172.21.15.80:0/4133216796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 msgr2=0x7f7b8015fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/4133216796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b8015fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b700097a0 tx=0x7f7b7002b840 comp rx=0 tx=0).stop 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 -- 172.21.15.80:0/4133216796 shutdown_connections 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/4133216796 >> v2:172.21.15.87:3300/0 conn(0x7f7b8015ef80 0x7f7b800cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/4133216796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b8015fe60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 -- 172.21.15.80:0/4133216796 >> 172.21.15.80:0/4133216796 conn(0x7f7b8006ce20 msgr2=0x7f7b8006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 -- 172.21.15.80:0/4133216796 shutdown_connections 2024-04-16T15:36:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.310+0000 7f7b86a4a640 1 -- 172.21.15.80:0/4133216796 wait complete. 2024-04-16T15:36:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.311+0000 7f7b86a4a640 1 Processor -- start 2024-04-16T15:36:17.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.311+0000 7f7b86a4a640 1 -- start start 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b801491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b8015ef80 0x7f7b801f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800d2ff0 con 0x7f7b80163350 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801637c0 con 0x7f7b8015ef80 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800d3170 con 0x7f7b800d1450 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37010/0 (socket says 172.21.15.80:37010) 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 -- 172.21.15.80:0/3241461416 learned_addr learned my addr 172.21.15.80:0/3241461416 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b7ffff640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b801491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b77fff640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b8015ef80 0x7f7b801f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 -- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 msgr2=0x7f7b801491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b801491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 -- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b8015ef80 msgr2=0x7f7b801f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b8015ef80 0x7f7b801f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 -- 172.21.15.80:0/3241461416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800cd160 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b84fe7640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800caa0 tx=0x7f7b7800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78017070 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7800ac00 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b800cd440 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78012400 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.312+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b800cda00 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.313+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b80068a40 con 0x7f7b80163350 2024-04-16T15:36:17.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.314+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b7801a070 con 0x7f7b80163350 2024-04-16T15:36:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.314+0000 7f7b7d7fa640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 0x7f7b6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.314+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b7808bc10 con 0x7f7b80163350 2024-04-16T15:36:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.314+0000 7f7b7ffff640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 0x7f7b6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:17.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.315+0000 7f7b7ffff640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 0x7f7b6006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b70036000 tx=0x7f7b7003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:17.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.318+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b780596b0 con 0x7f7b80163350 2024-04-16T15:36:17.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.536+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b800d2920 con 0x7f7b80163350 2024-04-16T15:36:17.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.536+0000 7f7b7d7fa640 1 -- 172.21.15.80:0/3241461416 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7b7805d9b0 con 0x7f7b80163350 2024-04-16T15:36:17.535 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 msgr2=0x7f7b6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 0x7f7b6006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b70036000 tx=0x7f7b7003d040 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 msgr2=0x7f7b801467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800caa0 tx=0x7f7b7800cf60 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 shutdown_connections 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7b80163350 0x7f7b801467b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b8015ef80 0x7f7b801f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7b6006c8f0 0x7f7b6006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 --2- 172.21.15.80:0/3241461416 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7b800d1450 0x7f7b801491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 >> 172.21.15.80:0/3241461416 conn(0x7f7b8006ce20 msgr2=0x7f7b800d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 shutdown_connections 2024-04-16T15:36:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17.538+0000 7f7b86a4a640 1 -- 172.21.15.80:0/3241461416 wait complete. 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi080.front.sepia.ceph.com 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:36:17.548 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-16T15:36:17.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.548 DEBUG:teuthology.orchestra.run.smithi080:> ip addr 2024-04-16T15:36:17.564 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:17.564 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b2 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f0 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:d8:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: altname enp7s0f1 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a8 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:17.565 INFO:teuthology.orchestra.run.smithi080.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 0c:c4:7a:8f:cb:a9 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: inet 172.21.15.80/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 5e:39:50:5d:94:19 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T15:36:17.566 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::589d:67ff:fef3:af86/64 scope link tentative 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether 5e:39:50:5d:94:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::5c39:50ff:fe5d:9419/64 scope link tentative 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:17.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.567 DEBUG:teuthology.orchestra.run.smithi080:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:36:17.632 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-04-16T15:36:17.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.634 DEBUG:teuthology.orchestra.run.smithi080:> route 2024-04-16T15:36:17.691 INFO:teuthology.orchestra.run.smithi080.stdout:Kernel IP routing table 2024-04-16T15:36:17.691 INFO:teuthology.orchestra.run.smithi080.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:36:17.691 INFO:teuthology.orchestra.run.smithi080.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:36:17.691 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:36:17.691 INFO:teuthology.orchestra.run.smithi080.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:36:17.691 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:17.692 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:17.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:36:17.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:36:17.692 DEBUG:teuthology.orchestra.run.smithi080:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:36:17.692 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:17.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:17.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.830 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-16T15:36:17.846 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T15:36:17.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:17.847 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list-id 2024-04-16T15:36:17.902 INFO:teuthology.orchestra.run.smithi080.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-16T15:36:17.902 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:17.902 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:17.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:36:17.902 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-16T15:36:17.902 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:17.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:18.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:18.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:18.029 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T15:36:18.056 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:18.056 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:18.056 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:18.056 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.056 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether be:b9:2a:11:9f:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::bcb9:2aff:fe11:9fcf/64 scope link 2024-04-16T15:36:18.057 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:18.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:18.126 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.127 INFO:teuthology.orchestra.run.smithi080.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:18.127 INFO:teuthology.orchestra.run.smithi080.stdout: link/ether be:b9:2a:11:9f:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:36:18.127 INFO:teuthology.orchestra.run.smithi080.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:36:18.127 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: inet6 fe80::bcb9:2aff:fe11:9fcf/64 scope link 2024-04-16T15:36:18.128 INFO:teuthology.orchestra.run.smithi080.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:18.129 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-16T15:36:18.129 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-16T15:36:18.130 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:18.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:18.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:18.299 DEBUG:teuthology.orchestra.run.smithi080:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:18.299 DEBUG:teuthology.orchestra.run.smithi080:> set -e 2024-04-16T15:36:18.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set brx.1 up 2024-04-16T15:36:18.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T15:36:18.299 DEBUG:teuthology.orchestra.run.smithi080:> ') 2024-04-16T15:36:18.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:18.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:18.383 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-16T15:36:18.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:18.383 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:18.399 INFO:teuthology.orchestra.run.smithi080.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-16T15:36:18.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:18.399 DEBUG:teuthology.orchestra.run.smithi080:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:18.454 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:36:18.523 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:18.579 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:36:18.579 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:36:18.579 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:36:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:18.581 INFO:teuthology.orchestra.run.smithi080.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:18.582 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:36:18.582 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:36:18.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:18.582 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:36:18.634 INFO:teuthology.orchestra.run.smithi080.stdout:41 2024-04-16T15:36:18.635 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-04-16T15:36:18.635 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-16T15:36:18.677 DEBUG:teuthology.orchestra.run.smithi080:> sudo modprobe fuse 2024-04-16T15:36:18.707 DEBUG:teuthology.orchestra.run.smithi080:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/proc 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/sys 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/dev 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/security 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/shm 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/pts 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/run 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/cgroup 2024-04-16T15:36:18.764 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/pstore 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/bpf 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/ 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/selinux 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/hugepages 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/dev/mqueue 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/debug 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/tracing 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/sys/kernel/config 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:18.765 INFO:teuthology.orchestra.run.smithi080.stdout:/run/user/1000 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run.smithi080.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:36:18.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:18.767 DEBUG:teuthology.orchestra.run.smithi080:> ls /sys/fs/fuse/connections 2024-04-16T15:36:18.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi080.stderr:2024-04-16T15:36:18.767+0000 7f9f5fef6480 -1 init, newargv = 0x559fedd3aed0 newargc=15 2024-04-16T15:36:18.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi080.stderr:ceph-fuse[48847]: starting ceph client 2024-04-16T15:36:18.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi080.stderr:ceph-fuse[48847]: starting fuse 2024-04-16T15:36:18.782 INFO:teuthology.orchestra.run.smithi080.stdout:41 2024-04-16T15:36:18.783 INFO:teuthology.orchestra.run.smithi080.stdout:44 2024-04-16T15:36:18.783 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-04-16T15:36:18.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:36:18.783 DEBUG:teuthology.orchestra.run.smithi080:> import glob 2024-04-16T15:36:18.783 DEBUG:teuthology.orchestra.run.smithi080:> import re 2024-04-16T15:36:18.783 DEBUG:teuthology.orchestra.run.smithi080:> import os 2024-04-16T15:36:18.783 DEBUG:teuthology.orchestra.run.smithi080:> import subprocess 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> def _find_admin_socket(client_name): 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> files = glob.glob(asok_path) 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> # Given a non-glob path, it better be there 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> if "*" not in asok_path: 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> assert(len(files) == 1) 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> return files[0] 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> for f in files: 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:36:18.784 DEBUG:teuthology.orchestra.run.smithi080:> contents = proc_f.read() 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> if mountpoint in contents: 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> return f 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> print(_find_admin_socket("client.2")) 2024-04-16T15:36:18.785 DEBUG:teuthology.orchestra.run.smithi080:> ' 2024-04-16T15:36:18.906 INFO:teuthology.orchestra.run.smithi080.stdout:/var/run/ceph/ceph-client.2.48847.asok 2024-04-16T15:36:18.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:18.916 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.48847.asok 2024-04-16T15:36:18.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:18.917 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.48847.asok status 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "metadata": { 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "entity_id": "2", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "hostname": "smithi080", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "pid": "48847", 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: "root": "/" 2024-04-16T15:36:19.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_count": 0, 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "dentry_pinned_count": 0, 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "id": 4893, 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "inst": { 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "name": { 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "client", 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "num": 4893 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2126248527 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:19.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": { 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type": "v1", 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "nonce": 2126248527 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "inst_str": "client.4893 192.168.0.2:0/2126248527", 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "addr_str": "192.168.0.2:0/2126248527", 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "inode_count": 1, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "mds_epoch": 9, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch": 25, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "blocklisted": false, 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout: "fs_name": "cephfs" 2024-04-16T15:36:19.059 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:36:19.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:36:19.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.169+0000 7f704c996640 1 Processor -- start 2024-04-16T15:36:19.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.169+0000 7f704c996640 1 -- start start 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f704c996640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f70480d1450 0x7f704815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f704c996640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70480cfbf0 con 0x7f704815ef80 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f704c996640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70480cfeb0 con 0x7f70480cf780 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f704c996640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7048162900 con 0x7f70480d1450 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f703dd9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f704815ef80 0x7f70480d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44266/0 (socket says 172.21.15.80:44266) 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f703dd9b640 1 -- 172.21.15.80:0/2408269898 learned_addr learned my addr 172.21.15.80:0/2408269898 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f704659c640 1 --2- 172.21.15.80:0/2408269898 >> v2:172.21.15.87:3300/0 conn(0x7f70480d1450 0x7f704815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.170+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076953096 0 0) 0x7f70480cfbf0 con 0x7f704815ef80 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7034003520 con 0x7f704815ef80 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2285779224 0 0) 0x7f7034003520 con 0x7f704815ef80 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 >> v2:172.21.15.87:3300/0 conn(0x7f70480d1450 msgr2=0x7f704815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 --2- 172.21.15.80:0/2408269898 >> v2:172.21.15.87:3300/0 conn(0x7f70480d1450 0x7f704815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 >> v1:172.21.15.87:6789/0 conn(0x7f70480cf780 legacy=0x7f70480d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70480d0190 con 0x7f704815ef80 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f7030001670 con 0x7f704815ef80 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 >> v1:172.21.15.80:6789/0 conn(0x7f704815ef80 legacy=0x7f70480d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 0x7f7034003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340043b0 0x7f7034004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7034005120 0x7f703400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7048162900 con 0x7f70340039b0 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f703400c060 con 0x7f70340043b0 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f703400c260 con 0x7f7034005120 2024-04-16T15:36:19.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 0x7f7034003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f703dd9b640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340043b0 0x7f7034004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7046d9d640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7034005120 0x7f703400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 -- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7034005120 msgr2=0x7f703400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7034005120 0x7f703400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 -- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340043b0 msgr2=0x7f7034004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340043b0 0x7f7034004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f704659c640 1 -- 172.21.15.80:0/2408269898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7034003520 con 0x7f70340039b0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7046d9d640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7034005120 0x7f703400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.171+0000 7f7046d9d640 1 -- 172.21.15.80:0/2408269898 reap_dead start 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.172+0000 7f704659c640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 0x7f7034003d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ac0 tx=0x7f7034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b8c7762d916bc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.172+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038039070 con 0x7f70340039b0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.172+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703802c6b0 con 0x7f70340039b0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.172+0000 7f7045d9b640 1 -- 172.21.15.80:0/2408269898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038009690 con 0x7f70340039b0 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 -- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 msgr2=0x7f7034003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 0x7f7034003d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ac0 tx=0x7f7034005830 comp rx=0 tx=0).stop 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 -- 172.21.15.80:0/2408269898 shutdown_connections 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 --2- 172.21.15.80:0/2408269898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70340039b0 0x7f7034003d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 -- 172.21.15.80:0/2408269898 >> 172.21.15.80:0/2408269898 conn(0x7f704806ce20 msgr2=0x7f704806d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 -- 172.21.15.80:0/2408269898 shutdown_connections 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.173+0000 7f704c996640 1 -- 172.21.15.80:0/2408269898 wait complete. 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.174+0000 7f704c996640 1 Processor -- start 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.174+0000 7f704c996640 1 -- start start 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340039b0 0x7f704814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f704815e210 0x7f704815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f704815fe60 con 0x7f70480ca680 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7048162ec0 con 0x7f70340039b0 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704c996640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f704815ffe0 con 0x7f704815e210 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37042/0 (socket says 172.21.15.80:37042) 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 -- 172.21.15.80:0/1358101518 learned_addr learned my addr 172.21.15.80:0/1358101518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 -- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f704815e210 msgr2=0x7f704815bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f704815e210 0x7f704815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 -- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340039b0 msgr2=0x7f704814d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f704659c640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340039b0 0x7f704814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340039b0 0x7f704814d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 -- 172.21.15.80:0/1358101518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70480c95e0 con 0x7f70480ca680 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.175+0000 7f703dd9b640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7030007290 tx=0x7f7030007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.176+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030001650 con 0x7f70480ca680 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.176+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7030018070 con 0x7f70480ca680 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.176+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70480c98c0 con 0x7f70480ca680 2024-04-16T15:36:19.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.176+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703000fb60 con 0x7f70480ca680 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.176+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70480c9e80 con 0x7f70480ca680 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.177+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7048068a40 con 0x7f70480ca680 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.177+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f703000fd00 con 0x7f70480ca680 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.178+0000 7f703f7fe640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 0x7f702806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.178+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f703008be00 con 0x7f70480ca680 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.178+0000 7f704659c640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 0x7f702806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.178+0000 7f704659c640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 0x7f702806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7038036000 tx=0x7f7038030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:19.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.182+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7030059f80 con 0x7f70480ca680 2024-04-16T15:36:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.398+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f704814def0 con 0x7f70480ca680 2024-04-16T15:36:19.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.398+0000 7f703f7fe640 1 -- 172.21.15.80:0/1358101518 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7030059880 con 0x7f70480ca680 2024-04-16T15:36:19.397 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 msgr2=0x7f702806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 0x7f702806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7038036000 tx=0x7f7038030000 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 msgr2=0x7f704815dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7030007290 tx=0x7f7030007750 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 shutdown_connections 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f702806c8f0 0x7f702806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f704815e210 0x7f704815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f70480ca680 0x7f704815dcd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 --2- 172.21.15.80:0/1358101518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70340039b0 0x7f704814d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 >> 172.21.15.80:0/1358101518 conn(0x7f704806ce20 msgr2=0x7f7048159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 shutdown_connections 2024-04-16T15:36:19.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:19.400+0000 7f704c996640 1 -- 172.21.15.80:0/1358101518 wait complete. 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:36:19.411 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T15:36:19.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:19.411 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:19.431 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-04-16T15:36:19.432 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:19.433 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T15:36:19.433 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:19.527 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:19.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:19.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:19.704 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:36:19.732 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-04-16T15:36:19.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:19.734 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-04-16T15:36:19.801 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-04-16T15:36:19.801 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:36:19.801 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:36:19.802 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:36:19.802 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:36:19.802 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:19.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:20.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:20.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:20.139 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-16T15:36:20.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:20.155 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-04-16T15:36:20.212 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:20.212 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:20.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:20.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T15:36:20.213 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:20.302 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:20.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:20.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T15:36:20.340 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:20.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:20.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:20.503 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:20.503 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:20.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-04-16T15:36:20.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T15:36:20.503 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:20.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:20.587 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-16T15:36:20.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:20.588 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:20.615 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T15:36:20.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:20.615 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:20.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-16T15:36:20.739 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:20.795 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:36:20.797 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:36:20.798 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-16T15:36:20.798 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:20.798 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:20.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:20.798 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-16T15:36:20.850 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T15:36:20.851 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-16T15:36:20.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-16T15:36:20.921 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-16T15:36:20.978 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-16T15:36:20.979 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-16T15:36:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:20.981 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:20.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:20.982 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-16T15:36:20.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:2024-04-16T15:36:20.983+0000 7f322a839480 -1 init, newargv = 0x556cd1ba9d20 newargc=15 2024-04-16T15:36:20.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[44048]: starting ceph client 2024-04-16T15:36:20.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi087.stderr:ceph-fuse[44048]: starting fuse 2024-04-16T15:36:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:41 2024-04-16T15:36:20.998 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:20.999 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.1")) 2024-04-16T15:36:21.000 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-04-16T15:36:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.1.44048.asok 2024-04-16T15:36:21.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:21.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44048.asok 2024-04-16T15:36:21.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44048.asok status 2024-04-16T15:36:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-16T15:36:21.269 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-04-16T15:36:21.269 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "1", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "44048", 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4631, 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-04-16T15:36:21.270 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4631 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3268005208 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3268005208 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4631 192.168.0.1:0/3268005208", 2024-04-16T15:36:21.271 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/3268005208", 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 25, 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-04-16T15:36:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-16T15:36:21.277 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T15:36:21.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.390+0000 7f69db82a640 1 Processor -- start 2024-04-16T15:36:21.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.390+0000 7f69db82a640 1 -- start start 2024-04-16T15:36:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69db82a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69d40cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69db82a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d40ccd90 con 0x7f69d4145a30 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69db82a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d40b1520 con 0x7f69d406c0b0 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69db82a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f69d4145e10 con 0x7f69d4145fb0 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69d95c6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f69d4145a30 0x7f69d406b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44268/0 (socket says 172.21.15.80:44268) 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.391+0000 7f69d95c6640 1 -- 172.21.15.80:0/795563539 learned_addr learned my addr 172.21.15.80:0/795563539 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858696606 0 0) 0x7f69d40ccd90 con 0x7f69d4145a30 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d9dc7640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69d40cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c0003520 con 0x7f69d4145a30 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2621996160 0 0) 0x7f69c0003520 con 0x7f69d4145a30 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 msgr2=0x7f69d40cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69d40cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 >> v1:172.21.15.87:6789/0 conn(0x7f69d406c0b0 legacy=0x7f69d40cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d40b1800 con 0x7f69d4145a30 2024-04-16T15:36:21.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f69d0001a10 con 0x7f69d4145a30 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 >> v1:172.21.15.80:6789/0 conn(0x7f69d4145a30 legacy=0x7f69d406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69c00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0003f60 0x7f69c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c0004d40 0x7f69c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4145e10 con 0x7f69c0004d40 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69c000baa0 con 0x7f69c0003f60 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f69c000bca0 con 0x7f69d4145fb0 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69c00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d9dc7640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c0004d40 0x7f69c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d8dc5640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0003f60 0x7f69c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 -- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0003f60 msgr2=0x7f69c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69c0003f60 0x7f69c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 -- 172.21.15.80:0/795563539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c0004d40 msgr2=0x7f69c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c0004d40 0x7f69c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d95c6640 1 -- 172.21.15.80:0/795563539 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c0003520 con 0x7f69d4145fb0 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.392+0000 7f69d9dc7640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69c0004d40 0x7f69c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.393+0000 7f69d95c6640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69c00039e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69d000a8f0 tx=0x7f69c0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=427f5329605d4fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.393+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000a4c0 con 0x7f69d4145fb0 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.393+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d0034630 con 0x7f69d4145fb0 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.393+0000 7f69cbfff640 1 -- 172.21.15.80:0/795563539 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0034a40 con 0x7f69d4145fb0 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 -- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 msgr2=0x7f69c00039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 --2- 172.21.15.80:0/795563539 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d4145fb0 0x7f69c00039e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69d000a8f0 tx=0x7f69c0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69d9dc7640 1 -- 172.21.15.80:0/795563539 reap_dead start 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 -- 172.21.15.80:0/795563539 shutdown_connections 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 -- 172.21.15.80:0/795563539 >> 172.21.15.80:0/795563539 conn(0x7f69d409aa70 msgr2=0x7f69d40b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 -- 172.21.15.80:0/795563539 shutdown_connections 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.394+0000 7f69db82a640 1 -- 172.21.15.80:0/795563539 wait complete. 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.395+0000 7f69db82a640 1 Processor -- start 2024-04-16T15:36:21.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.395+0000 7f69db82a640 1 -- start start 2024-04-16T15:36:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 0x7f69d40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 0x7f69d40cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f69d40b2d00 con 0x7f69d4145fb0 2024-04-16T15:36:21.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69d40b1dc0 con 0x7f69d40d0d00 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69db82a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f69d40b2e80 con 0x7f69d41400e0 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37052/0 (socket says 172.21.15.80:37052) 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 -- 172.21.15.80:0/3605805331 learned_addr learned my addr 172.21.15.80:0/3605805331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d9dc7640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 0x7f69d40cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d8dc5640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 0x7f69d40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 -- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 msgr2=0x7f69d40ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 0x7f69d40ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 -- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 msgr2=0x7f69d40cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 0x7f69d40cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 -- 172.21.15.80:0/3605805331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d415c600 con 0x7f69d4145fb0 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d8dc5640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 0x7f69d40ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d9dc7640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 0x7f69d40cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69d95c6640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f69d000aa10 tx=0x7f69d0001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.396+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0046070 con 0x7f69d4145fb0 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.397+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d003a040 con 0x7f69d4145fb0 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.397+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d40b6390 con 0x7f69d4145fb0 2024-04-16T15:36:21.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.397+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000a4c0 con 0x7f69d4145fb0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.397+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d40b6630 con 0x7f69d4145fb0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.398+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d4068a40 con 0x7f69d4145fb0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.398+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69d0049070 con 0x7f69d4145fb0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.399+0000 7f69c9ffb640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 0x7f69b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.399+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69d00add00 con 0x7f69d4145fb0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.399+0000 7f69d8dc5640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 0x7f69b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:21.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.399+0000 7f69d8dc5640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 0x7f69b806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69d4161200 tx=0x7f69c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:21.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.403+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69d415c600 con 0x7f69d4145fb0 2024-04-16T15:36:21.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.617+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f69d4067c10 con 0x7f69d4145fb0 2024-04-16T15:36:21.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.617+0000 7f69c9ffb640 1 -- 172.21.15.80:0/3605805331 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f69d007bdf0 con 0x7f69d4145fb0 2024-04-16T15:36:21.617 INFO:teuthology.orchestra.run.smithi080.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 msgr2=0x7f69b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 0x7f69b806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69d4161200 tx=0x7f69c4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 msgr2=0x7f69d415c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f69d000aa10 tx=0x7f69d0001de0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 shutdown_connections 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69d40d0d00 0x7f69d40cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f69b806c8f0 0x7f69b806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f69d41400e0 0x7f69d40ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 --2- 172.21.15.80:0/3605805331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f69d4145fb0 0x7f69d415c0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 >> 172.21.15.80:0/3605805331 conn(0x7f69d409aa70 msgr2=0x7f69d4160220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 shutdown_connections 2024-04-16T15:36:21.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:21.619+0000 7f69db82a640 1 -- 172.21.15.80:0/3605805331 wait complete. 2024-04-16T15:36:21.629 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T15:36:21.630 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-16T15:36:21.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.630 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.647 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:21.648 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 82:ef:b8:61:da:13 brd ff:ff:ff:ff:ff:ff 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::cc05:75ff:fe05:f598/64 scope link tentative 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 82:ef:b8:61:da:13 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::80ef:b8ff:fe61:da13/64 scope link tentative 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:21.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.649 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T15:36:21.715 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-04-16T15:36:21.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.717 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-04-16T15:36:21.775 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-04-16T15:36:21.775 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T15:36:21.775 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T15:36:21.775 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T15:36:21.775 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T15:36:21.776 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:21.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:21.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:21.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.915 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-16T15:36:21.931 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T15:36:21.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:21.932 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-04-16T15:36:21.987 INFO:teuthology.orchestra.run.smithi087.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-16T15:36:21.987 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:21.987 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:21.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:36:21.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-16T15:36:21.988 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:22.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:22.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:22.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:22.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T15:36:22.139 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 2e:98:03:2e:e7:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::2c98:3ff:fe2e:e7d3/64 scope link tentative 2024-04-16T15:36:22.140 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:22.141 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T15:36:22.210 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T15:36:22.210 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T15:36:22.210 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T15:36:22.210 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 2e:98:03:2e:e7:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::2c98:3ff:fe2e:e7d3/64 scope link tentative 2024-04-16T15:36:22.211 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-04-16T15:36:22.212 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-16T15:36:22.212 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-16T15:36:22.213 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:22.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:22.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:22.382 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T15:36:22.382 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-04-16T15:36:22.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.1 up 2024-04-16T15:36:22.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T15:36:22.382 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-04-16T15:36:22.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T15:36:22.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:22.466 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-16T15:36:22.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:22.466 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:22.482 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-16T15:36:22.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T15:36:22.482 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:22.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-16T15:36:22.606 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-16T15:36:22.663 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:36:22.664 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:36:22.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:22.665 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-16T15:36:22.719 INFO:teuthology.orchestra.run.smithi087.stdout:41 2024-04-16T15:36:22.719 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-04-16T15:36:22.719 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-16T15:36:22.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-04-16T15:36:22.789 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-04-16T15:36:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-04-16T15:36:22.847 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-4 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-5 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-6 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-7 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:36:22.848 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:36:22.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:22.849 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-04-16T15:36:22.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:2024-04-16T15:36:22.851+0000 7f1d70d5e480 -1 init, newargv = 0x55a517d4ef40 newargc=15 2024-04-16T15:36:22.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:ceph-fuse[44505]: starting ceph client 2024-04-16T15:36:22.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi087.stderr:ceph-fuse[44505]: starting fuse 2024-04-16T15:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout:41 2024-04-16T15:36:22.865 INFO:teuthology.orchestra.run.smithi087.stdout:44 2024-04-16T15:36:22.865 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-04-16T15:36:22.865 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-04-16T15:36:22.866 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-04-16T15:36:22.867 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-04-16T15:36:22.867 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T15:36:22.867 DEBUG:teuthology.orchestra.run.smithi087:> 2024-04-16T15:36:22.867 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.3")) 2024-04-16T15:36:22.867 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-04-16T15:36:22.987 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.3.44505.asok 2024-04-16T15:36:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-16T15:36:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T15:36:22.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44505.asok 2024-04-16T15:36:22.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:22.998 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44505.asok status 2024-04-16T15:36:23.135 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-16T15:36:23.136 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-04-16T15:36:23.136 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "3", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "44505", 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-04-16T15:36:23.137 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4738, 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4738 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 700483369 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-04-16T15:36:23.138 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.2:0", 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 700483369 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4738 192.168.0.2:0/700483369", 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.2:0/700483369", 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 25, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-04-16T15:36:23.139 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-16T15:36:23.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.144 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2024-04-16T15:36:23.144 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:23.163 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2024-04-16T15:36:23.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:23.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:23.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.239 DEBUG:teuthology.orchestra.run.smithi080:> stat --file-system '--printf=%T 2024-04-16T15:36:23.239 DEBUG:teuthology.orchestra.run.smithi080:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:23.298 INFO:teuthology.orchestra.run.smithi080.stdout:fuseblk 2024-04-16T15:36:23.298 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:23.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.371 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-04-16T15:36:23.371 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:23.388 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-04-16T15:36:23.388 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:23.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.388 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:23.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.456 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-04-16T15:36:23.456 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:23.512 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-04-16T15:36:23.513 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:23.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:23.513 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:23.581 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T15:36:23.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:23.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.765+0000 7f239ba14640 1 Processor -- start 2024-04-16T15:36:23.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.765+0000 7f239ba14640 1 -- start start 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f239ba14640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23940d1010 0x7f239406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f239ba14640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23940b4010 con 0x7f239415eaa0 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f239ba14640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23940cf100 con 0x7f23940ca770 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f239ba14640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f23940b3800 con 0x7f23940d1010 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f2398faf640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f23940d1010 0x7f239406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f2399fb1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f239415eaa0 0x7f23940ae360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44284/0 (socket says 172.21.15.80:44284) 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.766+0000 7f2399fb1640 1 -- 172.21.15.80:0/3822956415 learned_addr learned my addr 172.21.15.80:0/3822956415 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.767+0000 7f2398faf640 1 -- 172.21.15.80:0/3822956415 >> v1:172.21.15.87:6789/0 conn(0x7f23940ca770 legacy=0x7f23940cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.767+0000 7f2398faf640 1 -- 172.21.15.80:0/3822956415 >> v1:172.21.15.80:6789/0 conn(0x7f239415eaa0 legacy=0x7f23940ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.767+0000 7f2398faf640 1 -- 172.21.15.80:0/3822956415 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23940b3a50 con 0x7f23940d1010 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.767+0000 7f2398faf640 1 --2- 172.21.15.80:0/3822956415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239406c3b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23940cf2d0 tx=0x7f238402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b8218bde66beaa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f238bfff640 1 -- 172.21.15.80:0/3822956415 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384034070 con 0x7f23940d1010 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f238bfff640 1 -- 172.21.15.80:0/3822956415 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2384030610 con 0x7f23940d1010 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f238bfff640 1 -- 172.21.15.80:0/3822956415 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23840309e0 con 0x7f23940d1010 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 -- 172.21.15.80:0/3822956415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 msgr2=0x7f239406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 --2- 172.21.15.80:0/3822956415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239406c3b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23940cf2d0 tx=0x7f238402b960 comp rx=0 tx=0).stop 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 -- 172.21.15.80:0/3822956415 shutdown_connections 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 --2- 172.21.15.80:0/3822956415 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239406c3b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 -- 172.21.15.80:0/3822956415 >> 172.21.15.80:0/3822956415 conn(0x7f239409aa70 msgr2=0x7f23940b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 -- 172.21.15.80:0/3822956415 shutdown_connections 2024-04-16T15:36:23.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.768+0000 7f239ba14640 1 -- 172.21.15.80:0/3822956415 wait complete. 2024-04-16T15:36:23.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.769+0000 7f239ba14640 1 Processor -- start 2024-04-16T15:36:23.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.769+0000 7f239ba14640 1 -- start start 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 0x7f239409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f239415eaa0 0x7f23940701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f23940cf3a0 con 0x7f23940d1010 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f239406c8f0 con 0x7f23940ca770 2024-04-16T15:36:23.771 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f239ba14640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f23940aea70 con 0x7f239415eaa0 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f2398faf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f2398faf640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37062/0 (socket says 172.21.15.80:37062) 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f2398faf640 1 -- 172.21.15.80:0/1279189209 learned_addr learned my addr 172.21.15.80:0/1279189209 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f23997b0640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 0x7f239409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.770+0000 7f2399fb1640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f239415eaa0 0x7f23940701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 -- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f239415eaa0 msgr2=0x7f23940701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f239415eaa0 0x7f23940701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 -- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 msgr2=0x7f239409ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 0x7f239409ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 -- 172.21.15.80:0/1279189209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239409e4f0 con 0x7f23940d1010 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f23997b0640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 0x7f239409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2398faf640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2384009890 tx=0x7f23840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384034040 con 0x7f23940d1010 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2384039a10 con 0x7f23940d1010 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384039e00 con 0x7f23940d1010 2024-04-16T15:36:23.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239409e7d0 con 0x7f23940d1010 2024-04-16T15:36:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.771+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239409ed90 con 0x7f23940d1010 2024-04-16T15:36:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.772+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2394068a40 con 0x7f23940d1010 2024-04-16T15:36:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.772+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2384037070 con 0x7f23940d1010 2024-04-16T15:36:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.773+0000 7f2389ffb640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:23.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.773+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f23840adf90 con 0x7f23940d1010 2024-04-16T15:36:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.773+0000 7f23997b0640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:23.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.773+0000 7f23997b0640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 0x7f237806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f239406c8c0 tx=0x7f2390009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:23.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.777+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f238407c230 con 0x7f23940d1010 2024-04-16T15:36:23.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.955+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23940d2090 con 0x7f23940d1010 2024-04-16T15:36:23.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.956+0000 7f2389ffb640 1 -- 172.21.15.80:0/1279189209 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f238407bb30 con 0x7f23940d1010 2024-04-16T15:36:23.956 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:23.956 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:23.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 msgr2=0x7f237806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 0x7f237806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f239406c8c0 tx=0x7f2390009040 comp rx=0 tx=0).stop 2024-04-16T15:36:23.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 msgr2=0x7f239409b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2384009890 tx=0x7f23840046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 shutdown_connections 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f239415eaa0 0x7f23940701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f23940d1010 0x7f239409b590 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 --2- 172.21.15.80:0/1279189209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23940ca770 0x7f239409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 >> 172.21.15.80:0/1279189209 conn(0x7f239409aa70 msgr2=0x7f23940afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 shutdown_connections 2024-04-16T15:36:23.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:23.959+0000 7f239ba14640 1 -- 172.21.15.80:0/1279189209 wait complete. 2024-04-16T15:36:23.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:23.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:24.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.079+0000 7ff6330d3640 1 Processor -- start 2024-04-16T15:36:24.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.079+0000 7ff6330d3640 1 -- start start 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6330d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6330d3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62c1610b0 con 0x7ff62c09b180 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6330d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62c0b2010 con 0x7ff62c0cd430 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6330d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff62c0b22f0 con 0x7ff62c15fe70 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff631670640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff62c09b180 0x7ff62c0b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44286/0 (socket says 172.21.15.80:44286) 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff631670640 1 -- 172.21.15.80:0/3611264480 learned_addr learned my addr 172.21.15.80:0/3611264480 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff630e6f640 1 --2- 172.21.15.80:0/3611264480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507587528 0 0) 0x7ff62c1610b0 con 0x7ff62c09b180 2024-04-16T15:36:24.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff614003520 con 0x7ff62c09b180 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243444758 0 0) 0x7ff62c0b2010 con 0x7ff62c0cd430 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff62c1610b0 con 0x7ff62c0cd430 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 214734460 0 0) 0x7ff614003520 con 0x7ff62c09b180 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff630e6f640 1 -- 172.21.15.80:0/3611264480 >> v1:172.21.15.87:6789/0 conn(0x7ff62c0cd430 legacy=0x7ff62c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff630e6f640 1 -- 172.21.15.80:0/3611264480 >> v1:172.21.15.80:6789/0 conn(0x7ff62c09b180 legacy=0x7ff62c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.080+0000 7ff630e6f640 1 -- 172.21.15.80:0/3611264480 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c160d80 con 0x7ff62c15fe70 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.081+0000 7ff630e6f640 1 --2- 172.21.15.80:0/3611264480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c0ccef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff628009dc0 tx=0x7ff62802bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433a910f6729e6e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.081+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628039070 con 0x7ff62c15fe70 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.081+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62802c910 con 0x7ff62c15fe70 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.081+0000 7ff6237fe640 1 -- 172.21.15.80:0/3611264480 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624001670 con 0x7ff62c15fe70 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 -- 172.21.15.80:0/3611264480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 msgr2=0x7ff62c0ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 --2- 172.21.15.80:0/3611264480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c0ccef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff628009dc0 tx=0x7ff62802bde0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 -- 172.21.15.80:0/3611264480 shutdown_connections 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 --2- 172.21.15.80:0/3611264480 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c0ccef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 -- 172.21.15.80:0/3611264480 >> 172.21.15.80:0/3611264480 conn(0x7ff62c0d2550 msgr2=0x7ff62c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 -- 172.21.15.80:0/3611264480 shutdown_connections 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.082+0000 7ff6330d3640 1 -- 172.21.15.80:0/3611264480 wait complete. 2024-04-16T15:36:24.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.083+0000 7ff6330d3640 1 Processor -- start 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.083+0000 7ff6330d3640 1 -- start start 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 0x7ff62c1e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c0b3b20 con 0x7ff62c0cd430 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c0b39a0 con 0x7ff62c09b180 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff6330d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff62c0b3ca0 con 0x7ff62c15fe70 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37064/0 (socket says 172.21.15.80:37064) 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 -- 172.21.15.80:0/2958567614 learned_addr learned my addr 172.21.15.80:0/2958567614 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:24.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff630e6f640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 0x7ff62c1e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff631670640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 -- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 msgr2=0x7ff62c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 -- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 msgr2=0x7ff62c1e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 0x7ff62c1e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff623fff640 1 -- 172.21.15.80:0/2958567614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c1e7920 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.084+0000 7ff630e6f640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 0x7ff62c1e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff623fff640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c490 tx=0x7ff61c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0052d0 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61c005470 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62c1e7c00 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c012870 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.085+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62c1e84a0 con 0x7ff62c0cd430 2024-04-16T15:36:24.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.086+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62c1e7dd0 con 0x7ff62c0cd430 2024-04-16T15:36:24.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.086+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff61c012a10 con 0x7ff62c0cd430 2024-04-16T15:36:24.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.087+0000 7ff6217fa640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 0x7ff61806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.087+0000 7ff630e6f640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 0x7ff61806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.087+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff61c08ba50 con 0x7ff62c0cd430 2024-04-16T15:36:24.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.087+0000 7ff630e6f640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 0x7ff61806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff628036000 tx=0x7ff628030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.091+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff61c059460 con 0x7ff62c0cd430 2024-04-16T15:36:24.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.264+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff62c1e86a0 con 0x7ff62c0cd430 2024-04-16T15:36:24.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.264+0000 7ff6217fa640 1 -- 172.21.15.80:0/2958567614 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff62c1e86a0 con 0x7ff62c0cd430 2024-04-16T15:36:24.264 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 msgr2=0x7ff61806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 0x7ff61806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff628036000 tx=0x7ff628030000 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 msgr2=0x7ff62c1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff61c00c490 tx=0x7ff61c00c950 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 shutdown_connections 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff61806c8f0 0x7ff61806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff62c15fe70 0x7ff62c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff62c0cd430 0x7ff62c1487f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 --2- 172.21.15.80:0/2958567614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff62c09b180 0x7ff62c1e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 >> 172.21.15.80:0/2958567614 conn(0x7ff62c0d2550 msgr2=0x7ff62c0b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 shutdown_connections 2024-04-16T15:36:24.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.266+0000 7ff6330d3640 1 -- 172.21.15.80:0/2958567614 wait complete. 2024-04-16T15:36:24.277 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:24.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.383+0000 7f05b21f2640 1 Processor -- start 2024-04-16T15:36:24.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.383+0000 7f05b21f2640 1 -- start start 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05b21f2640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05ac15ee40 0x7f05ac06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05b21f2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac0d14f0 con 0x7f05ac15ea60 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05b21f2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac0d17d0 con 0x7f05ac0afc40 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05b21f2640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac0b1950 con 0x7f05ac15ee40 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05aaffd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f05ac15ee40 0x7f05ac06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05ab7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f05ac15ea60 0x7f05ac06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:44290/0 (socket says 172.21.15.80:44290) 2024-04-16T15:36:24.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.384+0000 7f05ab7fe640 1 -- 172.21.15.80:0/878574360 learned_addr learned my addr 172.21.15.80:0/878574360 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:24.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.385+0000 7f05aaffd640 1 -- 172.21.15.80:0/878574360 >> v1:172.21.15.87:6789/0 conn(0x7f05ac0afc40 legacy=0x7f05ac0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.385+0000 7f05aaffd640 1 -- 172.21.15.80:0/878574360 >> v1:172.21.15.80:6789/0 conn(0x7f05ac15ea60 legacy=0x7f05ac06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.385+0000 7f05aa7fc640 1 -- 172.21.15.80:0/878574360 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917531167 0 0) 0x7f05ac0d14f0 con 0x7f05ac15ea60 2024-04-16T15:36:24.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.385+0000 7f05aaffd640 1 -- 172.21.15.80:0/878574360 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0af440 con 0x7f05ac15ee40 2024-04-16T15:36:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.385+0000 7f05aaffd640 1 --2- 172.21.15.80:0/878574360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac06d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f05a00097a0 tx=0x7f05a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d44a7d197f30b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05aa7fc640 1 -- 172.21.15.80:0/878574360 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0035020 con 0x7f05ac15ee40 2024-04-16T15:36:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05aa7fc640 1 -- 172.21.15.80:0/878574360 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a0031830 con 0x7f05ac15ee40 2024-04-16T15:36:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05aa7fc640 1 -- 172.21.15.80:0/878574360 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0031c00 con 0x7f05ac15ee40 2024-04-16T15:36:24.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 -- 172.21.15.80:0/878574360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 msgr2=0x7f05ac06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 --2- 172.21.15.80:0/878574360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac06d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f05a00097a0 tx=0x7f05a002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 -- 172.21.15.80:0/878574360 shutdown_connections 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 --2- 172.21.15.80:0/878574360 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac06d1c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 -- 172.21.15.80:0/878574360 >> 172.21.15.80:0/878574360 conn(0x7f05ac0b4060 msgr2=0x7f05ac0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 -- 172.21.15.80:0/878574360 shutdown_connections 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.386+0000 7f05b21f2640 1 -- 172.21.15.80:0/878574360 wait complete. 2024-04-16T15:36:24.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.387+0000 7f05b21f2640 1 Processor -- start 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.387+0000 7f05b21f2640 1 -- start start 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05ac0afc40 0x7f05ac1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 0x7f05ac1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0d1260 con 0x7f05ac15ee40 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0d10e0 con 0x7f05ac15ea60 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05b21f2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac09ba80 con 0x7f05ac0afc40 2024-04-16T15:36:24.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37086/0 (socket says 172.21.15.80:37086) 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 -- 172.21.15.80:0/3826001120 learned_addr learned my addr 172.21.15.80:0/3826001120 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05aaffd640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 0x7f05ac1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05ab7fe640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05ac0afc40 0x7f05ac1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 -- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05ac0afc40 msgr2=0x7f05ac1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05ac0afc40 0x7f05ac1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.388+0000 7f05abfff640 1 -- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 msgr2=0x7f05ac1f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05abfff640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 0x7f05ac1f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05abfff640 1 -- 172.21.15.80:0/3826001120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac1f4c20 con 0x7f05ac15ee40 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05aaffd640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 0x7f05ac1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05abfff640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c390 tx=0x7f05a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4017070 con 0x7f05ac15ee40 2024-04-16T15:36:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a40052d0 con 0x7f05ac15ee40 2024-04-16T15:36:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4003810 con 0x7f05ac15ee40 2024-04-16T15:36:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1f4f00 con 0x7f05ac15ee40 2024-04-16T15:36:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.389+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac154f00 con 0x7f05ac15ee40 2024-04-16T15:36:24.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.390+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac069150 con 0x7f05ac15ee40 2024-04-16T15:36:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.390+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05a401a070 con 0x7f05ac15ee40 2024-04-16T15:36:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.391+0000 7f0593fff640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 0x7f059806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.391+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f05a408b0d0 con 0x7f05ac15ee40 2024-04-16T15:36:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.391+0000 7f05ab7fe640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 0x7f059806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.391+0000 7f05ab7fe640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 0x7f059806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.395+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f05a4059250 con 0x7f05ac15ee40 2024-04-16T15:36:24.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.568+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05ac06ede0 con 0x7f05ac15ee40 2024-04-16T15:36:24.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.569+0000 7f0593fff640 1 -- 172.21.15.80:0/3826001120 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f05a4058b50 con 0x7f05ac15ee40 2024-04-16T15:36:24.568 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:24.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 msgr2=0x7f059806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 0x7f059806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f059c005fd0 tx=0x7f059c007f10 comp rx=0 tx=0).stop 2024-04-16T15:36:24.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 msgr2=0x7f05ac0b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f05a400c390 tx=0x7f05a400c850 comp rx=0 tx=0).stop 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 shutdown_connections 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f05ac15ee40 0x7f05ac0b7520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05ac15ea60 0x7f05ac1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f059806c920 0x7f059806ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 --2- 172.21.15.80:0/3826001120 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f05ac0afc40 0x7f05ac1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 >> 172.21.15.80:0/3826001120 conn(0x7f05ac0b4060 msgr2=0x7f05ac071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 shutdown_connections 2024-04-16T15:36:24.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.571+0000 7f05b21f2640 1 -- 172.21.15.80:0/3826001120 wait complete. 2024-04-16T15:36:24.581 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.689+0000 7f1789f40640 1 Processor -- start 2024-04-16T15:36:24.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.689+0000 7f1789f40640 1 -- start start 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1789f40640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17840b2c00 0x7f17840d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1789f40640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840ccba0 con 0x7f178409b180 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1789f40640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840d3210 con 0x7f17840b3190 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1789f40640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f17840b2fe0 con 0x7f17840b2c00 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f17837fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f17840b2c00 0x7f17840d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1783fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f178409b180 0x7f17840d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36518/0 (socket says 172.21.15.80:36518) 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.690+0000 7f1783fff640 1 -- 172.21.15.80:0/1342064274 learned_addr learned my addr 172.21.15.80:0/1342064274 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:24.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.691+0000 7f17837fe640 1 -- 172.21.15.80:0/1342064274 >> v1:172.21.15.87:6789/0 conn(0x7f17840b3190 legacy=0x7f178409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.691+0000 7f17837fe640 1 -- 172.21.15.80:0/1342064274 >> v1:172.21.15.80:6789/0 conn(0x7f178409b180 legacy=0x7f17840d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.691+0000 7f17837fe640 1 -- 172.21.15.80:0/1342064274 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178406d660 con 0x7f17840b2c00 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.691+0000 7f17837fe640 1 --2- 172.21.15.80:0/1342064274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17840b2c00 0x7f17840d1f70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec93f364185386d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f17827fc640 1 -- 172.21.15.80:0/1342064274 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774039070 con 0x7f17840b2c00 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f17827fc640 1 -- 172.21.15.80:0/1342064274 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177402cd00 con 0x7f17840b2c00 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f17827fc640 1 -- 172.21.15.80:0/1342064274 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774034660 con 0x7f17840b2c00 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 -- 172.21.15.80:0/1342064274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17840b2c00 msgr2=0x7f17840d1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 --2- 172.21.15.80:0/1342064274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17840b2c00 0x7f17840d1f70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177402bf50 comp rx=0 tx=0).stop 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 -- 172.21.15.80:0/1342064274 shutdown_connections 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 --2- 172.21.15.80:0/1342064274 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17840b2c00 0x7f17840d1f70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 -- 172.21.15.80:0/1342064274 >> 172.21.15.80:0/1342064274 conn(0x7f17840d2550 msgr2=0x7f17840d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 -- 172.21.15.80:0/1342064274 shutdown_connections 2024-04-16T15:36:24.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.692+0000 7f1789f40640 1 -- 172.21.15.80:0/1342064274 wait complete. 2024-04-16T15:36:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.693+0000 7f1789f40640 1 Processor -- start 2024-04-16T15:36:24.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 -- start start 2024-04-16T15:36:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17840b2c00 0x7f17841f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17840b3190 0x7f17841f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f178406dcb0 con 0x7f178409b180 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f17840d1160 con 0x7f17840b2c00 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f1789f40640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f17840d12e0 con 0x7f17840b3190 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f17837fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f17837fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36272/0 (socket says 172.21.15.80:36272) 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.694+0000 7f17837fe640 1 -- 172.21.15.80:0/1301718983 learned_addr learned my addr 172.21.15.80:0/1301718983 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f1782ffd640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17840b2c00 0x7f17841f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 -- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17840b3190 msgr2=0x7f17841f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17840b3190 0x7f17841f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 -- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17840b2c00 msgr2=0x7f17841f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17840b2c00 0x7f17841f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 -- 172.21.15.80:0/1301718983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841f8f20 con 0x7f178409b180 2024-04-16T15:36:24.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f17837fe640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1774037040 tx=0x7f1774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774039050 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774045070 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17841f9200 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177403ea50 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.695+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17841f5450 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.696+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1784068a40 con 0x7f178409b180 2024-04-16T15:36:24.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.696+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f177402cbc0 con 0x7f178409b180 2024-04-16T15:36:24.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.697+0000 7f176bfff640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 0x7f177006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.697+0000 7f1782ffd640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 0x7f177006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.697+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f17740aecd0 con 0x7f178409b180 2024-04-16T15:36:24.698 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.697+0000 7f1782ffd640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 0x7f177006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17840cb020 tx=0x7f1778009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.701+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f177407cdc0 con 0x7f178409b180 2024-04-16T15:36:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.876+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1784161fe0 con 0x7f178409b180 2024-04-16T15:36:24.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.877+0000 7f176bfff640 1 -- 172.21.15.80:0/1301718983 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f177407c6c0 con 0x7f178409b180 2024-04-16T15:36:24.876 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:24.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 msgr2=0x7f177006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 0x7f177006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f17840cb020 tx=0x7f1778009040 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 msgr2=0x7f17841f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1774037040 tx=0x7f1774004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 shutdown_connections 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f177006c8f0 0x7f177006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f17840b3190 0x7f17841f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f17840b2c00 0x7f17841f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 --2- 172.21.15.80:0/1301718983 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f178409b180 0x7f17841f86f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 >> 172.21.15.80:0/1301718983 conn(0x7f17840d2550 msgr2=0x7f178406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 shutdown_connections 2024-04-16T15:36:24.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.879+0000 7f1789f40640 1 -- 172.21.15.80:0/1301718983 wait complete. 2024-04-16T15:36:24.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:24.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.996+0000 7f59266e4640 1 Processor -- start 2024-04-16T15:36:24.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.996+0000 7f59266e4640 1 -- start start 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f59266e4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59200b39a0 0x7f592009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f59266e4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59201610b0 con 0x7f592009ba70 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f59266e4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59200b2010 con 0x7f592015fe70 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f59266e4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f59200b22f0 con 0x7f59200b39a0 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5917fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59200b39a0 0x7f592009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5924c81640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f592009ba70 0x7f59200b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36524/0 (socket says 172.21.15.80:36524) 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5924c81640 1 -- 172.21.15.80:0/2543424121 learned_addr learned my addr 172.21.15.80:0/2543424121 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5917fff640 1 -- 172.21.15.80:0/2543424121 >> v1:172.21.15.87:6789/0 conn(0x7f592015fe70 legacy=0x7f59200ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5917fff640 1 -- 172.21.15.80:0/2543424121 >> v1:172.21.15.80:6789/0 conn(0x7f592009ba70 legacy=0x7f59200b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.997+0000 7f5917fff640 1 -- 172.21.15.80:0/2543424121 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920160d80 con 0x7f59200b39a0 2024-04-16T15:36:24.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.998+0000 7f5917fff640 1 --2- 172.21.15.80:0/2543424121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59200b39a0 0x7f592009aa70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f59080097a0 tx=0x7f590802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35da24163186ee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:24.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.998+0000 7f591f7fe640 1 -- 172.21.15.80:0/2543424121 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908034070 con 0x7f59200b39a0 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.998+0000 7f591f7fe640 1 -- 172.21.15.80:0/2543424121 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5908030610 con 0x7f59200b39a0 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.998+0000 7f591f7fe640 1 -- 172.21.15.80:0/2543424121 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080309e0 con 0x7f59200b39a0 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 -- 172.21.15.80:0/2543424121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59200b39a0 msgr2=0x7f592009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 --2- 172.21.15.80:0/2543424121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59200b39a0 0x7f592009aa70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f59080097a0 tx=0x7f590802b960 comp rx=0 tx=0).stop 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 -- 172.21.15.80:0/2543424121 shutdown_connections 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 --2- 172.21.15.80:0/2543424121 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59200b39a0 0x7f592009aa70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 -- 172.21.15.80:0/2543424121 >> 172.21.15.80:0/2543424121 conn(0x7f59200d2550 msgr2=0x7f59200d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 -- 172.21.15.80:0/2543424121 shutdown_connections 2024-04-16T15:36:24.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:24.999+0000 7f59266e4640 1 -- 172.21.15.80:0/2543424121 wait complete. 2024-04-16T15:36:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.000+0000 7f59266e4640 1 Processor -- start 2024-04-16T15:36:25.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.000+0000 7f59266e4640 1 -- start start 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59200b39a0 0x7f59200c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592015fe70 0x7f5920148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f592009b870 con 0x7f592009ba70 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f592009b6f0 con 0x7f59200b39a0 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f59266e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f59200b2f20 con 0x7f592015fe70 2024-04-16T15:36:25.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36284/0 (socket says 172.21.15.80:36284) 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 -- 172.21.15.80:0/2491098675 learned_addr learned my addr 172.21.15.80:0/2491098675 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f5917fff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59200b39a0 0x7f59200c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f5924c81640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592015fe70 0x7f5920148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 -- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592015fe70 msgr2=0x7f5920148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592015fe70 0x7f5920148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 -- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59200b39a0 msgr2=0x7f59200c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59200b39a0 0x7f59200c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 -- 172.21.15.80:0/2491098675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59200cb620 con 0x7f592009ba70 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.001+0000 7f591ffff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f591000c3c0 tx=0x7f591000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.002+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100052d0 con 0x7f592009ba70 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.002+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910005490 con 0x7f592009ba70 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.002+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59200cb900 con 0x7f592009ba70 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.002+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910007260 con 0x7f592009ba70 2024-04-16T15:36:25.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.002+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59200cbec0 con 0x7f592009ba70 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.003+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5920068a40 con 0x7f592009ba70 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.003+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5910007400 con 0x7f592009ba70 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.004+0000 7f591d7fa640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 0x7f590006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.004+0000 7f5917fff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 0x7f590006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.004+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f591008b300 con 0x7f592009ba70 2024-04-16T15:36:25.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.004+0000 7f5917fff640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 0x7f590006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5908036000 tx=0x7f590803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.008+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5910059480 con 0x7f592009ba70 2024-04-16T15:36:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.184+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f592015f570 con 0x7f592009ba70 2024-04-16T15:36:25.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.185+0000 7f591d7fa640 1 -- 172.21.15.80:0/2491098675 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f5910058d80 con 0x7f592009ba70 2024-04-16T15:36:25.184 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 msgr2=0x7f590006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 0x7f590006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5908036000 tx=0x7f590803b040 comp rx=0 tx=0).stop 2024-04-16T15:36:25.186 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 msgr2=0x7f592015ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f591000c3c0 tx=0x7f591000c880 comp rx=0 tx=0).stop 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 shutdown_connections 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f590006c8f0 0x7f590006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f592015fe70 0x7f5920148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59200b39a0 0x7f59200c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 --2- 172.21.15.80:0/2491098675 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f592009ba70 0x7f592015ed50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 >> 172.21.15.80:0/2491098675 conn(0x7f59200d2550 msgr2=0x7f59200d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 shutdown_connections 2024-04-16T15:36:25.187 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.187+0000 7f59266e4640 1 -- 172.21.15.80:0/2491098675 wait complete. 2024-04-16T15:36:25.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:25.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.302+0000 7f2f5e9c8640 1 Processor -- start 2024-04-16T15:36:25.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.302+0000 7f2f5e9c8640 1 -- start start 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5e9c8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f580ca770 0x7f2f5806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5e9c8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f580b4010 con 0x7f2f5815eaa0 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5e9c8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f580cf100 con 0x7f2f580d1010 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5e9c8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2f580b3800 con 0x7f2f580ca770 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5cf65640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2f5815eaa0 0x7f2f580ae360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36540/0 (socket says 172.21.15.80:36540) 2024-04-16T15:36:25.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f5cf65640 1 -- 172.21.15.80:0/2284588220 learned_addr learned my addr 172.21.15.80:0/2284588220 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f57fff640 1 --2- 172.21.15.80:0/2284588220 >> v2:172.21.15.87:3300/0 conn(0x7f2f580ca770 0x7f2f5806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188323833 0 0) 0x7f2f580b4010 con 0x7f2f5815eaa0 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.303+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f40003520 con 0x7f2f5815eaa0 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.304+0000 7f2f57fff640 1 -- 172.21.15.80:0/2284588220 >> v1:172.21.15.87:6789/0 conn(0x7f2f580d1010 legacy=0x7f2f580cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.304+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2896372965 0 0) 0x7f2f40003520 con 0x7f2f5815eaa0 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.304+0000 7f2f57fff640 1 -- 172.21.15.80:0/2284588220 >> v1:172.21.15.80:6789/0 conn(0x7f2f5815eaa0 legacy=0x7f2f580ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.304+0000 7f2f57fff640 1 -- 172.21.15.80:0/2284588220 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f580b3a50 con 0x7f2f580ca770 2024-04-16T15:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.304+0000 7f2f57fff640 1 --2- 172.21.15.80:0/2284588220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f5806c3b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cf2d0 tx=0x7f2f4802b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d9cbabe62e38b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48037070 con 0x7f2f580ca770 2024-04-16T15:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f48030510 con 0x7f2f580ca770 2024-04-16T15:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f56ffd640 1 -- 172.21.15.80:0/2284588220 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f500019f0 con 0x7f2f580ca770 2024-04-16T15:36:25.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/2284588220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 msgr2=0x7f2f5806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/2284588220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f5806c3b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2f580cf2d0 tx=0x7f2f4802b680 comp rx=0 tx=0).stop 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/2284588220 shutdown_connections 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/2284588220 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f5806c3b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/2284588220 >> 172.21.15.80:0/2284588220 conn(0x7f2f5809aa70 msgr2=0x7f2f580b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/2284588220 shutdown_connections 2024-04-16T15:36:25.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.305+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/2284588220 wait complete. 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.306+0000 7f2f5e9c8640 1 Processor -- start 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 -- start start 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f580cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815eaa0 0x7f2f580cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580cf3a0 con 0x7f2f580d1010 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5806c8f0 con 0x7f2f580ca770 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f5e9c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2f580aea70 con 0x7f2f5815eaa0 2024-04-16T15:36:25.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36296/0 (socket says 172.21.15.80:36296) 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.307+0000 7f2f577fe640 1 -- 172.21.15.80:0/1170092576 learned_addr learned my addr 172.21.15.80:0/1170092576 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f57fff640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f580cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 -- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815eaa0 msgr2=0x7f2f580cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f5cf65640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815eaa0 0x7f2f580cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815eaa0 0x7f2f580cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 -- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 msgr2=0x7f2f580cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f580cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 -- 172.21.15.80:0/1170092576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f580ccdb0 con 0x7f2f580d1010 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f57fff640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f580cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f577fe640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c780 tx=0x7f2f4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c017070 con 0x7f2f580d1010 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c005270 con 0x7f2f580d1010 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00a860 con 0x7f2f580d1010 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f580cbed0 con 0x7f2f580d1010 2024-04-16T15:36:25.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.308+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f580cc480 con 0x7f2f580d1010 2024-04-16T15:36:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.309+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f58068a40 con 0x7f2f580d1010 2024-04-16T15:36:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.309+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f4c01a070 con 0x7f2f580d1010 2024-04-16T15:36:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.310+0000 7f2f54ff9640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 0x7f2f4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.310+0000 7f2f57fff640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 0x7f2f4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.310+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2f4c08b310 con 0x7f2f580d1010 2024-04-16T15:36:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.310+0000 7f2f57fff640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 0x7f2f4406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f48034000 tx=0x7f2f48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.314+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f4c059490 con 0x7f2f580d1010 2024-04-16T15:36:25.490 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.491+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f580d07c0 con 0x7f2f580d1010 2024-04-16T15:36:25.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.492+0000 7f2f54ff9640 1 -- 172.21.15.80:0/1170092576 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7f2f4c058d90 con 0x7f2f580d1010 2024-04-16T15:36:25.491 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:25.492 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:25.493 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 msgr2=0x7f2f4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 0x7f2f4406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f48034000 tx=0x7f2f48008030 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 msgr2=0x7f2f58151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c780 tx=0x7f2f4c00cc40 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 shutdown_connections 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2f4406c8f0 0x7f2f4406edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2f5815eaa0 0x7f2f580cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2f580d1010 0x7f2f58151fd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 --2- 172.21.15.80:0/1170092576 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f580ca770 0x7f2f580cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 >> 172.21.15.80:0/1170092576 conn(0x7f2f5809aa70 msgr2=0x7f2f580b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 shutdown_connections 2024-04-16T15:36:25.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.494+0000 7f2f5e9c8640 1 -- 172.21.15.80:0/1170092576 wait complete. 2024-04-16T15:36:25.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:25.505 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:25.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.611+0000 7f720ad11640 1 Processor -- start 2024-04-16T15:36:25.611 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.611+0000 7f720ad11640 1 -- start start 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f720ad11640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f720406f650 0x7f72040cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f720ad11640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f72040cd820 0x7f720415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f720ad11640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720415bd50 con 0x7f7204145020 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f720ad11640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f720415c030 con 0x7f720406f650 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f720ad11640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f720415c310 con 0x7f72040cd820 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7203fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f720406f650 0x7f72040cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7208aad640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7204145020 0x7f720406ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36554/0 (socket says 172.21.15.80:36554) 2024-04-16T15:36:25.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7208aad640 1 -- 172.21.15.80:0/75422298 learned_addr learned my addr 172.21.15.80:0/75422298 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f72092ae640 1 --2- 172.21.15.80:0/75422298 >> v2:172.21.15.87:3300/0 conn(0x7f72040cd820 0x7f720415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7203fff640 1 -- 172.21.15.80:0/75422298 >> v2:172.21.15.87:3300/0 conn(0x7f72040cd820 msgr2=0x7f720415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7203fff640 1 --2- 172.21.15.80:0/75422298 >> v2:172.21.15.87:3300/0 conn(0x7f72040cd820 0x7f720415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7203fff640 1 -- 172.21.15.80:0/75422298 >> v1:172.21.15.80:6789/0 conn(0x7f7204145020 legacy=0x7f720406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.612+0000 7f7203fff640 1 -- 172.21.15.80:0/75422298 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720415c5f0 con 0x7f720406f650 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.613+0000 7f7203fff640 1 --2- 172.21.15.80:0/75422298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720406f650 0x7f72040cd2e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7204071c20 tx=0x7f71f402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a2a96569b5443a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.613+0000 7f72037fe640 1 -- 172.21.15.80:0/75422298 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4039070 con 0x7f720406f650 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.613+0000 7f72037fe640 1 -- 172.21.15.80:0/75422298 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f402cc80 con 0x7f720406f650 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.613+0000 7f72037fe640 1 -- 172.21.15.80:0/75422298 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4034660 con 0x7f720406f650 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 -- 172.21.15.80:0/75422298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720406f650 msgr2=0x7f72040cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 --2- 172.21.15.80:0/75422298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720406f650 0x7f72040cd2e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7204071c20 tx=0x7f71f402bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 -- 172.21.15.80:0/75422298 shutdown_connections 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 --2- 172.21.15.80:0/75422298 >> v2:172.21.15.87:3300/0 conn(0x7f72040cd820 0x7f720415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 --2- 172.21.15.80:0/75422298 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f720406f650 0x7f72040cd2e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 -- 172.21.15.80:0/75422298 >> 172.21.15.80:0/75422298 conn(0x7f7204067d90 msgr2=0x7f720406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 -- 172.21.15.80:0/75422298 shutdown_connections 2024-04-16T15:36:25.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.614+0000 7f720ad11640 1 -- 172.21.15.80:0/75422298 wait complete. 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.615+0000 7f720ad11640 1 Processor -- start 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.615+0000 7f720ad11640 1 -- start start 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f720406f650 0x7f7204157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 0x7f72040b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f72040b3f90 con 0x7f72040cd820 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72040b3e10 con 0x7f720406f650 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f720ad11640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f720415f770 con 0x7f7204145020 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36310/0 (socket says 172.21.15.80:36310) 2024-04-16T15:36:25.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 -- 172.21.15.80:0/2678659178 learned_addr learned my addr 172.21.15.80:0/2678659178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7208aad640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f720406f650 0x7f7204157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f72092ae640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 0x7f72040b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 -- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 msgr2=0x7f72040b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 0x7f72040b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 -- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f720406f650 msgr2=0x7f7204157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f720406f650 0x7f7204157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f7203fff640 1 -- 172.21.15.80:0/2678659178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7204140710 con 0x7f72040cd820 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.616+0000 7f72092ae640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 0x7f72040b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f7203fff640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71f4037040 tx=0x7f71f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4039050 con 0x7f72040cd820 2024-04-16T15:36:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f4045070 con 0x7f72040cd820 2024-04-16T15:36:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72041409f0 con 0x7f72040cd820 2024-04-16T15:36:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f403e850 con 0x7f72040cd820 2024-04-16T15:36:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.617+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7204140fb0 con 0x7f72040cd820 2024-04-16T15:36:25.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.618+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7204068a40 con 0x7f72040cd820 2024-04-16T15:36:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.618+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71f403e9f0 con 0x7f72040cd820 2024-04-16T15:36:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.619+0000 7f72017fa640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 0x7f71e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.619+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f71f40aeb50 con 0x7f72040cd820 2024-04-16T15:36:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.619+0000 7f7208aad640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 0x7f71e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.619+0000 7f7208aad640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 0x7f71e406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f720413ba70 tx=0x7f71fc007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.623+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71f407cdf0 con 0x7f72040cd820 2024-04-16T15:36:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.797+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7204141b90 con 0x7f72040cd820 2024-04-16T15:36:25.796 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.797+0000 7f72017fa640 1 -- 172.21.15.80:0/2678659178 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f71f407c6f0 con 0x7f72040cd820 2024-04-16T15:36:25.797 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 msgr2=0x7f71e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 0x7f71e406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f720413ba70 tx=0x7f71fc007e80 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 msgr2=0x7f72040b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f71f4037040 tx=0x7f71f4004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 shutdown_connections 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f71e406c8f0 0x7f71e406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7204145020 0x7f72040b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f72040cd820 0x7f72040b4810 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 --2- 172.21.15.80:0/2678659178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f720406f650 0x7f7204157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 >> 172.21.15.80:0/2678659178 conn(0x7f7204067d90 msgr2=0x7f72040af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 shutdown_connections 2024-04-16T15:36:25.799 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.799+0000 7f720ad11640 1 -- 172.21.15.80:0/2678659178 wait complete. 2024-04-16T15:36:25.810 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:25.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.917+0000 7fb9bde74640 1 Processor -- start 2024-04-16T15:36:25.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.917+0000 7fb9bde74640 1 -- start start 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9bde74640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 0x7fb9b80d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9bde74640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9b80d1bc0 0x7fb9b80d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9bde74640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b815eb80 con 0x7fb9b815e7a0 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9bde74640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b80d2030 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9bde74640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b80d32a0 con 0x7fb9b80b3870 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9b80d1bc0 0x7fb9b80d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb9b80d1bc0 0x7fb9b80d4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36322/0 (socket says 172.21.15.80:36322) 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 -- 172.21.15.80:0/955354207 learned_addr learned my addr 172.21.15.80:0/955354207 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 -- 172.21.15.80:0/955354207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 msgr2=0x7fb9b80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:25.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 0x7fb9b80d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 0x7fb9b80d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 -- 172.21.15.80:0/955354207 >> v1:172.21.15.87:6789/0 conn(0x7fb9b815e7a0 legacy=0x7fb9b80cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b7fff640 1 -- 172.21.15.80:0/955354207 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b80d3580 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.918+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 0x7fb9b80d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.919+0000 7fb9b7fff640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80d4340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009e50 tx=0x7fb9b002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b056fc357ed20a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.919+0000 7fb9b67fc640 1 -- 172.21.15.80:0/955354207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b002cb00 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.919+0000 7fb9b67fc640 1 -- 172.21.15.80:0/955354207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b002cca0 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.919+0000 7fb9b67fc640 1 -- 172.21.15.80:0/955354207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0034610 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 -- 172.21.15.80:0/955354207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80d1bc0 msgr2=0x7fb9b80d4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80d4340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009e50 tx=0x7fb9b002bf60 comp rx=0 tx=0).stop 2024-04-16T15:36:25.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 -- 172.21.15.80:0/955354207 shutdown_connections 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80d4340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 --2- 172.21.15.80:0/955354207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b80b3870 0x7fb9b80d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 -- 172.21.15.80:0/955354207 >> 172.21.15.80:0/955354207 conn(0x7fb9b80734f0 msgr2=0x7fb9b8073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 -- 172.21.15.80:0/955354207 shutdown_connections 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.920+0000 7fb9bde74640 1 -- 172.21.15.80:0/955354207 wait complete. 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.921+0000 7fb9bde74640 1 Processor -- start 2024-04-16T15:36:25.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.921+0000 7fb9bde74640 1 -- start start 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b815e7a0 0x7fb9b814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b80d3e20 con 0x7fb9b80b3870 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b80d3b40 con 0x7fb9b80d1bc0 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b80b7720 con 0x7fb9b815e7a0 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36332/0 (socket says 172.21.15.80:36332) 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 -- 172.21.15.80:0/1792208783 learned_addr learned my addr 172.21.15.80:0/1792208783 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:25.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b7fff640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b815e7a0 0x7fb9b814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 -- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b815e7a0 msgr2=0x7fb9b814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b815e7a0 0x7fb9b814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 -- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 msgr2=0x7fb9b80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 -- 172.21.15.80:0/1792208783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b80abde0 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9b77fe640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c3c0 tx=0x7fb9a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80052d0 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8005490 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b80ac0c0 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.922+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8007260 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.923+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b80ac680 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.923+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b8068a40 con 0x7fb9b80b3870 2024-04-16T15:36:25.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.924+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9a8007400 con 0x7fb9b80b3870 2024-04-16T15:36:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.924+0000 7fb9affff640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 0x7fb99806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.924+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb9a808b340 con 0x7fb9b80b3870 2024-04-16T15:36:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.924+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 0x7fb99806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:25.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.925+0000 7fb9b6ffd640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 0x7fb99806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:25.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:25.929+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9a8059440 con 0x7fb9b80b3870 2024-04-16T15:36:26.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.104+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb9b80cb010 con 0x7fb9b80b3870 2024-04-16T15:36:26.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.104+0000 7fb9affff640 1 -- 172.21.15.80:0/1792208783 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fb9a8058d40 con 0x7fb9b80b3870 2024-04-16T15:36:26.104 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 msgr2=0x7fb99806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 0x7fb99806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).stop 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 msgr2=0x7fb9b80cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c3c0 tx=0x7fb9a800c880 comp rx=0 tx=0).stop 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 shutdown_connections 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb99806c8f0 0x7fb99806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb9b815e7a0 0x7fb9b814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.106 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9b80d1bc0 0x7fb9b80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 --2- 172.21.15.80:0/1792208783 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb9b80b3870 0x7fb9b80cf640 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 >> 172.21.15.80:0/1792208783 conn(0x7fb9b80734f0 msgr2=0x7fb9b8161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 shutdown_connections 2024-04-16T15:36:26.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.106+0000 7fb9bde74640 1 -- 172.21.15.80:0/1792208783 wait complete. 2024-04-16T15:36:26.117 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:26.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.223+0000 7fa42d71c640 1 Processor -- start 2024-04-16T15:36:26.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.223+0000 7fa42d71c640 1 -- start start 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa42d71c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4280d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa42d71c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4280cfd90 con 0x7fa428161f20 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa42d71c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4280d0050 con 0x7fa4280b74e0 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa42d71c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa4280d0330 con 0x7fa4280d1700 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa426ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa428161f20 0x7fa4280cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36570/0 (socket says 172.21.15.80:36570) 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa426ffd640 1 -- 172.21.15.80:0/2558487291 learned_addr learned my addr 172.21.15.80:0/2558487291 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa4277fe640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4280d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100567441 0 0) 0x7fa4280cfd90 con 0x7fa428161f20 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.224+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa414003520 con 0x7fa428161f20 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 75907496 0 0) 0x7fa414003520 con 0x7fa428161f20 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 msgr2=0x7fa4280d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4280d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 >> v1:172.21.15.87:6789/0 conn(0x7fa4280b74e0 legacy=0x7fa4280d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4280d0610 con 0x7fa428161f20 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fa418001670 con 0x7fa428161f20 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 >> v1:172.21.15.80:6789/0 conn(0x7fa428161f20 legacy=0x7fa4280cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa414003f20 0x7fa414004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa414004d40 0x7fa4140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4280d0330 con 0x7fa414003f20 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa41400ba20 con 0x7fa414004d40 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa41400bc20 con 0x7fa4280d1700 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa414003f20 0x7fa414004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa426ffd640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4277fe640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa414004d40 0x7fa4140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 -- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 msgr2=0x7fa4140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4280d1700 0x7fa4140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 -- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa414004d40 msgr2=0x7fa4140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa414004d40 0x7fa4140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa41e7fc640 1 -- 172.21.15.80:0/2558487291 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa414003520 con 0x7fa414003f20 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.225+0000 7fa4277fe640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa414004d40 0x7fa4140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa414003f20 0x7fa414004800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa410001910 tx=0x7fa414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c1fe861d537e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410037070 con 0x7fa414003f20 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410032600 con 0x7fa414003f20 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa4267fc640 1 -- 172.21.15.80:0/2558487291 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4100014e0 con 0x7fa414003f20 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa42d71c640 1 -- 172.21.15.80:0/2558487291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa414003f20 msgr2=0x7fa414004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa42d71c640 1 --2- 172.21.15.80:0/2558487291 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa414003f20 0x7fa414004800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa410001910 tx=0x7fa414005830 comp rx=0 tx=0).stop 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.226+0000 7fa4277fe640 1 -- 172.21.15.80:0/2558487291 reap_dead start 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.227+0000 7fa42d71c640 1 -- 172.21.15.80:0/2558487291 shutdown_connections 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.227+0000 7fa42d71c640 1 -- 172.21.15.80:0/2558487291 >> 172.21.15.80:0/2558487291 conn(0x7fa42808c000 msgr2=0x7fa4280d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.227+0000 7fa42d71c640 1 -- 172.21.15.80:0/2558487291 shutdown_connections 2024-04-16T15:36:26.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.227+0000 7fa42d71c640 1 -- 172.21.15.80:0/2558487291 wait complete. 2024-04-16T15:36:26.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.228+0000 7fa42d71c640 1 Processor -- start 2024-04-16T15:36:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.228+0000 7fa42d71c640 1 -- start start 2024-04-16T15:36:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa414003f20 0x7fa4281f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 0x7fa4281544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4280cf940 con 0x7fa4281549f0 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa4280b5730 con 0x7fa428153b90 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa4280cfac0 con 0x7fa414003f20 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36350/0 (socket says 172.21.15.80:36350) 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 -- 172.21.15.80:0/1676516593 learned_addr learned my addr 172.21.15.80:0/1676516593 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa426ffd640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa414003f20 0x7fa4281f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 0x7fa4281544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 -- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa414003f20 msgr2=0x7fa4281f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa414003f20 0x7fa4281f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 -- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 msgr2=0x7fa4281544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 0x7fa4281544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 -- 172.21.15.80:0/1676516593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa428160060 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa41e7fc640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 0x7fa4281544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa4277fe640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4280d2210 tx=0x7fa420010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420010e00 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420003990 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4280c9460 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420003d80 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.229+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4280c9a20 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.230+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa428068a40 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.231+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa420005d10 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.231+0000 7fa41ffff640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 0x7fa40806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.231+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa42008c560 con 0x7fa4281549f0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.231+0000 7fa426ffd640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 0x7fa40806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.232+0000 7fa426ffd640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 0x7fa40806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa418007d00 tx=0x7fa418001bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.236+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa420025020 con 0x7fa4281549f0 2024-04-16T15:36:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.411+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4280c9bf0 con 0x7fa4281549f0 2024-04-16T15:36:26.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.411+0000 7fa41ffff640 1 -- 172.21.15.80:0/1676516593 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fa42005a650 con 0x7fa4281549f0 2024-04-16T15:36:26.411 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 msgr2=0x7fa40806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 0x7fa40806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa418007d00 tx=0x7fa418001bb0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 msgr2=0x7fa42815f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4280d2210 tx=0x7fa420010590 comp rx=0 tx=0).stop 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 shutdown_connections 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4281549f0 0x7fa42815f410 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa428153b90 0x7fa4281544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa40806c8f0 0x7fa40806edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 --2- 172.21.15.80:0/1676516593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa414003f20 0x7fa4281f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 >> 172.21.15.80:0/1676516593 conn(0x7fa42808c000 msgr2=0x7fa4280b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 shutdown_connections 2024-04-16T15:36:26.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.413+0000 7fa42d71c640 1 -- 172.21.15.80:0/1676516593 wait complete. 2024-04-16T15:36:26.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:26.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.530+0000 7f6a42ad9640 1 Processor -- start 2024-04-16T15:36:26.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.531+0000 7f6a42ad9640 1 -- start start 2024-04-16T15:36:26.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.531+0000 7f6a42ad9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a3c0b3ac0 0x7f6a3c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.531+0000 7f6a42ad9640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c15a680 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.531+0000 7f6a42ad9640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a3c0cd3f0 con 0x7f6a3c0c4ac0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.531+0000 7f6a42ad9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3c0cdc90 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a41076640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a3c0b3ac0 0x7f6a3c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a40875640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a3c15a2a0 0x7f6a3c15cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36580/0 (socket says 172.21.15.80:36580) 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a40875640 1 -- 172.21.15.80:0/4285809051 learned_addr learned my addr 172.21.15.80:0/4285809051 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a41076640 1 -- 172.21.15.80:0/4285809051 >> v1:172.21.15.87:6789/0 conn(0x7f6a3c0c4ac0 legacy=0x7f6a3c1608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a41076640 1 -- 172.21.15.80:0/4285809051 >> v1:172.21.15.80:6789/0 conn(0x7f6a3c15a2a0 legacy=0x7f6a3c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a41076640 1 -- 172.21.15.80:0/4285809051 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c0cd6d0 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.532+0000 7f6a3b7fe640 1 -- 172.21.15.80:0/4285809051 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654873531 0 0) 0x7f6a3c15a680 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a41076640 1 --2- 172.21.15.80:0/4285809051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c06b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6a340097a0 tx=0x7f6a3402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342fe6ce18f4da60 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a3b7fe640 1 -- 172.21.15.80:0/4285809051 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3402f810 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a3b7fe640 1 -- 172.21.15.80:0/4285809051 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3402f9b0 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a3b7fe640 1 -- 172.21.15.80:0/4285809051 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3402fd80 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 -- 172.21.15.80:0/4285809051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c0b3ac0 msgr2=0x7f6a3c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/4285809051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c06b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6a340097a0 tx=0x7f6a3402b9f0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 -- 172.21.15.80:0/4285809051 shutdown_connections 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/4285809051 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c06b9a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 -- 172.21.15.80:0/4285809051 >> 172.21.15.80:0/4285809051 conn(0x7f6a3c0b2fa0 msgr2=0x7f6a3c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 -- 172.21.15.80:0/4285809051 shutdown_connections 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.533+0000 7f6a42ad9640 1 -- 172.21.15.80:0/4285809051 wait complete. 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.534+0000 7f6a42ad9640 1 Processor -- start 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.534+0000 7f6a42ad9640 1 -- start start 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a3c0c4ac0 0x7f6a3c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c0cd1b0 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c0cd030 con 0x7f6a3c0b3ac0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a42ad9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c15d380 con 0x7f6a3c0c4ac0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a41076640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a41076640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36368/0 (socket says 172.21.15.80:36368) 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.535+0000 7f6a41076640 1 -- 172.21.15.80:0/1150162283 learned_addr learned my addr 172.21.15.80:0/1150162283 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a3bfff640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a3c0c4ac0 0x7f6a3c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a40875640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 -- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a3c0c4ac0 msgr2=0x7f6a3c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a3c0c4ac0 0x7f6a3c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 -- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c0b3ac0 msgr2=0x7f6a3c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 -- 172.21.15.80:0/1150162283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c0c5b40 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a41076640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098c0 tx=0x7f6a34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34047070 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a34037bc0 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c0c7760 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3402fe60 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.536+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c0c7d20 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.537+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c069150 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.538+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a3404a070 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.538+0000 7f6a397fa640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 0x7f6a1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.538+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6a340adc90 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.538+0000 7f6a40875640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 0x7f6a1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.539+0000 7f6a40875640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 0x7f6a1c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0012e0 tx=0x7f6a2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.542+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a34033030 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.718+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6a3c0b1570 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.717 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.718+0000 7f6a397fa640 1 -- 172.21.15.80:0/1150162283 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f6a3402f860 con 0x7f6a3c15a2a0 2024-04-16T15:36:26.718 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:26.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 msgr2=0x7f6a1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 0x7f6a1c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0012e0 tx=0x7f6a2c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:26.719 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 msgr2=0x7f6a3c0c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098c0 tx=0x7f6a34004730 comp rx=0 tx=0).stop 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 shutdown_connections 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a3c15a2a0 0x7f6a3c0c5600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a1c06c8f0 0x7f6a1c06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a3c0c4ac0 0x7f6a3c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 --2- 172.21.15.80:0/1150162283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a3c0b3ac0 0x7f6a3c0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 >> 172.21.15.80:0/1150162283 conn(0x7f6a3c0b2fa0 msgr2=0x7f6a3c15f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 shutdown_connections 2024-04-16T15:36:26.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.720+0000 7f6a42ad9640 1 -- 172.21.15.80:0/1150162283 wait complete. 2024-04-16T15:36:26.731 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:26.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.834+0000 7fe830738640 1 Processor -- start 2024-04-16T15:36:26.834 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.834+0000 7fe830738640 1 -- start start 2024-04-16T15:36:26.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe830738640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe8280cd260 0x7fe828169820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe830738640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8280d1910 con 0x7fe8280d1170 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe830738640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82806cd00 con 0x7fe82815e930 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe830738640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe82806cab0 con 0x7fe8280cd260 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe82dcd3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe8280d1170 0x7fe8280ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36592/0 (socket says 172.21.15.80:36592) 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.835+0000 7fe82dcd3640 1 -- 172.21.15.80:0/3984320674 learned_addr learned my addr 172.21.15.80:0/3984320674 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82ecd5640 1 --2- 172.21.15.80:0/3984320674 >> v2:172.21.15.87:3300/0 conn(0x7fe8280cd260 0x7fe828169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301451148 0 0) 0x7fe8280d1910 con 0x7fe8280d1170 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe810003520 con 0x7fe8280d1170 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3852943258 0 0) 0x7fe810003520 con 0x7fe8280d1170 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 >> v2:172.21.15.87:3300/0 conn(0x7fe8280cd260 msgr2=0x7fe828169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 --2- 172.21.15.80:0/3984320674 >> v2:172.21.15.87:3300/0 conn(0x7fe8280cd260 0x7fe828169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 >> v1:172.21.15.87:6789/0 conn(0x7fe82815e930 legacy=0x7fe82806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82806cfe0 con 0x7fe8280d1170 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fe81c001670 con 0x7fe8280d1170 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 >> v1:172.21.15.80:6789/0 conn(0x7fe8280d1170 legacy=0x7fe8280ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 0x7fe810003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe810004800 0x7fe810004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8100051c0 0x7fe81000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe82806cab0 con 0x7fe8100039b0 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe81000c060 con 0x7fe8100051c0 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe81000c260 con 0x7fe810004800 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 0x7fe810003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82ecd5640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8100051c0 0x7fe81000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82dcd3640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe810004800 0x7fe810004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 -- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe810004800 msgr2=0x7fe810004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe810004800 0x7fe810004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 -- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8100051c0 msgr2=0x7fe81000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8100051c0 0x7fe81000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82e4d4640 1 -- 172.21.15.80:0/3984320674 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810003520 con 0x7fe8100039b0 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82ecd5640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8100051c0 0x7fe81000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.836+0000 7fe82ecd5640 1 -- 172.21.15.80:0/3984320674 reap_dead start 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.837+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 0x7fe810003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe818001e50 tx=0x7fe810005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81a6c7f9d2c5b92 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.837+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818001a70 con 0x7fe8100039b0 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.837+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe818003b70 con 0x7fe8100039b0 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.837+0000 7fe82d4d2640 1 -- 172.21.15.80:0/3984320674 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8180050d0 con 0x7fe8100039b0 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 -- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 msgr2=0x7fe810003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 0x7fe810003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe818001e50 tx=0x7fe810005830 comp rx=0 tx=0).stop 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 -- 172.21.15.80:0/3984320674 shutdown_connections 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 --2- 172.21.15.80:0/3984320674 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8100039b0 0x7fe810003dd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 -- 172.21.15.80:0/3984320674 >> 172.21.15.80:0/3984320674 conn(0x7fe8280d2500 msgr2=0x7fe8280d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 -- 172.21.15.80:0/3984320674 shutdown_connections 2024-04-16T15:36:26.840 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.838+0000 7fe830738640 1 -- 172.21.15.80:0/3984320674 wait complete. 2024-04-16T15:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.839+0000 7fe830738640 1 Processor -- start 2024-04-16T15:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.839+0000 7fe830738640 1 -- start start 2024-04-16T15:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 0x7fe8280b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 0x7fe8280c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8280d15d0 con 0x7fe8280b50b0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe82815ed10 con 0x7fe828161b00 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe8280ccb50 con 0x7fe8100039b0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36386/0 (socket says 172.21.15.80:36386) 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 -- 172.21.15.80:0/584163045 learned_addr learned my addr 172.21.15.80:0/584163045 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 0x7fe8280b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82ecd5640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 0x7fe8280c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 -- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 msgr2=0x7fe8280b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 0x7fe8280b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 -- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 msgr2=0x7fe8280c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 0x7fe8280c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 -- 172.21.15.80:0/584163045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8280c7430 con 0x7fe8280b50b0 2024-04-16T15:36:26.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 0x7fe8280b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82ecd5640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 0x7fe8280c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe82dcd3640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e800 tx=0x7fe81c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00c870 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c018070 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8280c7710 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.840+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00cc30 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.841+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8280c7cd0 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.842+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe828069150 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.842+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe81c01d460 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.842+0000 7fe826ffd640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 0x7fe81406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.843+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe81c08be70 con 0x7fe8280b50b0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.843+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 0x7fe81406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:26.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.843+0000 7fe82e4d4640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 0x7fe81406ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe818034000 tx=0x7fe818009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:26.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:26.847+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe81c059ed0 con 0x7fe8280b50b0 2024-04-16T15:36:27.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.027+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8280b1c80 con 0x7fe8280b50b0 2024-04-16T15:36:27.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.028+0000 7fe826ffd640 1 -- 172.21.15.80:0/584163045 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18454 (secure 0 0 0) 0x7fe81c0597d0 con 0x7fe8280b50b0 2024-04-16T15:36:27.028 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:27.028 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":25,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:35:53.924636+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 msgr2=0x7fe81406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 0x7fe81406ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe818034000 tx=0x7fe818009030 comp rx=0 tx=0).stop 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 msgr2=0x7fe8281615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e800 tx=0x7fe81c00ecc0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 shutdown_connections 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe828161b00 0x7fe8280c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe8280b50b0 0x7fe8281615c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe81406c920 0x7fe81406ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 --2- 172.21.15.80:0/584163045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8100039b0 0x7fe8280b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 >> 172.21.15.80:0/584163045 conn(0x7fe8280d2500 msgr2=0x7fe8280cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 shutdown_connections 2024-04-16T15:36:27.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.030+0000 7fe830738640 1 -- 172.21.15.80:0/584163045 wait complete. 2024-04-16T15:36:27.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:27.041 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:27.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.148+0000 7f35b2374640 1 Processor -- start 2024-04-16T15:36:27.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.148+0000 7f35b2374640 1 -- start start 2024-04-16T15:36:27.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35b2374640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35ac161f20 0x7f35ac0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35b2374640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 0x7f35ac0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35b2374640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac0cfd90 con 0x7f35ac0b74e0 2024-04-16T15:36:27.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35b2374640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac0d0050 con 0x7f35ac161f20 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35b2374640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac0d0330 con 0x7f35ac0d1700 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35abfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35ac161f20 0x7f35ac0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35abfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35ac161f20 0x7f35ac0cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36402/0 (socket says 172.21.15.80:36402) 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35abfff640 1 -- 172.21.15.80:0/4218823077 learned_addr learned my addr 172.21.15.80:0/4218823077 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.149+0000 7f35abfff640 1 -- 172.21.15.80:0/4218823077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 msgr2=0x7f35ac0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35b0911640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 0x7f35ac0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35abfff640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 0x7f35ac0cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35abfff640 1 -- 172.21.15.80:0/4218823077 >> v1:172.21.15.87:6789/0 conn(0x7f35ac0b74e0 legacy=0x7f35ac0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35abfff640 1 -- 172.21.15.80:0/4218823077 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac0d0610 con 0x7f35ac161f20 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35b0911640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 0x7f35ac0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:27.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.150+0000 7f35abfff640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac161f20 0x7f35ac0cf230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f359c009870 tx=0x7f359c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc894ebd4313911 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35aaffd640 1 -- 172.21.15.80:0/4218823077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c034070 con 0x7f35ac161f20 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35aaffd640 1 -- 172.21.15.80:0/4218823077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c030840 con 0x7f35ac161f20 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35aaffd640 1 -- 172.21.15.80:0/4218823077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c030c10 con 0x7f35ac161f20 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 -- 172.21.15.80:0/4218823077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac161f20 msgr2=0x7f35ac0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac161f20 0x7f35ac0cf230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f359c009870 tx=0x7f359c02b980 comp rx=0 tx=0).stop 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 -- 172.21.15.80:0/4218823077 shutdown_connections 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0d1700 0x7f35ac0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 --2- 172.21.15.80:0/4218823077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac161f20 0x7f35ac0cf230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 -- 172.21.15.80:0/4218823077 >> 172.21.15.80:0/4218823077 conn(0x7f35ac08c000 msgr2=0x7f35ac0d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 -- 172.21.15.80:0/4218823077 shutdown_connections 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.151+0000 7f35b2374640 1 -- 172.21.15.80:0/4218823077 wait complete. 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.152+0000 7f35b2374640 1 Processor -- start 2024-04-16T15:36:27.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.152+0000 7f35b2374640 1 -- start start 2024-04-16T15:36:27.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b74e0 0x7f35ac14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 0x7f35ac160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0d27e0 con 0x7f35ac0d1700 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0b5730 con 0x7f35ac161f20 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b2374640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac0d2960 con 0x7f35ac0b74e0 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35ab7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36412/0 (socket says 172.21.15.80:36412) 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35ab7fe640 1 -- 172.21.15.80:0/99528662 learned_addr learned my addr 172.21.15.80:0/99528662 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35b0911640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 0x7f35ac160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.153+0000 7f35abfff640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b74e0 0x7f35ac14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 -- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b74e0 msgr2=0x7f35ac14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b74e0 0x7f35ac14aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 -- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 msgr2=0x7f35ac160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 0x7f35ac160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 -- 172.21.15.80:0/99528662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac14b1c0 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35b0911640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 0x7f35ac160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35ab7fe640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c430 tx=0x7f35a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00052d0 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0005490 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac14b4a0 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0007260 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.154+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac14ba60 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.155+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac068a40 con 0x7f35ac0d1700 2024-04-16T15:36:27.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.155+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35a0007400 con 0x7f35ac0d1700 2024-04-16T15:36:27.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.156+0000 7f35a8ff9640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.156+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35a008b310 con 0x7f35ac0d1700 2024-04-16T15:36:27.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.156+0000 7f35abfff640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.156+0000 7f35abfff640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 0x7f359806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.160+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35a0058db0 con 0x7f35ac0d1700 2024-04-16T15:36:27.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.336+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35ac0b6e60 con 0x7f35ac0d1700 2024-04-16T15:36:27.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.337+0000 7f35a8ff9640 1 -- 172.21.15.80:0/99528662 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f35a005d0b0 con 0x7f35ac0d1700 2024-04-16T15:36:27.336 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:27.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.338+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 msgr2=0x7f359806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 0x7f359806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f359c036000 tx=0x7f359c03b040 comp rx=0 tx=0).stop 2024-04-16T15:36:27.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 msgr2=0x7f35ac15e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35a000c430 tx=0x7f35a000c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 shutdown_connections 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35ac161f20 0x7f35ac160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35ac0d1700 0x7f35ac15e310 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 --2- 172.21.15.80:0/99528662 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35ac0b74e0 0x7f35ac14aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 >> 172.21.15.80:0/99528662 conn(0x7f35ac08c000 msgr2=0x7f35ac0b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 shutdown_connections 2024-04-16T15:36:27.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.339+0000 7f35b2374640 1 -- 172.21.15.80:0/99528662 wait complete. 2024-04-16T15:36:27.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:27.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.455+0000 7f8d3fa60640 1 Processor -- start 2024-04-16T15:36:27.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.455+0000 7f8d3fa60640 1 -- start start 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3fa60640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3fa60640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 0x7f8d381683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3fa60640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3806cab0 con 0x7f8d380b47d0 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3fa60640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3806d350 con 0x7f8d380700a0 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3fa60640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8d38159290 con 0x7f8d3815f070 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3dffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 0x7f8d381683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:33318/0 (socket says 172.21.15.80:33318) 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3cffb640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8d380b47d0 0x7f8d3815f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:38226/0 (socket says 172.21.15.80:38226) 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3dffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 0x7f8d381683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:51818/0 (socket says 172.21.15.80:51818) 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 -- 172.21.15.80:0/2223960647 learned_addr learned my addr 172.21.15.80:0/2223960647 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 -- 172.21.15.80:0/2223960647 >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 msgr2=0x7f8d381683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2223960647 >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 0x7f8d381683b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 -- 172.21.15.80:0/2223960647 >> v1:172.21.15.87:6789/0 conn(0x7f8d380b47d0 legacy=0x7f8d3815f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.456+0000 7f8d3d7fc640 1 -- 172.21.15.80:0/2223960647 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3806cd90 con 0x7f8d3815f070 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.457+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2223960647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009870 tx=0x7f8d3402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8286c52cb21479e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.457+0000 7f8d2ffff640 1 -- 172.21.15.80:0/2223960647 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34035020 con 0x7f8d3815f070 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.457+0000 7f8d2ffff640 1 -- 172.21.15.80:0/2223960647 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34031640 con 0x7f8d3815f070 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.457+0000 7f8d2ffff640 1 -- 172.21.15.80:0/2223960647 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3402d040 con 0x7f8d3815f070 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2223960647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 msgr2=0x7f8d3806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2223960647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009870 tx=0x7f8d3402b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2223960647 shutdown_connections 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2223960647 >> v2:172.21.15.87:3300/0 conn(0x7f8d380700a0 0x7f8d381683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2223960647 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3806c3b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2223960647 >> 172.21.15.80:0/2223960647 conn(0x7f8d380d0c30 msgr2=0x7f8d380d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2223960647 shutdown_connections 2024-04-16T15:36:27.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.458+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2223960647 wait complete. 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.459+0000 7f8d3fa60640 1 Processor -- start 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.459+0000 7f8d3fa60640 1 -- start start 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 0x7f8d380c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3815fb60 con 0x7f8d380b47d0 2024-04-16T15:36:27.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3806eb70 con 0x7f8d380700a0 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3fa60640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8d380b4c30 con 0x7f8d3815f070 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3cffb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3cffb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36428/0 (socket says 172.21.15.80:36428) 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3cffb640 1 -- 172.21.15.80:0/2480624626 learned_addr learned my addr 172.21.15.80:0/2480624626 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 0x7f8d380c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3dffd640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3cffb640 1 -- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 msgr2=0x7f8d3815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.460+0000 7f8d3cffb640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3cffb640 1 -- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 msgr2=0x7f8d380c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3cffb640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 0x7f8d380c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3cffb640 1 -- 172.21.15.80:0/2480624626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d380c6cb0 con 0x7f8d380b47d0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 0x7f8d380c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3cffb640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c400 tx=0x7f8d2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d280074e0 con 0x7f8d380b47d0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d28007680 con 0x7f8d380b47d0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d380c6f90 con 0x7f8d380b47d0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28004a00 con 0x7f8d380b47d0 2024-04-16T15:36:27.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.461+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3815b8c0 con 0x7f8d380b47d0 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.462+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38068a40 con 0x7f8d380b47d0 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.462+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d2801a020 con 0x7f8d380b47d0 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.463+0000 7f8d2dffb640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.463+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d2808b620 con 0x7f8d380b47d0 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.463+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.463+0000 7f8d3d7fc640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d34036000 tx=0x7f8d3403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.467+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d28059040 con 0x7f8d380b47d0 2024-04-16T15:36:27.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.641+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d38161d50 con 0x7f8d380b47d0 2024-04-16T15:36:27.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.641+0000 7f8d2dffb640 1 -- 172.21.15.80:0/2480624626 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f8d28078020 con 0x7f8d380b47d0 2024-04-16T15:36:27.641 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 msgr2=0x7f8d1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8d34036000 tx=0x7f8d3403c040 comp rx=0 tx=0).stop 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 msgr2=0x7f8d380c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c400 tx=0x7f8d2800c8c0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 shutdown_connections 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3815f070 0x7f8d3815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d380b47d0 0x7f8d380c7fa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.643 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 --2- 172.21.15.80:0/2480624626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d380700a0 0x7f8d380c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 >> 172.21.15.80:0/2480624626 conn(0x7f8d380d0c30 msgr2=0x7f8d3806ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 shutdown_connections 2024-04-16T15:36:27.644 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.643+0000 7f8d3fa60640 1 -- 172.21.15.80:0/2480624626 wait complete. 2024-04-16T15:36:27.654 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:27.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.760+0000 7fa3b15a8640 1 Processor -- start 2024-04-16T15:36:27.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.760+0000 7fa3b15a8640 1 -- start start 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.761+0000 7fa3b15a8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 0x7fa3ac0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.761+0000 7fa3b15a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.761+0000 7fa3b15a8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3ac0b3ed0 con 0x7fa3ac0c6de0 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.761+0000 7fa3b15a8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa3ac15ca20 con 0x7fa3ac15c640 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.761+0000 7fa3b15a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ac0cf180 con 0x7fa3ac0cb960 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aaffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 0x7fa3ac0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aaffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 0x7fa3ac0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:51832/0 (socket says 172.21.15.80:51832) 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:33336/0 (socket says 172.21.15.80:33336) 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3ab7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa3ac0c6de0 0x7fa3ac0d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:38228/0 (socket says 172.21.15.80:38228) 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aaffd640 1 -- 172.21.15.80:0/633236923 learned_addr learned my addr 172.21.15.80:0/633236923 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/633236923 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 msgr2=0x7fa3ac0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 --2- 172.21.15.80:0/633236923 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 0x7fa3ac0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/633236923 >> v1:172.21.15.87:6789/0 conn(0x7fa3ac0c6de0 legacy=0x7fa3ac0d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.762+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/633236923 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac0c7e10 con 0x7fa3ac0cb960 2024-04-16T15:36:27.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3aa7fc640 1 --2- 172.21.15.80:0/633236923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00097a0 tx=0x7fa3a002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb725dc1b50d343 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3a9ffb640 1 -- 172.21.15.80:0/633236923 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0035020 con 0x7fa3ac0cb960 2024-04-16T15:36:27.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3a9ffb640 1 -- 172.21.15.80:0/633236923 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a0031830 con 0x7fa3ac0cb960 2024-04-16T15:36:27.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3a9ffb640 1 -- 172.21.15.80:0/633236923 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0031c00 con 0x7fa3ac0cb960 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3b15a8640 1 -- 172.21.15.80:0/633236923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 msgr2=0x7fa3ac0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.763+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/633236923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00097a0 tx=0x7fa3a002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 -- 172.21.15.80:0/633236923 shutdown_connections 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/633236923 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac0cb960 0x7fa3ac0cbdb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/633236923 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac15c640 0x7fa3ac0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 -- 172.21.15.80:0/633236923 >> 172.21.15.80:0/633236923 conn(0x7fa3ac0d13a0 msgr2=0x7fa3ac0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 -- 172.21.15.80:0/633236923 shutdown_connections 2024-04-16T15:36:27.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.764+0000 7fa3b15a8640 1 -- 172.21.15.80:0/633236923 wait complete. 2024-04-16T15:36:27.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.765+0000 7fa3b15a8640 1 Processor -- start 2024-04-16T15:36:27.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.765+0000 7fa3b15a8640 1 -- start start 2024-04-16T15:36:27.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 0x7fa3ac149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac15c640 0x7fa3ac0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0c68c0 con 0x7fa3ac0cb960 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0c65e0 con 0x7fa3ac0c6de0 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ac0c7ae0 con 0x7fa3ac15c640 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36442/0 (socket says 172.21.15.80:36442) 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/1397436198 learned_addr learned my addr 172.21.15.80:0/1397436198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3ab7fe640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac15c640 0x7fa3ac0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aaffd640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 0x7fa3ac149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac15c640 msgr2=0x7fa3ac0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac15c640 0x7fa3ac0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 msgr2=0x7fa3ac149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 0x7fa3ac149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 -- 172.21.15.80:0/1397436198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac1f69b0 con 0x7fa3ac0cb960 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aaffd640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 0x7fa3ac149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:27.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3aa7fc640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0034040 tx=0x7fa3a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0040070 con 0x7fa3ac0cb960 2024-04-16T15:36:27.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a003a910 con 0x7fa3ac0cb960 2024-04-16T15:36:27.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac14a380 con 0x7fa3ac0cb960 2024-04-16T15:36:27.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.766+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0035040 con 0x7fa3ac0cb960 2024-04-16T15:36:27.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.767+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac1f5ed0 con 0x7fa3ac0cb960 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.767+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac069150 con 0x7fa3ac0cb960 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.768+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3a0038020 con 0x7fa3ac0cb960 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.768+0000 7fa3937fe640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 0x7fa39806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.768+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3a00ad8e0 con 0x7fa3ac0cb960 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.768+0000 7fa3aaffd640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 0x7fa39806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:27.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.769+0000 7fa3aaffd640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 0x7fa39806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d70 tx=0x7fa39c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:27.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.773+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3a0031800 con 0x7fa3ac0cb960 2024-04-16T15:36:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.955+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa3ac0d1c00 con 0x7fa3ac0cb960 2024-04-16T15:36:27.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.955+0000 7fa3937fe640 1 -- 172.21.15.80:0/1397436198 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fa3a007b9d0 con 0x7fa3ac0cb960 2024-04-16T15:36:27.955 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 msgr2=0x7fa39806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 0x7fa39806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d70 tx=0x7fa39c00b040 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 msgr2=0x7fa3ac0c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0034040 tx=0x7fa3a00046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 shutdown_connections 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa39806c8f0 0x7fa39806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa3ac15c640 0x7fa3ac0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa3ac0cb960 0x7fa3ac0c83e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 --2- 172.21.15.80:0/1397436198 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c6de0 0x7fa3ac149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:27.957 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 >> 172.21.15.80:0/1397436198 conn(0x7fa3ac0d13a0 msgr2=0x7fa3ac15b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:27.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 shutdown_connections 2024-04-16T15:36:27.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:27.957+0000 7fa3b15a8640 1 -- 172.21.15.80:0/1397436198 wait complete. 2024-04-16T15:36:27.967 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.080+0000 7f2ceb4d3640 1 Processor -- start 2024-04-16T15:36:28.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.080+0000 7f2ceb4d3640 1 -- start start 2024-04-16T15:36:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ceb4d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2ce415fee0 0x7f2ce409b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ceb4d3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ce40d0120 0x7f2ce409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ceb4d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce40cdd10 con 0x7f2ce409afb0 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ceb4d3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce409b420 con 0x7f2ce40d0120 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ceb4d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce40cdff0 con 0x7f2ce415fee0 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ce40d0120 0x7f2ce409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f2ce40d0120 0x7f2ce409aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36444/0 (socket says 172.21.15.80:36444) 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 -- 172.21.15.80:0/2147450875 learned_addr learned my addr 172.21.15.80:0/2147450875 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 -- 172.21.15.80:0/2147450875 >> v2:172.21.15.87:3300/0 conn(0x7f2ce415fee0 msgr2=0x7f2ce409b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 --2- 172.21.15.80:0/2147450875 >> v2:172.21.15.87:3300/0 conn(0x7f2ce415fee0 0x7f2ce409b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 -- 172.21.15.80:0/2147450875 >> v1:172.21.15.87:6789/0 conn(0x7f2ce409afb0 legacy=0x7f2ce40d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:28.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.081+0000 7f2ce8a6e640 1 -- 172.21.15.80:0/2147450875 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce40ce2d0 con 0x7f2ce40d0120 2024-04-16T15:36:28.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2ce8a6e640 1 --2- 172.21.15.80:0/2147450875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce40d0120 0x7f2ce409aa70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b4cf0 tx=0x7f2cd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e23d2fb8b8bc2b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2cdbfff640 1 -- 172.21.15.80:0/2147450875 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4035020 con 0x7f2ce40d0120 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2cdbfff640 1 -- 172.21.15.80:0/2147450875 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd4031870 con 0x7f2ce40d0120 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2cdbfff640 1 -- 172.21.15.80:0/2147450875 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4031c40 con 0x7f2ce40d0120 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2147450875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce40d0120 msgr2=0x7f2ce409aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.082+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2147450875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce40d0120 0x7f2ce409aa70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40b4cf0 tx=0x7f2cd402b910 comp rx=0 tx=0).stop 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2147450875 shutdown_connections 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2147450875 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce40d0120 0x7f2ce409aa70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2147450875 >> v2:172.21.15.87:3300/0 conn(0x7f2ce415fee0 0x7f2ce409b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2147450875 >> 172.21.15.80:0/2147450875 conn(0x7f2ce40b4040 msgr2=0x7f2ce40b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2147450875 shutdown_connections 2024-04-16T15:36:28.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.083+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2147450875 wait complete. 2024-04-16T15:36:28.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.084+0000 7f2ceb4d3640 1 Processor -- start 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.084+0000 7f2ceb4d3640 1 -- start start 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.084+0000 7f2ceb4d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.084+0000 7f2ceb4d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ce40d0120 0x7f2ce4070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.084+0000 7f2ceb4d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce415fee0 0x7f2ce4071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ceb4d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40c7680 con 0x7f2ce409afb0 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ceb4d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40c7500 con 0x7f2ce415fee0 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ceb4d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce40c7800 con 0x7f2ce40d0120 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36446/0 (socket says 172.21.15.80:36446) 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 -- 172.21.15.80:0/2127560336 learned_addr learned my addr 172.21.15.80:0/2127560336 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 -- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ce40d0120 msgr2=0x7f2ce4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ce40d0120 0x7f2ce4070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 -- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce415fee0 msgr2=0x7f2ce4071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce9a70640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce415fee0 0x7f2ce4071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce415fee0 0x7f2ce4071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 -- 172.21.15.80:0/2127560336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce415b540 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ce926f640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000b4a0 tx=0x7f2ce000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0014070 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce0010610 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce41485e0 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0010a00 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.085+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce414b330 con 0x7f2ce409afb0 2024-04-16T15:36:28.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.086+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce4069150 con 0x7f2ce409afb0 2024-04-16T15:36:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.087+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ce0017070 con 0x7f2ce409afb0 2024-04-16T15:36:28.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.087+0000 7f2cd9ffb640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 0x7f2cc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.087+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2ce008b9d0 con 0x7f2ce409afb0 2024-04-16T15:36:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.087+0000 7f2ce8a6e640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 0x7f2cc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.088+0000 7f2ce8a6e640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 0x7f2cc806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4036000 tx=0x7f2cd4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.092+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ce0059a00 con 0x7f2ce409afb0 2024-04-16T15:36:28.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.266+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2ce40ced40 con 0x7f2ce409afb0 2024-04-16T15:36:28.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.266+0000 7f2cd9ffb640 1 -- 172.21.15.80:0/2127560336 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2ce0059300 con 0x7f2ce409afb0 2024-04-16T15:36:28.266 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 msgr2=0x7f2cc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 0x7f2cc806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4036000 tx=0x7f2cd4030000 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 msgr2=0x7f2ce414adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000b4a0 tx=0x7f2ce000b960 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 shutdown_connections 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce415fee0 0x7f2ce4071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cc806c8f0 0x7f2cc806edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2ce40d0120 0x7f2ce4070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 --2- 172.21.15.80:0/2127560336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2ce409afb0 0x7f2ce414adf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 >> 172.21.15.80:0/2127560336 conn(0x7f2ce40b4040 msgr2=0x7f2ce40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 shutdown_connections 2024-04-16T15:36:28.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.268+0000 7f2ceb4d3640 1 -- 172.21.15.80:0/2127560336 wait complete. 2024-04-16T15:36:28.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:28.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.382+0000 7f87380ba640 1 Processor -- start 2024-04-16T15:36:28.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.382+0000 7f87380ba640 1 -- start start 2024-04-16T15:36:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f87380ba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f873015f9f0 0x7f873015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f87380ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 0x7f873015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f87380ba640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873015cc20 con 0x7f873015c200 2024-04-16T15:36:28.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f87380ba640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f873013eb70 con 0x7f873015f9f0 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f87380ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f873015c670 con 0x7f8730141b10 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f8735e56640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f873015f9f0 0x7f873015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f8735e56640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f873015f9f0 0x7f873015fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36454/0 (socket says 172.21.15.80:36454) 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f8735e56640 1 -- 172.21.15.80:0/3195480387 learned_addr learned my addr 172.21.15.80:0/3195480387 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.383+0000 7f8736657640 1 --1- 172.21.15.80:0/3195480387 >> v1:172.21.15.80:6789/0 conn(0x7f873015c200 0x7f87300b5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36604/0 (socket says 172.21.15.80:36604) 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735655640 1 --2- 172.21.15.80:0/3195480387 >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 0x7f873015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735e56640 1 -- 172.21.15.80:0/3195480387 >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 msgr2=0x7f873015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735e56640 1 --2- 172.21.15.80:0/3195480387 >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 0x7f873015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735e56640 1 -- 172.21.15.80:0/3195480387 >> v1:172.21.15.80:6789/0 conn(0x7f873015c200 legacy=0x7f87300b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8734e54640 1 -- 172.21.15.80:0/3195480387 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756069634 0 0) 0x7f873015cc20 con 0x7f873015c200 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735e56640 1 -- 172.21.15.80:0/3195480387 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873015c940 con 0x7f873015f9f0 2024-04-16T15:36:28.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735655640 1 --2- 172.21.15.80:0/3195480387 >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 0x7f873015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.384+0000 7f8735e56640 1 --2- 172.21.15.80:0/3195480387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015f9f0 0x7f873015fdd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87300b68d0 tx=0x7f872002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e383faa850636c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f8734e54640 1 -- 172.21.15.80:0/3195480387 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720035020 con 0x7f873015f9f0 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f8734e54640 1 -- 172.21.15.80:0/3195480387 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8720031870 con 0x7f873015f9f0 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f8734e54640 1 -- 172.21.15.80:0/3195480387 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720031c40 con 0x7f873015f9f0 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 -- 172.21.15.80:0/3195480387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015f9f0 msgr2=0x7f873015fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 --2- 172.21.15.80:0/3195480387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015f9f0 0x7f873015fdd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87300b68d0 tx=0x7f872002b910 comp rx=0 tx=0).stop 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 -- 172.21.15.80:0/3195480387 shutdown_connections 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 --2- 172.21.15.80:0/3195480387 >> v2:172.21.15.87:3300/0 conn(0x7f8730141b10 0x7f873015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 --2- 172.21.15.80:0/3195480387 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015f9f0 0x7f873015fdd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 -- 172.21.15.80:0/3195480387 >> 172.21.15.80:0/3195480387 conn(0x7f87300b2940 msgr2=0x7f873006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 -- 172.21.15.80:0/3195480387 shutdown_connections 2024-04-16T15:36:28.386 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.385+0000 7f87380ba640 1 -- 172.21.15.80:0/3195480387 wait complete. 2024-04-16T15:36:28.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.386+0000 7f87380ba640 1 Processor -- start 2024-04-16T15:36:28.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.386+0000 7f87380ba640 1 -- start start 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f873015c200 0x7f873015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 0x7f8730144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f87301415f0 con 0x7f8730141b10 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8730141310 con 0x7f873015f9f0 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f87380ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f87300b6070 con 0x7f873015c200 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f8735e56640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f8735e56640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36470/0 (socket says 172.21.15.80:36470) 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f8735e56640 1 -- 172.21.15.80:0/113740690 learned_addr learned my addr 172.21.15.80:0/113740690 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:28.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f8736657640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 0x7f8730144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.387+0000 7f8735655640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f873015c200 0x7f873015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 -- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f873015c200 msgr2=0x7f873015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f873015c200 0x7f873015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 -- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 msgr2=0x7f8730144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 0x7f8730144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 -- 172.21.15.80:0/113740690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300aecb0 con 0x7f8730141b10 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8736657640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 0x7f8730144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f8735e56640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f872002b950 tx=0x7f87200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720040070 con 0x7f8730141b10 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8720030d00 con 0x7f8730141b10 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87300af240 con 0x7f8730141b10 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720035040 con 0x7f8730141b10 2024-04-16T15:36:28.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.388+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8730143b50 con 0x7f8730141b10 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.389+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730068a40 con 0x7f8730141b10 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.389+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f872004b060 con 0x7f8730141b10 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.390+0000 7f87267fc640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 0x7f871406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.390+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f87200add60 con 0x7f8730141b10 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.390+0000 7f8735655640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 0x7f871406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.390+0000 7f8735655640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 0x7f871406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8730072910 tx=0x7f872c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.394+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f872007bd90 con 0x7f8730141b10 2024-04-16T15:36:28.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.570+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8730144170 con 0x7f8730141b10 2024-04-16T15:36:28.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.571+0000 7f87267fc640 1 -- 172.21.15.80:0/113740690 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18844 (secure 0 0 0) 0x7f8730144170 con 0x7f8730141b10 2024-04-16T15:36:28.571 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:28.571 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":26,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:28.038806+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 msgr2=0x7f871406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 0x7f871406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8730072910 tx=0x7f872c008040 comp rx=0 tx=0).stop 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 msgr2=0x7f873013d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f872002b950 tx=0x7f87200046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 shutdown_connections 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f873015f9f0 0x7f8730144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871406c8f0 0x7f871406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f873015c200 0x7f873015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 --2- 172.21.15.80:0/113740690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8730141b10 0x7f873013d870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 >> 172.21.15.80:0/113740690 conn(0x7f87300b2940 msgr2=0x7f873006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 shutdown_connections 2024-04-16T15:36:28.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.573+0000 7f87380ba640 1 -- 172.21.15.80:0/113740690 wait complete. 2024-04-16T15:36:28.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:28.584 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.692+0000 7fb659752640 1 Processor -- start 2024-04-16T15:36:28.691 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.692+0000 7fb659752640 1 -- start start 2024-04-16T15:36:28.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb659752640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6540b74e0 0x7fb6540d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb659752640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6540cfd90 con 0x7fb654161f20 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb659752640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6540d0050 con 0x7fb6540d1530 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb659752640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb6540d1980 con 0x7fb6540b74e0 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb64bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb6540b74e0 0x7fb6540d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb652ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb654161f20 0x7fb6540cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36616/0 (socket says 172.21.15.80:36616) 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb652ffd640 1 -- 172.21.15.80:0/649462709 learned_addr learned my addr 172.21.15.80:0/649462709 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb64bfff640 1 -- 172.21.15.80:0/649462709 >> v1:172.21.15.87:6789/0 conn(0x7fb6540d1530 legacy=0x7fb6540d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb64bfff640 1 -- 172.21.15.80:0/649462709 >> v1:172.21.15.80:6789/0 conn(0x7fb654161f20 legacy=0x7fb6540cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb6527fc640 1 -- 172.21.15.80:0/649462709 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804765018 0 0) 0x7fb6540cfd90 con 0x7fb654161f20 2024-04-16T15:36:28.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.693+0000 7fb64bfff640 1 -- 172.21.15.80:0/649462709 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6540d0330 con 0x7fb6540b74e0 2024-04-16T15:36:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.694+0000 7fb64bfff640 1 --2- 172.21.15.80:0/649462709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540b74e0 0x7fb6540d0ff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb00f9076dcd8fe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.694+0000 7fb6527fc640 1 -- 172.21.15.80:0/649462709 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c035020 con 0x7fb6540b74e0 2024-04-16T15:36:28.695 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.694+0000 7fb6527fc640 1 -- 172.21.15.80:0/649462709 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c031830 con 0x7fb6540b74e0 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.694+0000 7fb6527fc640 1 -- 172.21.15.80:0/649462709 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c031c00 con 0x7fb6540b74e0 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 -- 172.21.15.80:0/649462709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540b74e0 msgr2=0x7fb6540d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 --2- 172.21.15.80:0/649462709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540b74e0 0x7fb6540d0ff0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 -- 172.21.15.80:0/649462709 shutdown_connections 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 --2- 172.21.15.80:0/649462709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540b74e0 0x7fb6540d0ff0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 -- 172.21.15.80:0/649462709 >> 172.21.15.80:0/649462709 conn(0x7fb65408c000 msgr2=0x7fb6540d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 -- 172.21.15.80:0/649462709 shutdown_connections 2024-04-16T15:36:28.696 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.695+0000 7fb659752640 1 -- 172.21.15.80:0/649462709 wait complete. 2024-04-16T15:36:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.696+0000 7fb659752640 1 Processor -- start 2024-04-16T15:36:28.697 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.696+0000 7fb659752640 1 -- start start 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.696+0000 7fb659752640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6540b74e0 0x7fb6540cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.696+0000 7fb659752640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 0x7fb6541534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540b5730 con 0x7fb6540d1530 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb654162300 con 0x7fb6540b74e0 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb6540cf940 con 0x7fb654161f20 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36498/0 (socket says 172.21.15.80:36498) 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 -- 172.21.15.80:0/4147973945 learned_addr learned my addr 172.21.15.80:0/4147973945 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb652ffd640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6540b74e0 0x7fb6540cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb6537fe640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 0x7fb6541534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 -- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 msgr2=0x7fb6541534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 0x7fb6541534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 -- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6540b74e0 msgr2=0x7fb6540cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6540b74e0 0x7fb6540cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 -- 172.21.15.80:0/4147973945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6540c86d0 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb6537fe640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 0x7fb6541534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64bfff640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c004230 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0043f0 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c003850 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6540c89b0 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.697+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6540ca300 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.698+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb654068a40 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.699+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb63c04c060 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.699+0000 7fb64b7fe640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 0x7fb63406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.699+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb63c0ada50 con 0x7fb6540d1530 2024-04-16T15:36:28.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.699+0000 7fb652ffd640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 0x7fb63406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:28.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.700+0000 7fb652ffd640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 0x7fb63406ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb644000f60 tx=0x7fb644007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:28.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.704+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb63c040070 con 0x7fb6540d1530 2024-04-16T15:36:28.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.877+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb6540d1d10 con 0x7fb6540d1530 2024-04-16T15:36:28.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.878+0000 7fb64b7fe640 1 -- 172.21.15.80:0/4147973945 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fb63c07ba80 con 0x7fb6540d1530 2024-04-16T15:36:28.877 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 msgr2=0x7fb63406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 0x7fb63406ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb644000f60 tx=0x7fb644007b50 comp rx=0 tx=0).stop 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 msgr2=0x7fb6540cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 shutdown_connections 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb63406c920 0x7fb63406ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb654161f20 0x7fb6541534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6540d1530 0x7fb6540cab70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 --2- 172.21.15.80:0/4147973945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6540b74e0 0x7fb6540cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.879+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 >> 172.21.15.80:0/4147973945 conn(0x7fb65408c000 msgr2=0x7fb65406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.880+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 shutdown_connections 2024-04-16T15:36:28.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.880+0000 7fb659752640 1 -- 172.21.15.80:0/4147973945 wait complete. 2024-04-16T15:36:28.890 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.996+0000 7fed035e2640 1 Processor -- start 2024-04-16T15:36:28.996 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.996+0000 7fed035e2640 1 -- start start 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed035e2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecfc15e7a0 0x7fecfc0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed035e2640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc15eb80 con 0x7fecfc0d1d90 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed035e2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc0d32a0 con 0x7fecfc0b3870 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed035e2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fecfc0d3580 con 0x7fecfc15e7a0 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed01b7f640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fecfc0d1d90 0x7fecfc0d4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36632/0 (socket says 172.21.15.80:36632) 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.997+0000 7fed01b7f640 1 -- 172.21.15.80:0/1767249227 learned_addr learned my addr 172.21.15.80:0/1767249227 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 --2- 172.21.15.80:0/1767249227 >> v2:172.21.15.87:3300/0 conn(0x7fecfc15e7a0 0x7fecfc0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079077967 0 0) 0x7fecfc15eb80 con 0x7fecfc0d1d90 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fece8003520 con 0x7fecfc0d1d90 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4216148015 0 0) 0x7fece8003520 con 0x7fecfc0d1d90 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 >> v2:172.21.15.87:3300/0 conn(0x7fecfc15e7a0 msgr2=0x7fecfc0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 --2- 172.21.15.80:0/1767249227 >> v2:172.21.15.87:3300/0 conn(0x7fecfc15e7a0 0x7fecfc0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 >> v1:172.21.15.87:6789/0 conn(0x7fecfc0b3870 legacy=0x7fecfc0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc0d3860 con 0x7fecfc0d1d90 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fecf4001690 con 0x7fecfc0d1d90 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 >> v1:172.21.15.80:6789/0 conn(0x7fecfc0d1d90 legacy=0x7fecfc0d4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 0x7fece8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece8004800 0x7fece8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece80051c0 0x7fece800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc0d3580 con 0x7fece80039b0 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fece800c070 con 0x7fece8004800 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fece800c270 con 0x7fece80051c0 2024-04-16T15:36:29.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 0x7fece8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed01b7f640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece80051c0 0x7fece800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed00b7d640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece8004800 0x7fece8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 -- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece80051c0 msgr2=0x7fece800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fece80051c0 0x7fece800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 -- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece8004800 msgr2=0x7fece8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.998+0000 7fed0137e640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece8004800 0x7fece8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fed01b7f640 1 -- 172.21.15.80:0/1767249227 reap_dead start 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fed0137e640 1 -- 172.21.15.80:0/1767249227 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece8003520 con 0x7fece80039b0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fed0137e640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 0x7fece8003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009fc0 tx=0x7fece8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29768570a28bd1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8039070 con 0x7fece80039b0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf802cc20 con 0x7fece80039b0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:28.999+0000 7fecf3fff640 1 -- 172.21.15.80:0/1767249227 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8009c10 con 0x7fece80039b0 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 -- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 msgr2=0x7fece8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 0x7fece8003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009fc0 tx=0x7fece8005830 comp rx=0 tx=0).stop 2024-04-16T15:36:29.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 -- 172.21.15.80:0/1767249227 shutdown_connections 2024-04-16T15:36:29.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 --2- 172.21.15.80:0/1767249227 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fece80039b0 0x7fece8003dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 -- 172.21.15.80:0/1767249227 >> 172.21.15.80:0/1767249227 conn(0x7fecfc0734f0 msgr2=0x7fecfc073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 -- 172.21.15.80:0/1767249227 shutdown_connections 2024-04-16T15:36:29.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.000+0000 7fed035e2640 1 -- 172.21.15.80:0/1767249227 wait complete. 2024-04-16T15:36:29.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.001+0000 7fed035e2640 1 Processor -- start 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.001+0000 7fed035e2640 1 -- start start 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece80039b0 0x7fecfc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 0x7fecfc1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc0b7720 con 0x7fecfc1f47b0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc0d3e20 con 0x7fece80039b0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed035e2640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fecfc0d1680 con 0x7fecfc0ccea0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36510/0 (socket says 172.21.15.80:36510) 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 -- 172.21.15.80:0/2790531408 learned_addr learned my addr 172.21.15.80:0/2790531408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed0137e640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece80039b0 0x7fecfc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed00b7d640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 0x7fecfc1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 -- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 msgr2=0x7fecfc1f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 0x7fecfc1f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 -- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece80039b0 msgr2=0x7fecfc15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece80039b0 0x7fecfc15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 -- 172.21.15.80:0/2790531408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc1f4ca0 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed00b7d640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 0x7fecfc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.002+0000 7fed01b7f640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0d0170 tx=0x7fecf4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.003+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf400f8b0 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.003+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4018070 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.003+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf400fc90 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.003+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc1f4f80 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.003+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc0cbb90 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.004+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc068a40 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.004+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecf401d460 con 0x7fecfc1f47b0 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.004+0000 7fecf1ffb640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 0x7fece006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.005+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fecf408bcd0 con 0x7fecfc1f47b0 2024-04-16T15:36:29.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.005+0000 7fed0137e640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 0x7fece006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.005+0000 7fed0137e640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 0x7fece006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fecf8036000 tx=0x7fecf802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.009+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fecf4059d90 con 0x7fecfc1f47b0 2024-04-16T15:36:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.189+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fecfc0b78a0 con 0x7fecfc1f47b0 2024-04-16T15:36:29.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.190+0000 7fecf1ffb640 1 -- 172.21.15.80:0/2790531408 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fecf4059690 con 0x7fecfc1f47b0 2024-04-16T15:36:29.189 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:29.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 msgr2=0x7fece006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 0x7fece006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fecf8036000 tx=0x7fecf802e000 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 msgr2=0x7fecfc0b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0d0170 tx=0x7fecf4007720 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 shutdown_connections 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecfc1f47b0 0x7fecfc0b7dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fece006c8f0 0x7fece006edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecfc0ccea0 0x7fecfc1f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 --2- 172.21.15.80:0/2790531408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fece80039b0 0x7fecfc15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 >> 172.21.15.80:0/2790531408 conn(0x7fecfc0734f0 msgr2=0x7fecfc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 shutdown_connections 2024-04-16T15:36:29.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.192+0000 7fed035e2640 1 -- 172.21.15.80:0/2790531408 wait complete. 2024-04-16T15:36:29.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:29.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.309+0000 7f1b769c3640 1 Processor -- start 2024-04-16T15:36:29.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.309+0000 7f1b769c3640 1 -- start start 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b769c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 0x7f1b700d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b769c3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b700b3190 0x7f1b7009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b769c3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b700ccba0 con 0x7f1b7009afb0 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b769c3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1b700b2fe0 con 0x7f1b700b3190 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b769c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f1b700d34f0 con 0x7f1b700b2c00 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b6f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b700b3190 0x7f1b7009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b6ffff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 0x7f1b700d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b6f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b700b3190 0x7f1b7009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:51900/0 (socket says 172.21.15.80:51900) 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b74f60640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1b7009afb0 0x7f1b70162660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:38258/0 (socket says 172.21.15.80:38258) 2024-04-16T15:36:29.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.310+0000 7f1b6f7fe640 1 -- 172.21.15.80:0/3171422572 learned_addr learned my addr 172.21.15.80:0/3171422572 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.311+0000 7f1b6f7fe640 1 -- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 msgr2=0x7f1b700d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.311+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 0x7f1b700d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.311+0000 7f1b6f7fe640 1 -- 172.21.15.80:0/3171422572 >> v1:172.21.15.87:6789/0 conn(0x7f1b7009afb0 legacy=0x7f1b70162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.311+0000 7f1b6f7fe640 1 -- 172.21.15.80:0/3171422572 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b700d3210 con 0x7f1b700b3190 2024-04-16T15:36:29.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.311+0000 7f1b6ffff640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 0x7f1b700d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b3190 0x7f1b7009aa70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8b9e2f68507353 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b6effd640 1 -- 172.21.15.80:0/3171422572 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64034070 con 0x7f1b700b3190 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b6effd640 1 -- 172.21.15.80:0/3171422572 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64030840 con 0x7f1b700b3190 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b6effd640 1 -- 172.21.15.80:0/3171422572 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64030c10 con 0x7f1b700b3190 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 -- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b3190 msgr2=0x7f1b7009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b3190 0x7f1b7009aa70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6402b980 comp rx=0 tx=0).stop 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 -- 172.21.15.80:0/3171422572 shutdown_connections 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b3190 0x7f1b7009aa70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 --2- 172.21.15.80:0/3171422572 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b2c00 0x7f1b700d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 -- 172.21.15.80:0/3171422572 >> 172.21.15.80:0/3171422572 conn(0x7f1b700d2550 msgr2=0x7f1b700d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 -- 172.21.15.80:0/3171422572 shutdown_connections 2024-04-16T15:36:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.312+0000 7f1b769c3640 1 -- 172.21.15.80:0/3171422572 wait complete. 2024-04-16T15:36:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.313+0000 7f1b769c3640 1 Processor -- start 2024-04-16T15:36:29.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 -- start start 2024-04-16T15:36:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 0x7f1b7014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b3190 0x7f1b701f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7006dcb0 con 0x7f1b7009afb0 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7006d940 con 0x7f1b700b2c00 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b769c3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f1b700d1a60 con 0x7f1b700b3190 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.314+0000 7f1b6ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36518/0 (socket says 172.21.15.80:36518) 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 -- 172.21.15.80:0/4063672596 learned_addr learned my addr 172.21.15.80:0/4063672596 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 0x7f1b7014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b74f60640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b3190 0x7f1b701f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 -- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b3190 msgr2=0x7f1b701f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b3190 0x7f1b701f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 -- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 msgr2=0x7f1b7014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 0x7f1b7014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 -- 172.21.15.80:0/4063672596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b700af2f0 con 0x7f1b7009afb0 2024-04-16T15:36:29.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 0x7f1b7014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6ffff640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e990 tx=0x7f1b6000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60017070 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6000c9e0 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b700cbf70 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000cdb0 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.315+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b700cc530 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.316+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b70068a40 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.316+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b6001a070 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.317+0000 7f1b6cff9640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 0x7f1b5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.317+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1b6008be30 con 0x7f1b7009afb0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.317+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 0x7f1b5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.317+0000 7f1b6f7fe640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 0x7f1b5c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b64036000 tx=0x7f1b6403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.321+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b60059e60 con 0x7f1b7009afb0 2024-04-16T15:36:29.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.495+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b700b2200 con 0x7f1b7009afb0 2024-04-16T15:36:29.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.496+0000 7f1b6cff9640 1 -- 172.21.15.80:0/4063672596 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f1b60059760 con 0x7f1b7009afb0 2024-04-16T15:36:29.495 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:29.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.497+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 msgr2=0x7f1b5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.497+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 0x7f1b5c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b64036000 tx=0x7f1b6403b040 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.497+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 msgr2=0x7f1b700c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.497+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e990 tx=0x7f1b6000ee50 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 shutdown_connections 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f1b5c06c8f0 0x7f1b5c06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f1b700b3190 0x7f1b701f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b700b2c00 0x7f1b7014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 --2- 172.21.15.80:0/4063672596 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1b7009afb0 0x7f1b700c9620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 >> 172.21.15.80:0/4063672596 conn(0x7f1b700d2550 msgr2=0x7f1b7006ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 shutdown_connections 2024-04-16T15:36:29.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.498+0000 7f1b769c3640 1 -- 172.21.15.80:0/4063672596 wait complete. 2024-04-16T15:36:29.508 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.615+0000 7f599fcb1640 1 Processor -- start 2024-04-16T15:36:29.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 -- start start 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 0x7f599809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5998160170 0x7f599809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f599809b7a0 0x7f59980b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f59980b22b0 con 0x7f599809b7a0 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f59980ce870 con 0x7f599815fd90 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.616+0000 7f599fcb1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f59980ceb50 con 0x7f5998160170 2024-04-16T15:36:29.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f599809b7a0 0x7f59980b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f599809b7a0 0x7f59980b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36520/0 (socket says 172.21.15.80:36520) 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 -- 172.21.15.80:0/1282900214 learned_addr learned my addr 172.21.15.80:0/1282900214 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599da4d640 1 --2- 172.21.15.80:0/1282900214 >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 0x7f599809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599d24c640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5998160170 0x7f599809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 -- 172.21.15.80:0/1282900214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5998160170 msgr2=0x7f599809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5998160170 0x7f599809afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 -- 172.21.15.80:0/1282900214 >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 msgr2=0x7f599809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 --2- 172.21.15.80:0/1282900214 >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 0x7f599809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599e24e640 1 -- 172.21.15.80:0/1282900214 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59980b1f40 con 0x7f599809b7a0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.617+0000 7f599da4d640 1 --2- 172.21.15.80:0/1282900214 >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 0x7f599809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599e24e640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599809b7a0 0x7f59980b2740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5998068740 tx=0x7f598802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9511bedf2da84c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599ca4b640 1 -- 172.21.15.80:0/1282900214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598802ca70 con 0x7f599809b7a0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599ca4b640 1 -- 172.21.15.80:0/1282900214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598802cc10 con 0x7f599809b7a0 2024-04-16T15:36:29.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599ca4b640 1 -- 172.21.15.80:0/1282900214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880343f0 con 0x7f599809b7a0 2024-04-16T15:36:29.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 -- 172.21.15.80:0/1282900214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599809b7a0 msgr2=0x7f59980b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599809b7a0 0x7f59980b2740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5998068740 tx=0x7f598802bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 -- 172.21.15.80:0/1282900214 shutdown_connections 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599809b7a0 0x7f59980b2740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 --2- 172.21.15.80:0/1282900214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5998160170 0x7f599809afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 --2- 172.21.15.80:0/1282900214 >> v2:172.21.15.87:3300/0 conn(0x7f599815fd90 0x7f599809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.618+0000 7f599fcb1640 1 -- 172.21.15.80:0/1282900214 >> 172.21.15.80:0/1282900214 conn(0x7f59980b4060 msgr2=0x7f59980b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.619+0000 7f599fcb1640 1 -- 172.21.15.80:0/1282900214 shutdown_connections 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.619+0000 7f599fcb1640 1 -- 172.21.15.80:0/1282900214 wait complete. 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 Processor -- start 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 -- start start 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f599809b7a0 0x7f59980c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5998160170 0x7f59980b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59980b3010 con 0x7f599815fd90 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59980b2e90 con 0x7f5998160170 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599fcb1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f59980b3190 con 0x7f599809b7a0 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599d24c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.620+0000 7f599d24c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36526/0 (socket says 172.21.15.80:36526) 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 -- 172.21.15.80:0/2072477568 learned_addr learned my addr 172.21.15.80:0/2072477568 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599e24e640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5998160170 0x7f59980b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599da4d640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f599809b7a0 0x7f59980c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 -- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f599809b7a0 msgr2=0x7f59980c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f599809b7a0 0x7f59980c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 -- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5998160170 msgr2=0x7f59980b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5998160170 0x7f59980b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 -- 172.21.15.80:0/2072477568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59980c5c20 con 0x7f599815fd90 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599d24c640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d5f0 tx=0x7f598c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0125f0 con 0x7f599815fd90 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c019070 con 0x7f599815fd90 2024-04-16T15:36:29.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59980b6050 con 0x7f599815fd90 2024-04-16T15:36:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0129d0 con 0x7f599815fd90 2024-04-16T15:36:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.621+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59980c61c0 con 0x7f599815fd90 2024-04-16T15:36:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.622+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59980cd5e0 con 0x7f599815fd90 2024-04-16T15:36:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.622+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f598c012b70 con 0x7f599815fd90 2024-04-16T15:36:29.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.623+0000 7f59967fc640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 0x7f598406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.623+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f598c08c0d0 con 0x7f599815fd90 2024-04-16T15:36:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.623+0000 7f599da4d640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 0x7f598406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.623+0000 7f599da4d640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 0x7f598406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5990006e80 tx=0x7f5990008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.627+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59980cd5e0 con 0x7f599815fd90 2024-04-16T15:36:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.802+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5998067b30 con 0x7f599815fd90 2024-04-16T15:36:29.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.803+0000 7f59967fc640 1 -- 172.21.15.80:0/2072477568 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5998067b30 con 0x7f599815fd90 2024-04-16T15:36:29.802 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 msgr2=0x7f598406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 0x7f598406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5990006e80 tx=0x7f5990008040 comp rx=0 tx=0).stop 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 msgr2=0x7f59981518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d5f0 tx=0x7f598c00dab0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 shutdown_connections 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5998160170 0x7f59980b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f599815fd90 0x7f59981518d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f598406c920 0x7f598406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 --2- 172.21.15.80:0/2072477568 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f599809b7a0 0x7f59980c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 >> 172.21.15.80:0/2072477568 conn(0x7f59980b4060 msgr2=0x7f59980cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 shutdown_connections 2024-04-16T15:36:29.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.805+0000 7f599fcb1640 1 -- 172.21.15.80:0/2072477568 wait complete. 2024-04-16T15:36:29.855 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-04-16T15:36:29.855 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:29.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.960+0000 7f09cf288640 1 Processor -- start 2024-04-16T15:36:29.959 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.960+0000 7f09cf288640 1 -- start start 2024-04-16T15:36:29.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cf288640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c815ecc0 0x7f09c80b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cf288640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c80b4d80 0x7f09c80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cf288640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c80b29f0 con 0x7f09c80b2580 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cf288640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f09c809be20 con 0x7f09c80b4d80 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cf288640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f09c80b3960 con 0x7f09c815ecc0 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c80b4d80 0x7f09c80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f09c80b4d80 0x7f09c80b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36532/0 (socket says 172.21.15.80:36532) 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 -- 172.21.15.80:0/643631346 learned_addr learned my addr 172.21.15.80:0/643631346 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 -- 172.21.15.80:0/643631346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c815ecc0 msgr2=0x7f09c80b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 --2- 172.21.15.80:0/643631346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c815ecc0 0x7f09c80b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 -- 172.21.15.80:0/643631346 >> v1:172.21.15.87:6789/0 conn(0x7f09c80b2580 legacy=0x7f09c80d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:29.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.961+0000 7f09cc823640 1 -- 172.21.15.80:0/643631346 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c80b3c00 con 0x7f09c80b4d80 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.962+0000 7f09cc823640 1 --2- 172.21.15.80:0/643631346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c80b4d80 0x7f09c80b2040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009870 tx=0x7f09b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222ab773bc39c83b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.962+0000 7f09bffff640 1 -- 172.21.15.80:0/643631346 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8034070 con 0x7f09c80b4d80 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.962+0000 7f09bffff640 1 -- 172.21.15.80:0/643631346 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8030840 con 0x7f09c80b4d80 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.962+0000 7f09bffff640 1 -- 172.21.15.80:0/643631346 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8030c10 con 0x7f09c80b4d80 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 -- 172.21.15.80:0/643631346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c80b4d80 msgr2=0x7f09c80b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 --2- 172.21.15.80:0/643631346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c80b4d80 0x7f09c80b2040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09b8009870 tx=0x7f09b802b980 comp rx=0 tx=0).stop 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 -- 172.21.15.80:0/643631346 shutdown_connections 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 --2- 172.21.15.80:0/643631346 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c80b4d80 0x7f09c80b2040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 --2- 172.21.15.80:0/643631346 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c815ecc0 0x7f09c80b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 -- 172.21.15.80:0/643631346 >> 172.21.15.80:0/643631346 conn(0x7f09c80b4030 msgr2=0x7f09c80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 -- 172.21.15.80:0/643631346 shutdown_connections 2024-04-16T15:36:29.963 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.963+0000 7f09cf288640 1 -- 172.21.15.80:0/643631346 wait complete. 2024-04-16T15:36:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.964+0000 7f09cf288640 1 Processor -- start 2024-04-16T15:36:29.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.964+0000 7f09cf288640 1 -- start start 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c80b2580 0x7f09c8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 0x7f09c809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f09c815f0a0 con 0x7f09c815ecc0 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f09c809b900 con 0x7f09c80b4d80 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f09c806e080 con 0x7f09c80b2580 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36534/0 (socket says 172.21.15.80:36534) 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 -- 172.21.15.80:0/2796747305 learned_addr learned my addr 172.21.15.80:0/2796747305 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cc823640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 0x7f09c809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd024640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c80b2580 0x7f09c8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 -- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c80b2580 msgr2=0x7f09c8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c80b2580 0x7f09c8152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 -- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 msgr2=0x7f09c809cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 0x7f09c809cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 -- 172.21.15.80:0/2796747305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c8153880 con 0x7f09c815ecc0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cc823640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 0x7f09c809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cd825640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c780 tx=0x7f09c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0017070 con 0x7f09c815ecc0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0003da0 con 0x7f09c815ecc0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c8153b60 con 0x7f09c815ecc0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.965+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c00052b0 con 0x7f09c815ecc0 2024-04-16T15:36:29.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.966+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c8154120 con 0x7f09c815ecc0 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.967+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c8068a40 con 0x7f09c815ecc0 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.967+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09c001a070 con 0x7f09c815ecc0 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.968+0000 7f09bdffb640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 0x7f09ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.968+0000 7f09cd024640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 0x7f09ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.968+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f09c008b530 con 0x7f09c815ecc0 2024-04-16T15:36:29.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.968+0000 7f09cd024640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 0x7f09ac06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b810 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:29.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:29.972+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09c00595f0 con 0x7f09c815ecc0 2024-04-16T15:36:30.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.149+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09c81545b0 con 0x7f09c815ecc0 2024-04-16T15:36:30.150 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.150+0000 7f09bdffb640 1 -- 172.21.15.80:0/2796747305 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f09c0058ef0 con 0x7f09c815ecc0 2024-04-16T15:36:30.150 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:30.150 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 msgr2=0x7f09ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 0x7f09ac06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b810 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 msgr2=0x7f09c80c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c780 tx=0x7f09c000cc40 comp rx=0 tx=0).stop 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 shutdown_connections 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f09c815ecc0 0x7f09c80c7b70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09c80b4d80 0x7f09c809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f09ac06c8f0 0x7f09ac06edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 --2- 172.21.15.80:0/2796747305 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f09c80b2580 0x7f09c8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.152+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 >> 172.21.15.80:0/2796747305 conn(0x7f09c80b4030 msgr2=0x7f09c80d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.153+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 shutdown_connections 2024-04-16T15:36:30.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.153+0000 7f09cf288640 1 -- 172.21.15.80:0/2796747305 wait complete. 2024-04-16T15:36:30.164 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:30.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.271+0000 7ff05cf9d640 1 Processor -- start 2024-04-16T15:36:30.271 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.271+0000 7ff05cf9d640 1 -- start start 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff05cf9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0580b8900 0x7ff0581695f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff05cf9d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0580cf5b0 con 0x7ff0580d36d0 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff05cf9d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0580cf890 con 0x7ff058161d60 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff05cf9d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff0580b7460 con 0x7ff0580b8900 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff057fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0580b8900 0x7ff0581695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff056ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff0580d36d0 0x7ff0581629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36648/0 (socket says 172.21.15.80:36648) 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.272+0000 7ff056ffd640 1 -- 172.21.15.80:0/1751914625 learned_addr learned my addr 172.21.15.80:0/1751914625 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff057fff640 1 -- 172.21.15.80:0/1751914625 >> v1:172.21.15.87:6789/0 conn(0x7ff058161d60 legacy=0x7ff0581622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff057fff640 1 -- 172.21.15.80:0/1751914625 >> v1:172.21.15.80:6789/0 conn(0x7ff0580d36d0 legacy=0x7ff0581629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff057fff640 1 -- 172.21.15.80:0/1751914625 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0580cfb70 con 0x7ff0580b8900 2024-04-16T15:36:30.273 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff0567fc640 1 -- 172.21.15.80:0/1751914625 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787617303 0 0) 0x7ff0580cf5b0 con 0x7ff0580d36d0 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff057fff640 1 --2- 172.21.15.80:0/1751914625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580b8900 0x7ff0581695f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097a0 tx=0x7ff05002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46912712acf511d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.273+0000 7ff0567fc640 1 -- 172.21.15.80:0/1751914625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050035020 con 0x7ff0580b8900 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff0567fc640 1 -- 172.21.15.80:0/1751914625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff050031830 con 0x7ff0580b8900 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff0567fc640 1 -- 172.21.15.80:0/1751914625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050031c00 con 0x7ff0580b8900 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 -- 172.21.15.80:0/1751914625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580b8900 msgr2=0x7ff0581695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/1751914625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580b8900 0x7ff0581695f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097a0 tx=0x7ff05002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 -- 172.21.15.80:0/1751914625 shutdown_connections 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/1751914625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580b8900 0x7ff0581695f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 -- 172.21.15.80:0/1751914625 >> 172.21.15.80:0/1751914625 conn(0x7ff05808c000 msgr2=0x7ff0580d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 -- 172.21.15.80:0/1751914625 shutdown_connections 2024-04-16T15:36:30.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.274+0000 7ff05cf9d640 1 -- 172.21.15.80:0/1751914625 wait complete. 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.275+0000 7ff05cf9d640 1 Processor -- start 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.275+0000 7ff05cf9d640 1 -- start start 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 0x7ff058158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff058161d60 0x7ff0580cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff0580d4de0 con 0x7ff0580d36d0 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0580d4c60 con 0x7ff058161d60 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff05cf9d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff0580d4f60 con 0x7ff0580b8900 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff056ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36562/0 (socket says 172.21.15.80:36562) 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff056ffd640 1 -- 172.21.15.80:0/317148731 learned_addr learned my addr 172.21.15.80:0/317148731 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.276+0000 7ff057fff640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff058161d60 0x7ff0580cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff0577fe640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 0x7ff058158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 -- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 msgr2=0x7ff058158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 0x7ff058158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 -- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff058161d60 msgr2=0x7ff0580cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff058161d60 0x7ff0580cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 -- 172.21.15.80:0/317148731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0580c8120 con 0x7ff0580d36d0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff0577fe640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 0x7ff058158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff056ffd640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c4b0 tx=0x7ff04c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c018070 con 0x7ff0580d36d0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c007500 con 0x7ff0580d36d0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0580c8390 con 0x7ff0580d36d0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c004a20 con 0x7ff0580d36d0 2024-04-16T15:36:30.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.277+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0580c8950 con 0x7ff0580d36d0 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.278+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0580c8e30 con 0x7ff0580d36d0 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.278+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff04c01b070 con 0x7ff0580d36d0 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.279+0000 7ff03ffff640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 0x7ff04406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.279+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff04c08b270 con 0x7ff0580d36d0 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.279+0000 7ff0577fe640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 0x7ff04406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.279+0000 7ff0577fe640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 0x7ff04406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff048007e90 tx=0x7ff0480073a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.283+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0580c8e30 con 0x7ff0580d36d0 2024-04-16T15:36:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.455+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0580ba4d0 con 0x7ff0580d36d0 2024-04-16T15:36:30.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.456+0000 7ff03ffff640 1 -- 172.21.15.80:0/317148731 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff04c059360 con 0x7ff0580d36d0 2024-04-16T15:36:30.455 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 msgr2=0x7ff04406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 0x7ff04406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff048007e90 tx=0x7ff0480073a0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 msgr2=0x7ff0580cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c4b0 tx=0x7ff04c00c970 comp rx=0 tx=0).stop 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 shutdown_connections 2024-04-16T15:36:30.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff058161d60 0x7ff0580cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0580d36d0 0x7ff0580cd400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff04406c8f0 0x7ff04406edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.457+0000 7ff05cf9d640 1 --2- 172.21.15.80:0/317148731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0580b8900 0x7ff058158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.458+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 >> 172.21.15.80:0/317148731 conn(0x7ff05808c000 msgr2=0x7ff05815f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.458+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 shutdown_connections 2024-04-16T15:36:30.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.458+0000 7ff05cf9d640 1 -- 172.21.15.80:0/317148731 wait complete. 2024-04-16T15:36:30.468 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.574+0000 7f14e697c640 1 Processor -- start 2024-04-16T15:36:30.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.574+0000 7f14e697c640 1 -- start start 2024-04-16T15:36:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14e697c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14e006b9a0 0x7f14e00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14e697c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e0146c90 0x7f14e01684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14e697c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e00b4af0 con 0x7f14e00d13e0 2024-04-16T15:36:30.575 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14e697c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f14e01457f0 con 0x7f14e006b9a0 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14e697c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f14e00d19a0 con 0x7f14e0146c90 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14dffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14e006b9a0 0x7f14e00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14dffff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f14e006b9a0 0x7f14e00b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36574/0 (socket says 172.21.15.80:36574) 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.575+0000 7f14dffff640 1 -- 172.21.15.80:0/1831470558 learned_addr learned my addr 172.21.15.80:0/1831470558 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14e4f19640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e0146c90 0x7f14e01684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14dffff640 1 -- 172.21.15.80:0/1831470558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e0146c90 msgr2=0x7f14e01684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14dffff640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e0146c90 0x7f14e01684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14dffff640 1 -- 172.21.15.80:0/1831470558 >> v1:172.21.15.87:6789/0 conn(0x7f14e00d13e0 legacy=0x7f14e006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.576 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14dffff640 1 -- 172.21.15.80:0/1831470558 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00d1c80 con 0x7f14e006b9a0 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.576+0000 7f14dffff640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e006b9a0 0x7f14e00b45b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009870 tx=0x7f14d002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb43d59257f4d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14df7fe640 1 -- 172.21.15.80:0/1831470558 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0034070 con 0x7f14e006b9a0 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14df7fe640 1 -- 172.21.15.80:0/1831470558 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d0030840 con 0x7f14e006b9a0 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14df7fe640 1 -- 172.21.15.80:0/1831470558 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0030c10 con 0x7f14e006b9a0 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 -- 172.21.15.80:0/1831470558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e006b9a0 msgr2=0x7f14e00b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e006b9a0 0x7f14e00b45b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009870 tx=0x7f14d002b980 comp rx=0 tx=0).stop 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 -- 172.21.15.80:0/1831470558 shutdown_connections 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e0146c90 0x7f14e01684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 --2- 172.21.15.80:0/1831470558 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e006b9a0 0x7f14e00b45b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 -- 172.21.15.80:0/1831470558 >> 172.21.15.80:0/1831470558 conn(0x7f14e00b6ba0 msgr2=0x7f14e009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 -- 172.21.15.80:0/1831470558 shutdown_connections 2024-04-16T15:36:30.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.577+0000 7f14e697c640 1 -- 172.21.15.80:0/1831470558 wait complete. 2024-04-16T15:36:30.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.578+0000 7f14e697c640 1 Processor -- start 2024-04-16T15:36:30.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.578+0000 7f14e697c640 1 -- start start 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e006b9a0 0x7f14e015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14e00d13e0 0x7f14e00b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f14e006c490 con 0x7f14e0146c90 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f14e00d2240 con 0x7f14e00d13e0 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e697c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f14e006c610 con 0x7f14e006b9a0 2024-04-16T15:36:30.581 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36580/0 (socket says 172.21.15.80:36580) 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 -- 172.21.15.80:0/3820523816 learned_addr learned my addr 172.21.15.80:0/3820523816 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14d7fff640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14e00d13e0 0x7f14e00b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14dffff640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e006b9a0 0x7f14e015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 -- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e006b9a0 msgr2=0x7f14e015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e006b9a0 0x7f14e015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 -- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14e00d13e0 msgr2=0x7f14e00b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14e00d13e0 0x7f14e00b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.579+0000 7f14e4f19640 1 -- 172.21.15.80:0/3820523816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e015e830 con 0x7f14e0146c90 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14e4f19640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f14d8007e30 tx=0x7f14d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014620 con 0x7f14e0146c90 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8019070 con 0x7f14e0146c90 2024-04-16T15:36:30.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014a00 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e0143310 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.580+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e0142b10 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.581+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e0068a40 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.581+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14d8014ba0 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.582+0000 7f14dd7fa640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.582+0000 7f14dffff640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.582+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f14d808c680 con 0x7f14e0146c90 2024-04-16T15:36:30.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.582+0000 7f14dffff640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 0x7f14c006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d0036000 tx=0x7f14d003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.585 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.586+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14e015e830 con 0x7f14e0146c90 2024-04-16T15:36:30.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.763+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f14e00b5390 con 0x7f14e0146c90 2024-04-16T15:36:30.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.763+0000 7f14dd7fa640 1 -- 172.21.15.80:0/3820523816 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f14d805a060 con 0x7f14e0146c90 2024-04-16T15:36:30.763 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:30.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 msgr2=0x7f14c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 0x7f14c006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d0036000 tx=0x7f14d003b040 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 msgr2=0x7f14e01606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f14d8007e30 tx=0x7f14d800e4b0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 shutdown_connections 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f14e0146c90 0x7f14e01606c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14e00d13e0 0x7f14e00b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f14c006c8f0 0x7f14c006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 --2- 172.21.15.80:0/3820523816 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f14e006b9a0 0x7f14e015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 >> 172.21.15.80:0/3820523816 conn(0x7f14e00b6ba0 msgr2=0x7f14e006fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 shutdown_connections 2024-04-16T15:36:30.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.765+0000 7f14e697c640 1 -- 172.21.15.80:0/3820523816 wait complete. 2024-04-16T15:36:30.776 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.882+0000 7fb5cc746640 1 Processor -- start 2024-04-16T15:36:30.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.882+0000 7fb5cc746640 1 -- start start 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5cc746640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb5c40b2c00 0x7fb5c40d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5cc746640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40ccba0 con 0x7fb5c40b3190 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5cc746640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40d3210 con 0x7fb5c409b180 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5cc746640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c40b2fe0 con 0x7fb5c40b2c00 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5c9ce1640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5c40b3190 0x7fb5c409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36658/0 (socket says 172.21.15.80:36658) 2024-04-16T15:36:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5c9ce1640 1 -- 172.21.15.80:0/2923254425 learned_addr learned my addr 172.21.15.80:0/2923254425 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/2923254425 >> v2:172.21.15.87:3300/0 conn(0x7fb5c40b2c00 0x7fb5c40d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092420289 0 0) 0x7fb5c40ccba0 con 0x7fb5c40b3190 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.883+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b0003520 con 0x7fb5c40b3190 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810653894 0 0) 0x7fb5b0003520 con 0x7fb5c40b3190 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 >> v2:172.21.15.87:3300/0 conn(0x7fb5c40b2c00 msgr2=0x7fb5c40d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 --2- 172.21.15.80:0/2923254425 >> v2:172.21.15.87:3300/0 conn(0x7fb5c40b2c00 0x7fb5c40d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 >> v1:172.21.15.87:6789/0 conn(0x7fb5c409b180 legacy=0x7fb5c40d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c406d660 con 0x7fb5c40b3190 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fb5b4001670 con 0x7fb5c40b3190 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 >> v1:172.21.15.80:6789/0 conn(0x7fb5c40b3190 legacy=0x7fb5c409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b0004800 0x7fb5b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5b00051c0 0x7fb5b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b000c030 con 0x7fb5b00039b0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b000c1e0 con 0x7fb5b0004800 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b000c3e0 con 0x7fb5b00051c0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5c9ce1640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b0004800 0x7fb5b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5cace3640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5b00051c0 0x7fb5b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 -- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5b00051c0 msgr2=0x7fb5b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5b00051c0 0x7fb5b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 -- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b0004800 msgr2=0x7fb5b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b0004800 0x7fb5b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5ca4e2640 1 -- 172.21.15.80:0/2923254425 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0003520 con 0x7fb5b00039b0 2024-04-16T15:36:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5cace3640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5b00051c0 0x7fb5b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.884+0000 7fb5cace3640 1 -- 172.21.15.80:0/2923254425 reap_dead start 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009ac0 tx=0x7fb5b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc6ecc666ad78db server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0039070 con 0x7fb5b00039b0 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c002c6b0 con 0x7fb5b00039b0 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5c94e0640 1 -- 172.21.15.80:0/2923254425 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009690 con 0x7fb5b00039b0 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5cc746640 1 -- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 msgr2=0x7fb5b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5cc746640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009ac0 tx=0x7fb5b0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5cc746640 1 -- 172.21.15.80:0/2923254425 shutdown_connections 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5cc746640 1 --2- 172.21.15.80:0/2923254425 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5b00039b0 0x7fb5b0003dd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.885+0000 7fb5cc746640 1 -- 172.21.15.80:0/2923254425 >> 172.21.15.80:0/2923254425 conn(0x7fb5c40d2550 msgr2=0x7fb5c40d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.886+0000 7fb5cc746640 1 -- 172.21.15.80:0/2923254425 shutdown_connections 2024-04-16T15:36:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.886+0000 7fb5cc746640 1 -- 172.21.15.80:0/2923254425 wait complete. 2024-04-16T15:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 Processor -- start 2024-04-16T15:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 -- start start 2024-04-16T15:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b00039b0 0x7fb5c4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5c40b05e0 0x7fb5c40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c406dcb0 con 0x7fb5c40c7e00 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40d1f70 con 0x7fb5b00039b0 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5cc746640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c40d20f0 con 0x7fb5c40b05e0 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.887+0000 7fb5c9ce1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36594/0 (socket says 172.21.15.80:36594) 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 -- 172.21.15.80:0/700298214 learned_addr learned my addr 172.21.15.80:0/700298214 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b00039b0 0x7fb5c4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 -- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5c40b05e0 msgr2=0x7fb5c40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5c40b05e0 0x7fb5c40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 -- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b00039b0 msgr2=0x7fb5c4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b00039b0 0x7fb5c4157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 -- 172.21.15.80:0/700298214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40b6b80 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5c9ce1640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40072c0 tx=0x7fb5b4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400f960 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4018070 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c40b5380 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400fd20 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.888+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c40b5940 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.889+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c4068a40 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.890+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5b401d460 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.890+0000 7fb5baffd640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 0x7fb5a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.890+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb5b408c040 con 0x7fb5c40c7e00 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.890+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 0x7fb5a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.890+0000 7fb5ca4e2640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 0x7fb5a806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0036000 tx=0x7fb5c0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:30.894+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5b405a100 con 0x7fb5c40c7e00 2024-04-16T15:36:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.071+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb5c40b5b10 con 0x7fb5c40c7e00 2024-04-16T15:36:31.071 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.072+0000 7fb5baffd640 1 -- 172.21.15.80:0/700298214 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb5b4059a00 con 0x7fb5c40c7e00 2024-04-16T15:36:31.071 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:31.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 msgr2=0x7fb5a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 0x7fb5a806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0036000 tx=0x7fb5c0030000 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 msgr2=0x7fb5c40b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40072c0 tx=0x7fb5b4007780 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 shutdown_connections 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5a806c920 0x7fb5a806ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5c40b05e0 0x7fb5c40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5c40c7e00 0x7fb5c40b6210 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 --2- 172.21.15.80:0/700298214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5b00039b0 0x7fb5c4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 >> 172.21.15.80:0/700298214 conn(0x7fb5c40d2550 msgr2=0x7fb5c40717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 shutdown_connections 2024-04-16T15:36:31.074 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.074+0000 7fb5cc746640 1 -- 172.21.15.80:0/700298214 wait complete. 2024-04-16T15:36:31.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:31.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.190+0000 7fecff4d3640 1 Processor -- start 2024-04-16T15:36:31.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.190+0000 7fecff4d3640 1 -- start start 2024-04-16T15:36:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecff4d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 0x7fecf806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecff4d3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf80cd9f0 0x7fecf815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecff4d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf815bd50 con 0x7fecf806f480 2024-04-16T15:36:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecff4d3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fecf815c030 con 0x7fecf80cd9f0 2024-04-16T15:36:31.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecff4d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fecf815c310 con 0x7fecf8145020 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecfda70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf80cd9f0 0x7fecf815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecfda70640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fecf80cd9f0 0x7fecf815f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36610/0 (socket says 172.21.15.80:36610) 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecfda70640 1 -- 172.21.15.80:0/1565034604 learned_addr learned my addr 172.21.15.80:0/1565034604 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.191+0000 7fecfd26f640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 0x7fecf806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfda70640 1 -- 172.21.15.80:0/1565034604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 msgr2=0x7fecf806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfda70640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 0x7fecf806ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfda70640 1 -- 172.21.15.80:0/1565034604 >> v1:172.21.15.87:6789/0 conn(0x7fecf806f480 legacy=0x7fecf80cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfda70640 1 -- 172.21.15.80:0/1565034604 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf815c5f0 con 0x7fecf80cd9f0 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfd26f640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 0x7fecf806ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:31.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7fecfda70640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf80cd9f0 0x7fecf815f230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fecf000bb10 tx=0x7fecf002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dfb5f074c50536 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7feceffff640 1 -- 172.21.15.80:0/1565034604 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf003b070 con 0x7fecf80cd9f0 2024-04-16T15:36:31.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7feceffff640 1 -- 172.21.15.80:0/1565034604 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0036440 con 0x7fecf80cd9f0 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.192+0000 7feceffff640 1 -- 172.21.15.80:0/1565034604 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0036810 con 0x7fecf80cd9f0 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 -- 172.21.15.80:0/1565034604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf80cd9f0 msgr2=0x7fecf815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf80cd9f0 0x7fecf815f230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fecf000bb10 tx=0x7fecf002e150 comp rx=0 tx=0).stop 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 -- 172.21.15.80:0/1565034604 shutdown_connections 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf80cd9f0 0x7fecf815f230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1565034604 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf8145020 0x7fecf806ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 -- 172.21.15.80:0/1565034604 >> 172.21.15.80:0/1565034604 conn(0x7fecf8067d90 msgr2=0x7fecf806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 -- 172.21.15.80:0/1565034604 shutdown_connections 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.193+0000 7fecff4d3640 1 -- 172.21.15.80:0/1565034604 wait complete. 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.194+0000 7fecff4d3640 1 Processor -- start 2024-04-16T15:36:31.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.194+0000 7fecff4d3640 1 -- start start 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf806f480 0x7fecf80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf80cd9f0 0x7fecf815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fecf815f8f0 con 0x7fecf8145020 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fecf815f770 con 0x7fecf80cd9f0 2024-04-16T15:36:31.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecff4d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fecf815fa70 con 0x7fecf806f480 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfda70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfda70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36626/0 (socket says 172.21.15.80:36626) 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfda70640 1 -- 172.21.15.80:0/1434871927 learned_addr learned my addr 172.21.15.80:0/1434871927 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfd26f640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf806f480 0x7fecf80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfca6e640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf80cd9f0 0x7fecf815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfda70640 1 -- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf806f480 msgr2=0x7fecf80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.195+0000 7fecfda70640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf806f480 0x7fecf80b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecfda70640 1 -- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf80cd9f0 msgr2=0x7fecf815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecfda70640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf80cd9f0 0x7fecf815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecfda70640 1 -- 172.21.15.80:0/1434871927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf813fae0 con 0x7fecf8145020 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecfda70640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b2c0 tx=0x7fecf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0045020 con 0x7fecf8145020 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf00346c0 con 0x7fecf8145020 2024-04-16T15:36:31.197 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf8159ab0 con 0x7fecf8145020 2024-04-16T15:36:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf003b040 con 0x7fecf8145020 2024-04-16T15:36:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.196+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf813fdc0 con 0x7fecf8145020 2024-04-16T15:36:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.197+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf8068a40 con 0x7fecf8145020 2024-04-16T15:36:31.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.197+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecf0048020 con 0x7fecf8145020 2024-04-16T15:36:31.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.198+0000 7fecedffb640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.198+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fecf00b0900 con 0x7fecf8145020 2024-04-16T15:36:31.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.198+0000 7fecfd26f640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.199 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.198+0000 7fecfd26f640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 0x7fecdc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009fd0 tx=0x7fecf40097f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.201 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.202+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fecf004f030 con 0x7fecf8145020 2024-04-16T15:36:31.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.376+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fecf80b36e0 con 0x7fecf8145020 2024-04-16T15:36:31.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.376+0000 7fecedffb640 1 -- 172.21.15.80:0/1434871927 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fecf007e250 con 0x7fecf8145020 2024-04-16T15:36:31.376 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 msgr2=0x7fecdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 0x7fecdc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009fd0 tx=0x7fecf40097f0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 msgr2=0x7fecf813f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b2c0 tx=0x7fecf00046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 shutdown_connections 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fecf8145020 0x7fecf813f090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecf80cd9f0 0x7fecf815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 --2- 172.21.15.80:0/1434871927 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fecf806f480 0x7fecf80b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 >> 172.21.15.80:0/1434871927 conn(0x7fecf8067d90 msgr2=0x7fecf80cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:31.378 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 shutdown_connections 2024-04-16T15:36:31.379 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.378+0000 7fecff4d3640 1 -- 172.21.15.80:0/1434871927 wait complete. 2024-04-16T15:36:31.389 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush' 2024-04-16T15:36:31.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.492+0000 7ffa043f0640 1 Processor -- start 2024-04-16T15:36:31.492 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.492+0000 7ffa043f0640 1 -- start start 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa043f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9fc0af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa043f0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc06b9a0 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa043f0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc06bc80 con 0x7ff9fc15ecf0 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa043f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff9fc0b31a0 con 0x7ff9fc0b07f0 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa0198b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff9fc0b1e50 0x7ff9fc0ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36662/0 (socket says 172.21.15.80:36662) 2024-04-16T15:36:31.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa0198b640 1 -- 172.21.15.80:0/3540688618 learned_addr learned my addr 172.21.15.80:0/3540688618 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa0298d640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9fc0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.493+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172341918 0 0) 0x7ff9fc06b9a0 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e8003520 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652800696 0 0) 0x7ff9e8003520 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 msgr2=0x7ff9fc0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9fc0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 >> v1:172.21.15.87:6789/0 conn(0x7ff9fc15ecf0 legacy=0x7ff9fc0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc06bf60 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7ff9ec001670 con 0x7ff9fc0b1e50 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 >> v1:172.21.15.80:6789/0 conn(0x7ff9fc0b1e50 legacy=0x7ff9fc0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e80039e0 0x7ff9e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e8004390 0x7ff9e8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9e80050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc0b31a0 con 0x7ff9e80039e0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e800b9c0 con 0x7ff9e8004390 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e800bbc0 con 0x7ff9fc0b07f0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e80039e0 0x7ff9e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0198b640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e8004390 0x7ff9e8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0298d640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9e80050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 -- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 msgr2=0x7ff9e80050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9e80050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 -- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e8004390 msgr2=0x7ff9e8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e8004390 0x7ff9e8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0218c640 1 -- 172.21.15.80:0/3540688618 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e8003520 con 0x7ff9e80039e0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.494+0000 7ffa0298d640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc0b07f0 0x7ff9e80050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.495+0000 7ffa0218c640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e80039e0 0x7ff9e8003dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001860 tx=0x7ff9e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a659bc5e0171f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.495+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f802f050 con 0x7ff9e80039e0 2024-04-16T15:36:31.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.495+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f8033650 con 0x7ff9e80039e0 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.495+0000 7ffa0118a640 1 -- 172.21.15.80:0/3540688618 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8001430 con 0x7ff9e80039e0 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 -- 172.21.15.80:0/3540688618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e80039e0 msgr2=0x7ff9e8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 --2- 172.21.15.80:0/3540688618 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9e80039e0 0x7ff9e8003dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001860 tx=0x7ff9e8005830 comp rx=0 tx=0).stop 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa0298d640 1 -- 172.21.15.80:0/3540688618 reap_dead start 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 -- 172.21.15.80:0/3540688618 shutdown_connections 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 -- 172.21.15.80:0/3540688618 >> 172.21.15.80:0/3540688618 conn(0x7ff9fc09aa70 msgr2=0x7ff9fc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 -- 172.21.15.80:0/3540688618 shutdown_connections 2024-04-16T15:36:31.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.496+0000 7ffa043f0640 1 -- 172.21.15.80:0/3540688618 wait complete. 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.497+0000 7ffa043f0640 1 Processor -- start 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.497+0000 7ffa043f0640 1 -- start start 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 0x7ff9fc15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 0x7ff9fc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc0d0fa0 con 0x7ff9fc0b5250 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc06c520 con 0x7ff9e80039e0 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff9fc0d1120 con 0x7ff9fc15d830 2024-04-16T15:36:31.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36646/0 (socket says 172.21.15.80:36646) 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 -- 172.21.15.80:0/1469992027 learned_addr learned my addr 172.21.15.80:0/1469992027 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0218c640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 0x7ff9fc15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0198b640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 0x7ff9fc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 -- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 msgr2=0x7ff9fc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 0x7ff9fc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 -- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 msgr2=0x7ff9fc15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 0x7ff9fc15c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 -- 172.21.15.80:0/1469992027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc0c6060 con 0x7ff9fc0b5250 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0218c640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 0x7ff9fc15c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0198b640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 0x7ff9fc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa0298d640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009ed0 tx=0x7ff9f4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4010dd0 con 0x7ff9fc0b5250 2024-04-16T15:36:31.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f4003990 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc0c52a0 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4003d80 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.498+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc0c5860 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.499+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9fc069150 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.500+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9f401e020 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.500+0000 7ff9f2ffd640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 0x7ff9e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.500+0000 7ffa0218c640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 0x7ff9e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.500+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff9f408c4f0 con 0x7ff9fc0b5250 2024-04-16T15:36:31.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.501+0000 7ffa0218c640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 0x7ff9e006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001860 tx=0x7ff9f8031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:31.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.505+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9f405a520 con 0x7ff9fc0b5250 2024-04-16T15:36:31.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:31.747+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush"]} v 0) -- 0x7ff9fc0af510 con 0x7ff9fc0b5250 2024-04-16T15:36:32.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.057+0000 7ff9f2ffd640 1 -- 172.21.15.80:0/1469992027 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_readahead.TestReadahead.test_flush"]}]=0 v67) ==== 134+0+0 (secure 0 0 0) 0x7ff9f4059e20 con 0x7ff9fc0b5250 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 msgr2=0x7ff9e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 0x7ff9e006ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001860 tx=0x7ff9f8031000 comp rx=0 tx=0).stop 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 msgr2=0x7ff9fc0b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009ed0 tx=0x7ff9f4010590 comp rx=0 tx=0).stop 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 shutdown_connections 2024-04-16T15:36:32.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff9fc0b5250 0x7ff9fc0b56d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff9e006c920 0x7ff9e006ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff9fc15d830 0x7ff9fc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 --2- 172.21.15.80:0/1469992027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9e80039e0 0x7ff9fc15c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 >> 172.21.15.80:0/1469992027 conn(0x7ff9fc09aa70 msgr2=0x7ff9fc0cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 shutdown_connections 2024-04-16T15:36:32.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.059+0000 7ffa043f0640 1 -- 172.21.15.80:0/1469992027 wait complete. 2024-04-16T15:36:32.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T15:36:32.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.177+0000 7f252019d640 1 Processor -- start 2024-04-16T15:36:32.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.177+0000 7f252019d640 1 -- start start 2024-04-16T15:36:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f252019d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f251815cdc0 0x7f25180ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f252019d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25180d1ac0 0x7f251806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f252019d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25180ceea0 con 0x7f2518145eb0 2024-04-16T15:36:32.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f252019d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f25180cf180 con 0x7f25180d1ac0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f252019d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f25180cf460 con 0x7f251815cdc0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25180d1ac0 0x7f251806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f25180d1ac0 0x7f251806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36656/0 (socket says 172.21.15.80:36656) 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 -- 172.21.15.80:0/1404219932 learned_addr learned my addr 172.21.15.80:0/1404219932 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251d738640 1 --2- 172.21.15.80:0/1404219932 >> v2:172.21.15.87:3300/0 conn(0x7f251815cdc0 0x7f25180ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 -- 172.21.15.80:0/1404219932 >> v2:172.21.15.87:3300/0 conn(0x7f251815cdc0 msgr2=0x7f25180ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 --2- 172.21.15.80:0/1404219932 >> v2:172.21.15.87:3300/0 conn(0x7f251815cdc0 0x7f25180ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 -- 172.21.15.80:0/1404219932 >> v1:172.21.15.87:6789/0 conn(0x7f2518145eb0 legacy=0x7f25180d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.178+0000 7f251e73a640 1 -- 172.21.15.80:0/1404219932 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25180cf740 con 0x7f25180d1ac0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.179+0000 7f251e73a640 1 --2- 172.21.15.80:0/1404219932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25180d1ac0 0x7f251806b9a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2518073330 tx=0x7f251002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff2707eeba6364 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.179+0000 7f251cf37640 1 -- 172.21.15.80:0/1404219932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251002ca80 con 0x7f25180d1ac0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.179+0000 7f251cf37640 1 -- 172.21.15.80:0/1404219932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251002cc20 con 0x7f25180d1ac0 2024-04-16T15:36:32.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.179+0000 7f251cf37640 1 -- 172.21.15.80:0/1404219932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25100343f0 con 0x7f25180d1ac0 2024-04-16T15:36:32.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 -- 172.21.15.80:0/1404219932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25180d1ac0 msgr2=0x7f251806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 --2- 172.21.15.80:0/1404219932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25180d1ac0 0x7f251806b9a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2518073330 tx=0x7f251002bee0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 -- 172.21.15.80:0/1404219932 shutdown_connections 2024-04-16T15:36:32.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 --2- 172.21.15.80:0/1404219932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f25180d1ac0 0x7f251806b9a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 --2- 172.21.15.80:0/1404219932 >> v2:172.21.15.87:3300/0 conn(0x7f251815cdc0 0x7f25180ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 -- 172.21.15.80:0/1404219932 >> 172.21.15.80:0/1404219932 conn(0x7f25180b6ba0 msgr2=0x7f251809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 -- 172.21.15.80:0/1404219932 shutdown_connections 2024-04-16T15:36:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.180+0000 7f252019d640 1 -- 172.21.15.80:0/1404219932 wait complete. 2024-04-16T15:36:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.181+0000 7f252019d640 1 Processor -- start 2024-04-16T15:36:32.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.181+0000 7f252019d640 1 -- start start 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25180d1ac0 0x7f25180cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 0x7f251815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2518146410 con 0x7f251815cdc0 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2518146290 con 0x7f25180d1ac0 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f252019d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f25180d1ef0 con 0x7f2518145eb0 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36660/0 (socket says 172.21.15.80:36660) 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 -- 172.21.15.80:0/1755498781 learned_addr learned my addr 172.21.15.80:0/1755498781 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251df39640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25180d1ac0 0x7f25180cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.183 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251d738640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 0x7f251815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 -- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 msgr2=0x7f251815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 0x7f251815c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 -- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25180d1ac0 msgr2=0x7f25180cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25180d1ac0 0x7f25180cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 -- 172.21.15.80:0/1755498781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25180cce70 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251d738640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 0x7f251815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.182+0000 7f251e73a640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2510009f40 tx=0x7f2510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.183+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510043020 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.183+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251003e450 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.183+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25180cd150 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.183+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510009510 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.183+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251809cca0 con 0x7f251815cdc0 2024-04-16T15:36:32.184 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.184+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2518068a40 con 0x7f251815cdc0 2024-04-16T15:36:32.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.184+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2510046020 con 0x7f251815cdc0 2024-04-16T15:36:32.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.184+0000 7f250e7fc640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 0x7f24fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.184+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f25100ae7d0 con 0x7f251815cdc0 2024-04-16T15:36:32.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.184+0000 7f251df39640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 0x7f24fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.185 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.185+0000 7f251df39640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 0x7f24fc06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25180b3e60 tx=0x7f2514007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.188 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.189+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f251004d030 con 0x7f251815cdc0 2024-04-16T15:36:32.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.362+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25180ae7f0 con 0x7f251815cdc0 2024-04-16T15:36:32.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.368+0000 7f250e7fc640 1 -- 172.21.15.80:0/1755498781 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f251007c800 con 0x7f251815cdc0 2024-04-16T15:36:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 msgr2=0x7f24fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 0x7f24fc06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f25180b3e60 tx=0x7f2514007e30 comp rx=0 tx=0).stop 2024-04-16T15:36:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 msgr2=0x7f25180ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2510009f40 tx=0x7f2510004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 shutdown_connections 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f251815cdc0 0x7f25180ca7e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24fc06c8f0 0x7f24fc06edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2518145eb0 0x7f251815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 --2- 172.21.15.80:0/1755498781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25180d1ac0 0x7f25180cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 >> 172.21.15.80:0/1755498781 conn(0x7f25180b6ba0 msgr2=0x7f251806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 shutdown_connections 2024-04-16T15:36:32.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.370+0000 7f252019d640 1 -- 172.21.15.80:0/1755498781 wait complete. 2024-04-16T15:36:32.381 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T15:36:32.381 DEBUG:teuthology.orchestra.run.smithi080:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T15:36:32.425 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T15:36:32.487 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T15:36:32.488 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:32.488 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:32.504 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:32.504 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:32.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:32.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.705+0000 7f065c75f640 1 Processor -- start 2024-04-16T15:36:32.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.705+0000 7f065c75f640 1 -- start start 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065c75f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065415ef80 0x7f065415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065c75f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540cf780 0x7f0654163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065c75f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06540cfbf0 con 0x7f06540d1450 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065c75f640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0654162900 con 0x7f065415ef80 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065c75f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0654162ec0 con 0x7f06540cf780 2024-04-16T15:36:32.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f0659cfa640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f065415ef80 0x7f065415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065a4fb640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f06540d1450 0x7f06540d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36678/0 (socket says 172.21.15.80:36678) 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f065a4fb640 1 -- 172.21.15.80:0/2865111431 learned_addr learned my addr 172.21.15.80:0/2865111431 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f0659cfa640 1 -- 172.21.15.80:0/2865111431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540cf780 msgr2=0x7f0654163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f0659cfa640 1 --2- 172.21.15.80:0/2865111431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540cf780 0x7f0654163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f0659cfa640 1 -- 172.21.15.80:0/2865111431 >> v1:172.21.15.80:6789/0 conn(0x7f06540d1450 legacy=0x7f06540d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.707+0000 7f0659cfa640 1 -- 172.21.15.80:0/2865111431 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06540cfeb0 con 0x7f065415ef80 2024-04-16T15:36:32.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.706+0000 7f06594f9640 1 -- 172.21.15.80:0/2865111431 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80384581 0 0) 0x7f06540cfbf0 con 0x7f06540d1450 2024-04-16T15:36:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.707+0000 7f0659cfa640 1 --2- 172.21.15.80:0/2865111431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065415ef80 0x7f065415fe60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06480097a0 tx=0x7f064802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3cb4fd062d2811 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.707+0000 7f06594f9640 1 -- 172.21.15.80:0/2865111431 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06480315a0 con 0x7f065415ef80 2024-04-16T15:36:32.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.707+0000 7f06594f9640 1 -- 172.21.15.80:0/2865111431 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0648037070 con 0x7f065415ef80 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.707+0000 7f06594f9640 1 -- 172.21.15.80:0/2865111431 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648031960 con 0x7f065415ef80 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 -- 172.21.15.80:0/2865111431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065415ef80 msgr2=0x7f065415fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 --2- 172.21.15.80:0/2865111431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065415ef80 0x7f065415fe60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f06480097a0 tx=0x7f064802b840 comp rx=0 tx=0).stop 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 -- 172.21.15.80:0/2865111431 shutdown_connections 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 --2- 172.21.15.80:0/2865111431 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540cf780 0x7f0654163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 --2- 172.21.15.80:0/2865111431 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f065415ef80 0x7f065415fe60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 -- 172.21.15.80:0/2865111431 >> 172.21.15.80:0/2865111431 conn(0x7f065406ce20 msgr2=0x7f065406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 -- 172.21.15.80:0/2865111431 shutdown_connections 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.708+0000 7f065c75f640 1 -- 172.21.15.80:0/2865111431 wait complete. 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.709+0000 7f065c75f640 1 Processor -- start 2024-04-16T15:36:32.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.709+0000 7f065c75f640 1 -- start start 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540d1450 0x7f06541f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f065415ef80 0x7f06541f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0654162b50 con 0x7f06540cf780 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0654163890 con 0x7f065415ef80 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065c75f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f06540d2ff0 con 0x7f06540d1450 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36684/0 (socket says 172.21.15.80:36684) 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 -- 172.21.15.80:0/3079957699 learned_addr learned my addr 172.21.15.80:0/3079957699 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f0659cfa640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540d1450 0x7f06541f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 -- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540d1450 msgr2=0x7f06541f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540d1450 0x7f06541f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 -- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f065415ef80 msgr2=0x7f06541f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065acfc640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f065415ef80 0x7f06541f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f065415ef80 0x7f06541f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.710+0000 7f065a4fb640 1 -- 172.21.15.80:0/3079957699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06541501b0 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f065a4fb640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f064400cc10 tx=0x7f064400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644017070 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064400ce20 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06541f55a0 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644012640 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.711+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06540c9790 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.712+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0654068a40 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.712+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f064401a070 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.712+0000 7f0652ffd640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 0x7f064006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.713+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f064408bde0 con 0x7f06540cf780 2024-04-16T15:36:32.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.713+0000 7f0659cfa640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 0x7f064006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:32.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.713+0000 7f0659cfa640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 0x7f064006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0648036000 tx=0x7f0648008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:32.716 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.717+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06541501b0 con 0x7f06540cf780 2024-04-16T15:36:32.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.895+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f065406d380 con 0x7f06540cf780 2024-04-16T15:36:32.895 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.896+0000 7f0652ffd640 1 -- 172.21.15.80:0/3079957699 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f0644059e10 con 0x7f06540cf780 2024-04-16T15:36:32.895 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:32.896 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:32.897 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 msgr2=0x7f064006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 0x7f064006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0648036000 tx=0x7f0648008030 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 msgr2=0x7f065414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f064400cc10 tx=0x7f064400a430 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 shutdown_connections 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f065415ef80 0x7f06541f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f064006c8f0 0x7f064006edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f06540d1450 0x7f06541f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 --2- 172.21.15.80:0/3079957699 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06540cf780 0x7f065414fc70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 >> 172.21.15.80:0/3079957699 conn(0x7f065406ce20 msgr2=0x7f0654161d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 shutdown_connections 2024-04-16T15:36:32.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:32.898+0000 7f065c75f640 1 -- 172.21.15.80:0/3079957699 wait complete. 2024-04-16T15:36:32.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:32.909 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:33.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.015+0000 7fc1911e9640 1 Processor -- start 2024-04-16T15:36:33.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.015+0000 7fc1911e9640 1 -- start start 2024-04-16T15:36:33.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc18c15ea60 0x7fc18c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc18c06d530 0x7fc18c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fc18c0b1950 con 0x7fc18c06d530 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc18c0d14f0 con 0x7fc18c15ea60 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc1911e9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0d17d0 con 0x7fc18c15ee40 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc18b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc18c06d530 0x7fc18c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc18b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fc18c06d530 0x7fc18c09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36694/0 (socket says 172.21.15.80:36694) 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.016+0000 7fc18b59e640 1 -- 172.21.15.80:0/869224530 learned_addr learned my addr 172.21.15.80:0/869224530 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18a59c640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 -- 172.21.15.80:0/869224530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 msgr2=0x7fc18c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c06cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18ad9d640 1 --2- 172.21.15.80:0/869224530 >> v2:172.21.15.87:3300/0 conn(0x7fc18c15ea60 0x7fc18c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 -- 172.21.15.80:0/869224530 >> v2:172.21.15.87:3300/0 conn(0x7fc18c15ea60 msgr2=0x7fc18c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 --2- 172.21.15.80:0/869224530 >> v2:172.21.15.87:3300/0 conn(0x7fc18c15ea60 0x7fc18c06cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 -- 172.21.15.80:0/869224530 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0af440 con 0x7fc18c06d530 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc18b59e640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c09aa70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc18c073760 tx=0x7fc18402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4abb38e56873d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.017+0000 7fc189d9b640 1 -- 172.21.15.80:0/869224530 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18402c9e0 con 0x7fc18c06d530 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc189d9b640 1 -- 172.21.15.80:0/869224530 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18402cb80 con 0x7fc18c06d530 2024-04-16T15:36:33.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc189d9b640 1 -- 172.21.15.80:0/869224530 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840343f0 con 0x7fc18c06d530 2024-04-16T15:36:33.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 -- 172.21.15.80:0/869224530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 msgr2=0x7fc18c09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c09aa70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc18c073760 tx=0x7fc18402be40 comp rx=0 tx=0).stop 2024-04-16T15:36:33.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 -- 172.21.15.80:0/869224530 shutdown_connections 2024-04-16T15:36:33.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c09aa70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 --2- 172.21.15.80:0/869224530 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 --2- 172.21.15.80:0/869224530 >> v2:172.21.15.87:3300/0 conn(0x7fc18c15ea60 0x7fc18c06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 -- 172.21.15.80:0/869224530 >> 172.21.15.80:0/869224530 conn(0x7fc18c0b4060 msgr2=0x7fc18c0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 -- 172.21.15.80:0/869224530 shutdown_connections 2024-04-16T15:36:33.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.018+0000 7fc1911e9640 1 -- 172.21.15.80:0/869224530 wait complete. 2024-04-16T15:36:33.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.019+0000 7fc1911e9640 1 Processor -- start 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 -- start start 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc18c15ea60 0x7fc18c1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0d1260 con 0x7fc18c06d530 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0d10e0 con 0x7fc18c15ea60 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc1911e9640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c09afb0 con 0x7fc18c15ee40 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc18ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc18ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36700/0 (socket says 172.21.15.80:36700) 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.020+0000 7fc18ad9d640 1 -- 172.21.15.80:0/536931961 learned_addr learned my addr 172.21.15.80:0/536931961 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 -- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 msgr2=0x7fc18c14c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18b59e640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c14c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18a59c640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc18c15ea60 0x7fc18c1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 -- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc18c15ea60 msgr2=0x7fc18c1e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc18c15ea60 0x7fc18c1e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 -- 172.21.15.80:0/536931961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0cd3b0 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc18ad9d640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00c7f0 tx=0x7fc17c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c015070 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c004240 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0ccdf0 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c007620 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.021+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c1e7f80 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.022+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c069150 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.022+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc17c0077c0 con 0x7fc18c06d530 2024-04-16T15:36:33.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.023+0000 7fc1737fe640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 0x7fc17806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.023+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc17c08c0d0 con 0x7fc18c06d530 2024-04-16T15:36:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.023+0000 7fc18a59c640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 0x7fc17806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.023+0000 7fc18a59c640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 0x7fc17806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc18c1f7db0 tx=0x7fc180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.027+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc18c0cd3b0 con 0x7fc18c06d530 2024-04-16T15:36:33.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.202+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc18c0b2b10 con 0x7fc18c06d530 2024-04-16T15:36:33.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.203+0000 7fc1737fe640 1 -- 172.21.15.80:0/536931961 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc17c05a190 con 0x7fc18c06d530 2024-04-16T15:36:33.202 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:33.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 msgr2=0x7fc17806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 0x7fc17806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc18c1f7db0 tx=0x7fc180008040 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 msgr2=0x7fc18c1e8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00c7f0 tx=0x7fc17c00ccb0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 shutdown_connections 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc17806c8f0 0x7fc17806edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc18c15ee40 0x7fc18c14c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc18c15ea60 0x7fc18c1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 --2- 172.21.15.80:0/536931961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc18c06d530 0x7fc18c1e8780 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 >> 172.21.15.80:0/536931961 conn(0x7fc18c0b4060 msgr2=0x7fc18c15db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 shutdown_connections 2024-04-16T15:36:33.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.205+0000 7fc1911e9640 1 -- 172.21.15.80:0/536931961 wait complete. 2024-04-16T15:36:33.215 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:33.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.322+0000 7f24ca28f640 1 Processor -- start 2024-04-16T15:36:33.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.322+0000 7f24ca28f640 1 -- start start 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24ca28f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24c41665c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24ca28f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c415bd50 con 0x7f24c4145020 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24ca28f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c415c030 con 0x7f24c406f650 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24ca28f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f24c415c310 con 0x7f24c40cd9f0 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f24c4145020 0x7f24c406ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36692/0 (socket says 172.21.15.80:36692) 2024-04-16T15:36:33.325 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c3fff640 1 -- 172.21.15.80:0/2431363708 learned_addr learned my addr 172.21.15.80:0/2431363708 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386746384 0 0) 0x7f24c415bd50 con 0x7f24c4145020 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24ac003520 con 0x7f24c4145020 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c882c640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24c41665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2223227738 0 0) 0x7f24ac003520 con 0x7f24c4145020 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 msgr2=0x7f24c41665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24c41665c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 >> v1:172.21.15.87:6789/0 conn(0x7f24c406f650 legacy=0x7f24c40cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.323+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c415c5f0 con 0x7f24c4145020 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f24b4001670 con 0x7f24c4145020 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 >> v1:172.21.15.80:6789/0 conn(0x7f24c4145020 legacy=0x7f24c406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.326 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac004d40 0x7f24ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f24c415c310 con 0x7f24ac003f60 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac00dcb0 con 0x7f24ac004d40 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f24ac00deb0 con 0x7f24c40cd9f0 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c3fff640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c882c640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac004d40 0x7f24ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 -- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 msgr2=0x7f24ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c40cd9f0 0x7f24ac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 -- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac004d40 msgr2=0x7f24ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24ac004d40 0x7f24ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.324+0000 7f24c37fe640 1 -- 172.21.15.80:0/2431363708 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac003520 con 0x7f24ac003f60 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24c37fe640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24ac004800 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24b8001750 tx=0x7f24ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e01a470439fdcec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8001370 con 0x7f24ac003f60 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b80052d0 con 0x7f24ac003f60 2024-04-16T15:36:33.327 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24c2ffd640 1 -- 172.21.15.80:0/2431363708 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8003830 con 0x7f24ac003f60 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 -- 172.21.15.80:0/2431363708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 msgr2=0x7f24ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 --2- 172.21.15.80:0/2431363708 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24ac004800 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24b8001750 tx=0x7f24ac005830 comp rx=0 tx=0).stop 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24c882c640 1 -- 172.21.15.80:0/2431363708 reap_dead start 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 -- 172.21.15.80:0/2431363708 shutdown_connections 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 -- 172.21.15.80:0/2431363708 >> 172.21.15.80:0/2431363708 conn(0x7f24c4067d90 msgr2=0x7f24c406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 -- 172.21.15.80:0/2431363708 shutdown_connections 2024-04-16T15:36:33.328 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.325+0000 7f24ca28f640 1 -- 172.21.15.80:0/2431363708 wait complete. 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 Processor -- start 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 -- start start 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24c4156db0 0x7f24c406e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c4157230 0x7f24c406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f24c406dfb0 con 0x7f24ac003f60 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f24c406de30 con 0x7f24c4156db0 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.327+0000 7f24ca28f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f24c406e130 con 0x7f24c4157230 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36712/0 (socket says 172.21.15.80:36712) 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 -- 172.21.15.80:0/812127162 learned_addr learned my addr 172.21.15.80:0/812127162 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 -- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c4157230 msgr2=0x7f24c406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c4157230 0x7f24c406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 -- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24c4156db0 msgr2=0x7f24c406e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24c4156db0 0x7f24c406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 -- 172.21.15.80:0/812127162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c4143b30 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c3fff640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24b40011e0 tx=0x7f24b4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b400f8e0 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b4018070 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c4143db0 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b400fce0 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.328+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c4144370 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.329+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c4155570 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.329+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24b401d460 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.330+0000 7f24c0ff9640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 0x7f24b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.330+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f24b408bff0 con 0x7f24ac003f60 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.330+0000 7f24c37fe640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 0x7f24b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.330+0000 7f24c37fe640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 0x7f24b006edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24b8033000 tx=0x7f24b802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.334+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f24c4155570 con 0x7f24ac003f60 2024-04-16T15:36:33.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.509+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24c4068a40 con 0x7f24ac003f60 2024-04-16T15:36:33.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.510+0000 7f24c0ff9640 1 -- 172.21.15.80:0/812127162 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f24c4143b30 con 0x7f24ac003f60 2024-04-16T15:36:33.509 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:33.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.511+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 msgr2=0x7f24b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.511+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 0x7f24b006edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24b8033000 tx=0x7f24b802f000 comp rx=0 tx=0).stop 2024-04-16T15:36:33.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.511+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 msgr2=0x7f24c413a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.511+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24b40011e0 tx=0x7f24b4007720 comp rx=0 tx=0).stop 2024-04-16T15:36:33.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 shutdown_connections 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f24b006c8f0 0x7f24b006edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f24c4157230 0x7f24c406e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24c4156db0 0x7f24c406e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 --2- 172.21.15.80:0/812127162 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f24ac003f60 0x7f24c413a9c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 >> 172.21.15.80:0/812127162 conn(0x7f24c4067d90 msgr2=0x7f24c40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 shutdown_connections 2024-04-16T15:36:33.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.512+0000 7f24ca28f640 1 -- 172.21.15.80:0/812127162 wait complete. 2024-04-16T15:36:33.522 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:33.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.629+0000 7f6d90fa8640 1 Processor -- start 2024-04-16T15:36:33.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.629+0000 7f6d90fa8640 1 -- start start 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d90fa8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d8c0728c0 0x7f6d8c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d90fa8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0afb30 0x7f6d8c0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d90fa8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8c0b3a10 con 0x7f6d8c148190 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d90fa8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8c0734c0 con 0x7f6d8c0728c0 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d90fa8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c148570 con 0x7f6d8c0afb30 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d8a59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6d8c148190 0x7f6d8c0721b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36700/0 (socket says 172.21.15.80:36700) 2024-04-16T15:36:33.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d8a59c640 1 -- 172.21.15.80:0/3009887124 learned_addr learned my addr 172.21.15.80:0/3009887124 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471121828 0 0) 0x7f6d8c0b3a10 con 0x7f6d8c148190 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d8ad9d640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0afb30 0x7f6d8c0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d78003520 con 0x7f6d8c148190 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.630+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3009887124 >> v2:172.21.15.87:3300/0 conn(0x7f6d8c0728c0 0x7f6d8c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3890123255 0 0) 0x7f6d78003520 con 0x7f6d8c148190 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0afb30 msgr2=0x7f6d8c0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0afb30 0x7f6d8c0b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 >> v2:172.21.15.87:3300/0 conn(0x7f6d8c0728c0 msgr2=0x7f6d8c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 --2- 172.21.15.80:0/3009887124 >> v2:172.21.15.87:3300/0 conn(0x7f6d8c0728c0 0x7f6d8c0aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c0b3cd0 con 0x7f6d8c148190 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f6d7c0019f0 con 0x7f6d8c148190 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 >> v1:172.21.15.80:6789/0 conn(0x7f6d8c148190 legacy=0x7f6d8c0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d780039b0 0x7f6d78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d78004800 0x7f6d78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780051c0 0x7f6d7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0734c0 con 0x7f6d780039b0 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c148570 con 0x7f6d780051c0 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d7800bfe0 con 0x7f6d78004800 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8ad9d640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0afb30 0x7f6d8c0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d780039b0 0x7f6d78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d78004800 0x7f6d78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8ad9d640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780051c0 0x7f6d7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 -- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d78004800 msgr2=0x7f6d78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d78004800 0x7f6d78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 -- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780051c0 msgr2=0x7f6d7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780051c0 0x7f6d7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8a59c640 1 -- 172.21.15.80:0/3009887124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d78003520 con 0x7f6d780039b0 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d8ad9d640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780051c0 0x7f6d7800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.631+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d78004800 0x7f6d78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d780039b0 0x7f6d78003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00a880 tx=0x7f6d78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa56030f6071a3e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00a4a0 con 0x7f6d780039b0 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c034650 con 0x7f6d780039b0 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d8959a640 1 -- 172.21.15.80:0/3009887124 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c034a40 con 0x7f6d780039b0 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3009887124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d780039b0 msgr2=0x7f6d78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3009887124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d780039b0 0x7f6d78003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00a880 tx=0x7f6d78005830 comp rx=0 tx=0).stop 2024-04-16T15:36:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.632+0000 7f6d8ad9d640 1 -- 172.21.15.80:0/3009887124 reap_dead start 2024-04-16T15:36:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.633+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3009887124 shutdown_connections 2024-04-16T15:36:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.633+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3009887124 >> 172.21.15.80:0/3009887124 conn(0x7f6d8c0b2590 msgr2=0x7f6d8c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.633+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3009887124 shutdown_connections 2024-04-16T15:36:33.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.633+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3009887124 wait complete. 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.634+0000 7f6d90fa8640 1 Processor -- start 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.634+0000 7f6d90fa8640 1 -- start start 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780039b0 0x7f6d8c144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0c8ba0 0x7f6d8c0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c15ef00 con 0x7f6d8c145fc0 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0b4290 con 0x7f6d780039b0 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c15f080 con 0x7f6d8c0c8ba0 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36718/0 (socket says 172.21.15.80:36718) 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 -- 172.21.15.80:0/3938240127 learned_addr learned my addr 172.21.15.80:0/3938240127 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:33.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780039b0 0x7f6d8c144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d8ad9d640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0c8ba0 0x7f6d8c0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 -- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0c8ba0 msgr2=0x7f6d8c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0c8ba0 0x7f6d8c0cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 -- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780039b0 msgr2=0x7f6d8c144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780039b0 0x7f6d8c144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 -- 172.21.15.80:0/3938240127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c1f8760 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d89d9b640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400f4e0 tx=0x7f6d74004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74018020 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d74014870 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c144f20 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74014c60 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.635+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c1454e0 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.636+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c068a40 con 0x7f6d8c145fc0 2024-04-16T15:36:33.641 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.637+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d7401b020 con 0x7f6d8c145fc0 2024-04-16T15:36:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.637+0000 7f6d82ffd640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 0x7f6d6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.637+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6d7408c200 con 0x7f6d8c145fc0 2024-04-16T15:36:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.637+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 0x7f6d6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.638+0000 7f6d8a59c640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 0x7f6d6c06ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c034000 tx=0x7f6d7c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.642 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.642+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d74022020 con 0x7f6d8c145fc0 2024-04-16T15:36:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.817+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6d8c0cf9d0 con 0x7f6d8c145fc0 2024-04-16T15:36:33.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.817+0000 7f6d82ffd640 1 -- 172.21.15.80:0/3938240127 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6d8c1f8760 con 0x7f6d8c145fc0 2024-04-16T15:36:33.817 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 msgr2=0x7f6d6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 0x7f6d6c06ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c034000 tx=0x7f6d7c009030 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 msgr2=0x7f6d8c1f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400f4e0 tx=0x7f6d74004610 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 shutdown_connections 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6d6c06c920 0x7f6d6c06ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6d8c0c8ba0 0x7f6d8c0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d8c145fc0 0x7f6d8c1f8220 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 --2- 172.21.15.80:0/3938240127 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d780039b0 0x7f6d8c144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 >> 172.21.15.80:0/3938240127 conn(0x7f6d8c0b2590 msgr2=0x7f6d8c161620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 shutdown_connections 2024-04-16T15:36:33.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.819+0000 7f6d90fa8640 1 -- 172.21.15.80:0/3938240127 wait complete. 2024-04-16T15:36:33.830 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.936+0000 7f7936f8d640 1 Processor -- start 2024-04-16T15:36:33.936 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.936+0000 7f7936f8d640 1 -- start start 2024-04-16T15:36:33.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7936f8d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79300d1d90 0x7f7930169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7936f8d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793015eb80 con 0x7f793015e7a0 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7936f8d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300d32a0 con 0x7f79300b3870 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7936f8d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f79300d3580 con 0x7f79300d1d90 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7934d29640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f793015e7a0 0x7f79300cf6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36714/0 (socket says 172.21.15.80:36714) 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f7934d29640 1 -- 172.21.15.80:0/299416017 learned_addr learned my addr 172.21.15.80:0/299416017 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.937+0000 7f793552a640 1 --2- 172.21.15.80:0/299416017 >> v2:172.21.15.87:3300/0 conn(0x7f79300d1d90 0x7f7930169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451406620 0 0) 0x7f793015eb80 con 0x7f793015e7a0 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7920003520 con 0x7f793015e7a0 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1499270526 0 0) 0x7f7920003520 con 0x7f793015e7a0 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 >> v2:172.21.15.87:3300/0 conn(0x7f79300d1d90 msgr2=0x7f7930169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 --2- 172.21.15.80:0/299416017 >> v2:172.21.15.87:3300/0 conn(0x7f79300d1d90 0x7f7930169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 >> v1:172.21.15.87:6789/0 conn(0x7f79300b3870 legacy=0x7f79300d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300d3860 con 0x7f793015e7a0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f7924001690 con 0x7f793015e7a0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 >> v1:172.21.15.80:6789/0 conn(0x7f793015e7a0 legacy=0x7f79300cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79200039b0 0x7f7920003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f7920004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79200051c0 0x7f792000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f79300d3580 con 0x7f7920004800 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f792000c070 con 0x7f79200039b0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f792000c270 con 0x7f79200051c0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f7920004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f7934d29640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79200039b0 0x7f7920003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f793552a640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79200051c0 0x7f792000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 -- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79200051c0 msgr2=0x7f792000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f79200051c0 0x7f792000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 -- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79200039b0 msgr2=0x7f7920003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:33.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79200039b0 0x7f7920003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f792ffff640 1 -- 172.21.15.80:0/299416017 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7920003520 con 0x7f7920004800 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.938+0000 7f793552a640 1 -- 172.21.15.80:0/299416017 reap_dead start 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.939+0000 7f792ffff640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f7920004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f791c001750 tx=0x7f7920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4c6ecccacc5388 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.939+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c001370 con 0x7f7920004800 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.939+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c0052d0 con 0x7f7920004800 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.939+0000 7f792f7fe640 1 -- 172.21.15.80:0/299416017 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c003830 con 0x7f7920004800 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 -- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 msgr2=0x7f7920004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f7920004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f791c001750 tx=0x7f7920005830 comp rx=0 tx=0).stop 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 -- 172.21.15.80:0/299416017 shutdown_connections 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 --2- 172.21.15.80:0/299416017 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f7920004c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 -- 172.21.15.80:0/299416017 >> 172.21.15.80:0/299416017 conn(0x7f79300734f0 msgr2=0x7f7930073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 -- 172.21.15.80:0/299416017 shutdown_connections 2024-04-16T15:36:33.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.940+0000 7f7936f8d640 1 -- 172.21.15.80:0/299416017 wait complete. 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.941+0000 7f7936f8d640 1 Processor -- start 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.941+0000 7f7936f8d640 1 -- start start 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79301f4d00 0x7f79301f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7930150240 0x7f79301506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f79300b7720 con 0x7f7920004800 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79300d3e20 con 0x7f79301f4d00 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7936f8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f79300d1680 con 0x7f7930150240 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36730/0 (socket says 172.21.15.80:36730) 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 -- 172.21.15.80:0/2409982463 learned_addr learned my addr 172.21.15.80:0/2409982463 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f793552a640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7930150240 0x7f79301506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f792ffff640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79301f4d00 0x7f79301f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 -- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7930150240 msgr2=0x7f79301506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7930150240 0x7f79301506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 -- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79301f4d00 msgr2=0x7f79301f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79301f4d00 0x7f79301f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 -- 172.21.15.80:0/2409982463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300cc870 con 0x7f7920004800 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.942+0000 7f7934d29640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79240072f0 tx=0x7f79240077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.943+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792400f8e0 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.943+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7924018070 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.943+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792400fce0 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.943+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793014ad30 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.943+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301616b0 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.944+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7930068a40 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.944+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f792401d460 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.945+0000 7f792d7fa640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 0x7f791406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.945+0000 7f792ffff640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 0x7f791406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.945+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f792408bf00 con 0x7f7920004800 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.945+0000 7f792ffff640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 0x7f791406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f791c033000 tx=0x7f791c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:33.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:33.949+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7924059f30 con 0x7f7920004800 2024-04-16T15:36:34.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.125+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7930073970 con 0x7f7920004800 2024-04-16T15:36:34.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.126+0000 7f792d7fa640 1 -- 172.21.15.80:0/2409982463 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f7924059830 con 0x7f7920004800 2024-04-16T15:36:34.125 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 msgr2=0x7f791406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 0x7f791406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f791c033000 tx=0x7f791c009030 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 msgr2=0x7f79301f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79240072f0 tx=0x7f79240077b0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 shutdown_connections 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f791406c8f0 0x7f791406edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7930150240 0x7f79301506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79301f4d00 0x7f79301f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 --2- 172.21.15.80:0/2409982463 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7920004800 0x7f79301f8010 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 >> 172.21.15.80:0/2409982463 conn(0x7f79300734f0 msgr2=0x7f793015dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 shutdown_connections 2024-04-16T15:36:34.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.128+0000 7f7936f8d640 1 -- 172.21.15.80:0/2409982463 wait complete. 2024-04-16T15:36:34.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.243+0000 7f6e98d67640 1 Processor -- start 2024-04-16T15:36:34.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 -- start start 2024-04-16T15:36:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e94145020 0x7f6e9406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e9406f480 0x7f6e940cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9415bd50 con 0x7f6e940cd820 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9415c030 con 0x7f6e9406f480 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.244+0000 7f6e98d67640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9415c310 con 0x7f6e94145020 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e92d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6e940cd820 0x7f6e940cf2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:36728/0 (socket says 172.21.15.80:36728) 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e91d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e9406f480 0x7f6e940cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e92d9d640 1 -- 172.21.15.80:0/3453255171 learned_addr learned my addr 172.21.15.80:0/3453255171 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e9259c640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e94145020 0x7f6e9406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e91d9b640 1 -- 172.21.15.80:0/3453255171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e94145020 msgr2=0x7f6e9406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e91d9b640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e94145020 0x7f6e9406ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e91d9b640 1 -- 172.21.15.80:0/3453255171 >> v1:172.21.15.80:6789/0 conn(0x7f6e940cd820 legacy=0x7f6e940cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e91d9b640 1 -- 172.21.15.80:0/3453255171 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9415c5f0 con 0x7f6e9406f480 2024-04-16T15:36:34.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.245+0000 7f6e9159a640 1 -- 172.21.15.80:0/3453255171 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526093105 0 0) 0x7f6e9415bd50 con 0x7f6e940cd820 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e91d9b640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e9406f480 0x7f6e940cd2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097a0 tx=0x7f6e8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4deceaeec51864 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e9159a640 1 -- 172.21.15.80:0/3453255171 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88035020 con 0x7f6e9406f480 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e9159a640 1 -- 172.21.15.80:0/3453255171 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88031830 con 0x7f6e9406f480 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e9159a640 1 -- 172.21.15.80:0/3453255171 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88031c00 con 0x7f6e9406f480 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 -- 172.21.15.80:0/3453255171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e9406f480 msgr2=0x7f6e940cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e9406f480 0x7f6e940cd2e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097a0 tx=0x7f6e8802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 -- 172.21.15.80:0/3453255171 shutdown_connections 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e9406f480 0x7f6e940cd2e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 --2- 172.21.15.80:0/3453255171 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e94145020 0x7f6e9406ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.246+0000 7f6e98d67640 1 -- 172.21.15.80:0/3453255171 >> 172.21.15.80:0/3453255171 conn(0x7f6e94067d90 msgr2=0x7f6e9406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.247+0000 7f6e98d67640 1 -- 172.21.15.80:0/3453255171 shutdown_connections 2024-04-16T15:36:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.247+0000 7f6e98d67640 1 -- 172.21.15.80:0/3453255171 wait complete. 2024-04-16T15:36:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 Processor -- start 2024-04-16T15:36:34.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 -- start start 2024-04-16T15:36:34.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e9406f480 0x7f6e941f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e940cd820 0x7f6e94143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940b3f90 con 0x7f6e94145020 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940b3e10 con 0x7f6e9406f480 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.248+0000 7f6e98d67640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6e940cf9d0 con 0x7f6e940cd820 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36746/0 (socket says 172.21.15.80:36746) 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 -- 172.21.15.80:0/1179111001 learned_addr learned my addr 172.21.15.80:0/1179111001 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e91d9b640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e940cd820 0x7f6e94143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e9259c640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e9406f480 0x7f6e941f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 -- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e940cd820 msgr2=0x7f6e94143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e940cd820 0x7f6e94143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 -- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e9406f480 msgr2=0x7f6e941f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e9406f480 0x7f6e941f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 -- 172.21.15.80:0/1179111001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e94140520 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e92d9d640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c7a0 tx=0x7f6e8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84018070 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8400a640 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e94140800 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400aab0 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.249+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e94140dc0 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.250+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e94075460 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.251+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e8401b070 con 0x7f6e94145020 2024-04-16T15:36:34.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.251+0000 7f6e82ffd640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 0x7f6e7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.251+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e8408b440 con 0x7f6e94145020 2024-04-16T15:36:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.251+0000 7f6e9259c640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 0x7f6e7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.252+0000 7f6e9259c640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 0x7f6e7406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c006fd0 tx=0x7f6e8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.255+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e94075460 con 0x7f6e94145020 2024-04-16T15:36:34.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.440+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6e940b36e0 con 0x7f6e94145020 2024-04-16T15:36:34.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.441+0000 7f6e82ffd640 1 -- 172.21.15.80:0/1179111001 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6e84058eb0 con 0x7f6e94145020 2024-04-16T15:36:34.440 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:34.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 msgr2=0x7f6e7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 0x7f6e7406edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c006fd0 tx=0x7f6e8c008040 comp rx=0 tx=0).stop 2024-04-16T15:36:34.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 msgr2=0x7f6e941ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c7a0 tx=0x7f6e8400cc60 comp rx=0 tx=0).stop 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 shutdown_connections 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e94145020 0x7f6e941ee2e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e7406c8f0 0x7f6e7406edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.442+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e940cd820 0x7f6e94143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.443+0000 7f6e98d67640 1 --2- 172.21.15.80:0/1179111001 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e9406f480 0x7f6e941f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.443+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 >> 172.21.15.80:0/1179111001 conn(0x7f6e94067d90 msgr2=0x7f6e940b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.443+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 shutdown_connections 2024-04-16T15:36:34.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.443+0000 7f6e98d67640 1 -- 172.21.15.80:0/1179111001 wait complete. 2024-04-16T15:36:34.453 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:34.453 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:34.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:34.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.613+0000 7f581e4a0640 1 Processor -- start 2024-04-16T15:36:34.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.613+0000 7f581e4a0640 1 -- start start 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f581e4a0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58180b6030 0x7f58180ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f581e4a0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5818161270 con 0x7f581813f7c0 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f581e4a0640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581813fe10 con 0x7f58180cea50 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f581e4a0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f58180a95e0 con 0x7f58180b6030 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f58177fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58180b6030 0x7f58180ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f5817fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f581813f7c0 0x7f58180b5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45630/0 (socket says 172.21.15.80:45630) 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f58177fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f58180b6030 0x7f58180ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50696/0 (socket says 172.21.15.80:50696) 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f5817fff640 1 -- 172.21.15.80:0/392667077 learned_addr learned my addr 172.21.15.80:0/392667077 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.614+0000 7f58177fe640 1 -- 172.21.15.80:0/392667077 >> v1:172.21.15.87:6789/0 conn(0x7f58180cea50 legacy=0x7f581815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f58177fe640 1 -- 172.21.15.80:0/392667077 >> v1:172.21.15.80:6789/0 conn(0x7f581813f7c0 legacy=0x7f58180b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f5816ffd640 1 -- 172.21.15.80:0/392667077 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763574438 0 0) 0x7f5818161270 con 0x7f581813f7c0 2024-04-16T15:36:34.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f58177fe640 1 -- 172.21.15.80:0/392667077 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5818142d20 con 0x7f58180b6030 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f58177fe640 1 --2- 172.21.15.80:0/392667077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58180b6030 0x7f58180ce510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62140b8c9bb5e8f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f5816ffd640 1 -- 172.21.15.80:0/392667077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c02f810 con 0x7f58180b6030 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f5816ffd640 1 -- 172.21.15.80:0/392667077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c02f9b0 con 0x7f58180b6030 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.615+0000 7f5816ffd640 1 -- 172.21.15.80:0/392667077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c02fd80 con 0x7f58180b6030 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 -- 172.21.15.80:0/392667077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58180b6030 msgr2=0x7f58180ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 --2- 172.21.15.80:0/392667077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58180b6030 0x7f58180ce510 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02b9f0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 -- 172.21.15.80:0/392667077 shutdown_connections 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 --2- 172.21.15.80:0/392667077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58180b6030 0x7f58180ce510 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 -- 172.21.15.80:0/392667077 >> 172.21.15.80:0/392667077 conn(0x7f58180b2940 msgr2=0x7f581806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 -- 172.21.15.80:0/392667077 shutdown_connections 2024-04-16T15:36:34.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.616+0000 7f581e4a0640 1 -- 172.21.15.80:0/392667077 wait complete. 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.617+0000 7f581e4a0640 1 Processor -- start 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.617+0000 7f581e4a0640 1 -- start start 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 0x7f581813eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 0x7f58181e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5818160790 con 0x7f581813f7c0 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5818160de0 con 0x7f58180cea50 2024-04-16T15:36:34.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581e4a0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f5818160a70 con 0x7f58180b6030 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581ca3d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581ca3d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50700/0 (socket says 172.21.15.80:50700) 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f581ca3d640 1 -- 172.21.15.80:0/1654565412 learned_addr learned my addr 172.21.15.80:0/1654565412 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.618+0000 7f5817fff640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 0x7f581813eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f58177fe640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 0x7f58181e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 -- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 msgr2=0x7f581813eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 0x7f581813eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 -- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 msgr2=0x7f58181e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 0x7f58181e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 -- 172.21.15.80:0/1654565412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58181432d0 con 0x7f581813f7c0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f5817fff640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 0x7f581813eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f58177fe640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 0x7f58181e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581ca3d640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f581000c7a0 tx=0x7f581000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810003b70 con 0x7f581813f7c0 2024-04-16T15:36:34.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5810003d30 con 0x7f581813f7c0 2024-04-16T15:36:34.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581000aa90 con 0x7f581813f7c0 2024-04-16T15:36:34.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58181435b0 con 0x7f581813f7c0 2024-04-16T15:36:34.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.619+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5818143b70 con 0x7f581813f7c0 2024-04-16T15:36:34.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.620+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818068a40 con 0x7f581813f7c0 2024-04-16T15:36:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.620+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f581000ac30 con 0x7f581813f7c0 2024-04-16T15:36:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.621+0000 7f5814ff9640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 0x7f580406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.621+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f581008be60 con 0x7f581813f7c0 2024-04-16T15:36:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.621+0000 7f5817fff640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 0x7f580406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.621+0000 7f5817fff640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 0x7f580406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.625+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5810059f20 con 0x7f581813f7c0 2024-04-16T15:36:34.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.802+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58180cf410 con 0x7f581813f7c0 2024-04-16T15:36:34.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.803+0000 7f5814ff9640 1 -- 172.21.15.80:0/1654565412 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f5810059820 con 0x7f581813f7c0 2024-04-16T15:36:34.803 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:34.803 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 msgr2=0x7f580406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 0x7f580406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f60 tx=0x7f5808009040 comp rx=0 tx=0).stop 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 msgr2=0x7f58181455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f581000c7a0 tx=0x7f581000cc60 comp rx=0 tx=0).stop 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 shutdown_connections 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f581813f7c0 0x7f58181455c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58180cea50 0x7f58181e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f580406c8f0 0x7f580406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 --2- 172.21.15.80:0/1654565412 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f58180b6030 0x7f581813eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 >> 172.21.15.80:0/1654565412 conn(0x7f58180b2940 msgr2=0x7f5818071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.805+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 shutdown_connections 2024-04-16T15:36:34.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.806+0000 7f581e4a0640 1 -- 172.21.15.80:0/1654565412 wait complete. 2024-04-16T15:36:34.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:34.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.924+0000 7f2dee250640 1 Processor -- start 2024-04-16T15:36:34.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2dee250640 1 -- start start 2024-04-16T15:36:34.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2dee250640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2dee250640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de80d14f0 con 0x7f2de815ea60 2024-04-16T15:36:34.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2dee250640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de80d17d0 con 0x7f2de80afc40 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2dee250640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2de80b1950 con 0x7f2de815ee40 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2de77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f2de815ea60 0x7f2de806cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45634/0 (socket says 172.21.15.80:45634) 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.925+0000 7f2de77fe640 1 -- 172.21.15.80:0/3409202393 learned_addr learned my addr 172.21.15.80:0/3409202393 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2ddeffd640 1 --2- 172.21.15.80:0/3409202393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229881625 0 0) 0x7f2de80d14f0 con 0x7f2de815ea60 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dd4003520 con 0x7f2de815ea60 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763723073 0 0) 0x7f2de80d17d0 con 0x7f2de80afc40 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2de80d14f0 con 0x7f2de80afc40 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2ddeffd640 1 -- 172.21.15.80:0/3409202393 >> v1:172.21.15.87:6789/0 conn(0x7f2de80afc40 legacy=0x7f2de80b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2ddeffd640 1 -- 172.21.15.80:0/3409202393 >> v1:172.21.15.80:6789/0 conn(0x7f2de815ea60 legacy=0x7f2de806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.926+0000 7f2ddeffd640 1 -- 172.21.15.80:0/3409202393 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de80af440 con 0x7f2de815ee40 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2ddeffd640 1 --2- 172.21.15.80:0/3409202393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de806d1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097d0 tx=0x7f2dd002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5336b2190b1d2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0035020 con 0x7f2de815ee40 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0031800 con 0x7f2de815ee40 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2de6ffd640 1 -- 172.21.15.80:0/3409202393 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0031bb0 con 0x7f2de815ee40 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2dee250640 1 -- 172.21.15.80:0/3409202393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 msgr2=0x7f2de806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2dee250640 1 --2- 172.21.15.80:0/3409202393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de806d1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097d0 tx=0x7f2dd002b8a0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2dee250640 1 -- 172.21.15.80:0/3409202393 shutdown_connections 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2dee250640 1 --2- 172.21.15.80:0/3409202393 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de806d1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.927+0000 7f2dee250640 1 -- 172.21.15.80:0/3409202393 >> 172.21.15.80:0/3409202393 conn(0x7f2de80b4060 msgr2=0x7f2de80b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.928+0000 7f2dee250640 1 -- 172.21.15.80:0/3409202393 shutdown_connections 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.928+0000 7f2dee250640 1 -- 172.21.15.80:0/3409202393 wait complete. 2024-04-16T15:36:34.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 Processor -- start 2024-04-16T15:36:34.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 -- start start 2024-04-16T15:36:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 0x7f2de80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de814cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2de80d1260 con 0x7f2de815ea60 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2de80d10e0 con 0x7f2de80afc40 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.929+0000 7f2dee250640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2de809ba80 con 0x7f2de815ee40 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50706/0 (socket says 172.21.15.80:50706) 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 -- 172.21.15.80:0/2843327043 learned_addr learned my addr 172.21.15.80:0/2843327043 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de77fe640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 0x7f2de80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de7fff640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de814cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 -- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 msgr2=0x7f2de814cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de814cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 -- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 msgr2=0x7f2de80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 0x7f2de80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 -- 172.21.15.80:0/2843327043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de81e3f30 con 0x7f2de815ea60 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de77fe640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 0x7f2de80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:34.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de7fff640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de814cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2ddeffd640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000c00 tx=0x7f2dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0041070 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0031e30 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de81e41f0 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0035040 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.930+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de81e47b0 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.931+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8075460 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.932+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dd004c060 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.932+0000 7f2de4ff9640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 0x7f2dc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.932+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2dd00ad9a0 con 0x7f2de815ea60 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.932+0000 7f2de77fe640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 0x7f2dc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:34.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.932+0000 7f2de77fe640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 0x7f2dc806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000f60 tx=0x7f2dd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:34.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:34.936+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2de8075460 con 0x7f2de815ea60 2024-04-16T15:36:35.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.112+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2de8069150 con 0x7f2de815ea60 2024-04-16T15:36:35.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.113+0000 7f2de4ff9640 1 -- 172.21.15.80:0/2843327043 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f2dd004b2c0 con 0x7f2de815ea60 2024-04-16T15:36:35.112 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:35.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.114+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 msgr2=0x7f2dc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.114+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 0x7f2dc806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000f60 tx=0x7f2dd8009040 comp rx=0 tx=0).stop 2024-04-16T15:36:35.114 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.114+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 msgr2=0x7f2de81f8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000c00 tx=0x7f2dd00046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 shutdown_connections 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2dc806c8f0 0x7f2dc806edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2de815ee40 0x7f2de814cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2de815ea60 0x7f2de81f8470 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 --2- 172.21.15.80:0/2843327043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2de80afc40 0x7f2de80b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 >> 172.21.15.80:0/2843327043 conn(0x7f2de80b4060 msgr2=0x7f2de80b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 shutdown_connections 2024-04-16T15:36:35.115 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.115+0000 7f2dee250640 1 -- 172.21.15.80:0/2843327043 wait complete. 2024-04-16T15:36:35.125 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.232+0000 7f2d1138d640 1 Processor -- start 2024-04-16T15:36:35.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.232+0000 7f2d1138d640 1 -- start start 2024-04-16T15:36:35.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.233+0000 7f2d1138d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.233+0000 7f2d1138d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.233+0000 7f2d1138d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0c0ccdc0 con 0x7f2d0c0ce710 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.233+0000 7f2d1138d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0c0cd380 con 0x7f2d0c0d0080 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.233+0000 7f2d1138d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c0cd0a0 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0a7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0a7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:58888/0 (socket says 172.21.15.80:58888) 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0a7fc640 1 -- 172.21.15.80:0/1550465804 learned_addr learned my addr 172.21.15.80:0/1550465804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:54356/0 (socket says 172.21.15.80:54356) 2024-04-16T15:36:35.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0b7fe640 1 --1- 172.21.15.80:0/1550465804 >> v1:172.21.15.87:6789/0 conn(0x7f2d0c0ce710 0x7f2d0c0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:34444/0 (socket says 172.21.15.80:34444) 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 -- 172.21.15.80:0/1550465804 >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 msgr2=0x7f2d0c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 --2- 172.21.15.80:0/1550465804 >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 -- 172.21.15.80:0/1550465804 >> v1:172.21.15.87:6789/0 conn(0x7f2d0c0ce710 legacy=0x7f2d0c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d09ffb640 1 -- 172.21.15.80:0/1550465804 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172327089 0 0) 0x7f2d0c0ccdc0 con 0x7f2d0c0ce710 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0affd640 1 -- 172.21.15.80:0/1550465804 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c0b0f20 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.234+0000 7f2d0a7fc640 1 --2- 172.21.15.80:0/1550465804 >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.235+0000 7f2d0affd640 1 --2- 172.21.15.80:0/1550465804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00ba40 tx=0x7f2cfc02dff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f346214b3830fc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.235+0000 7f2d09ffb640 1 -- 172.21.15.80:0/1550465804 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc03b070 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.235+0000 7f2d09ffb640 1 -- 172.21.15.80:0/1550465804 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc02eda0 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.235+0000 7f2d09ffb640 1 -- 172.21.15.80:0/1550465804 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc036660 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 -- 172.21.15.80:0/1550465804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 msgr2=0x7f2d0c0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 --2- 172.21.15.80:0/1550465804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00ba40 tx=0x7f2cfc02dff0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 -- 172.21.15.80:0/1550465804 shutdown_connections 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 --2- 172.21.15.80:0/1550465804 >> v2:172.21.15.87:3300/0 conn(0x7f2d0c0d0080 0x7f2d0c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 --2- 172.21.15.80:0/1550465804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cdc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 -- 172.21.15.80:0/1550465804 >> 172.21.15.80:0/1550465804 conn(0x7f2d0c0b2fa0 msgr2=0x7f2d0c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 -- 172.21.15.80:0/1550465804 shutdown_connections 2024-04-16T15:36:35.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.236+0000 7f2d1138d640 1 -- 172.21.15.80:0/1550465804 wait complete. 2024-04-16T15:36:35.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.237+0000 7f2d1138d640 1 Processor -- start 2024-04-16T15:36:35.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.237+0000 7f2d1138d640 1 -- start start 2024-04-16T15:36:35.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 0x7f2d0c14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c0cc9e0 con 0x7f2d0c0d0080 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c15bb90 con 0x7f2d0c0ce710 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d1138d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c0ccb60 con 0x7f2d0c15b7b0 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50708/0 (socket says 172.21.15.80:50708) 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 -- 172.21.15.80:0/4021357680 learned_addr learned my addr 172.21.15.80:0/4021357680 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0affd640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 0x7f2d0c14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0b7fe640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 -- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 msgr2=0x7f2d0c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 -- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 msgr2=0x7f2d0c14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 0x7f2d0c14f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 -- 172.21.15.80:0/4021357680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c14fed0 con 0x7f2d0c0d0080 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0b7fe640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:35.241 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0affd640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 0x7f2d0c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.238+0000 7f2d0a7fc640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000ea00 tx=0x7f2d0000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.239+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00017070 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.239+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0000ca60 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.239+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c0c6830 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.239+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000ce10 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.239+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c0c6df0 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.240+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0c069150 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.240+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d0001a070 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.241+0000 7f2cf37fe640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 0x7f2cf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.241+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2d0008c1c0 con 0x7f2d0c0d0080 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.241+0000 7f2d0affd640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 0x7f2cf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.241+0000 7f2d0affd640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 0x7f2cf806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc038000 tx=0x7f2cfc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.245+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d0005a280 con 0x7f2d0c0d0080 2024-04-16T15:36:35.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.420+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d0c0cfc40 con 0x7f2d0c0d0080 2024-04-16T15:36:35.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.420+0000 7f2cf37fe640 1 -- 172.21.15.80:0/4021357680 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f2d00059b80 con 0x7f2d0c0d0080 2024-04-16T15:36:35.419 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:35.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 msgr2=0x7f2cf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 0x7f2cf806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc038000 tx=0x7f2cfc032000 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 msgr2=0x7f2d0c0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000ea00 tx=0x7f2d0000eec0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 shutdown_connections 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f2cf806c8f0 0x7f2cf806edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2d0c15b7b0 0x7f2d0c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2d0c0d0080 0x7f2d0c0cae50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 --2- 172.21.15.80:0/4021357680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d0c0ce710 0x7f2d0c14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 >> 172.21.15.80:0/4021357680 conn(0x7f2d0c0b2fa0 msgr2=0x7f2d0c0cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 shutdown_connections 2024-04-16T15:36:35.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.422+0000 7f2d1138d640 1 -- 172.21.15.80:0/4021357680 wait complete. 2024-04-16T15:36:35.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:35.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 Processor -- start 2024-04-16T15:36:35.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 -- start start 2024-04-16T15:36:35.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffaa815c640 0x7ffaa80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa80cb960 0x7ffaa80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffaa80c6de0 0x7ffaa80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80b3ed0 con 0x7ffaa815c640 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa815ca20 con 0x7ffaa80c6de0 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.540+0000 7ffaacc47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80cf180 con 0x7ffaa80cb960 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffaa815c640 0x7ffaa80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ffaa815c640 0x7ffaa80b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50716/0 (socket says 172.21.15.80:50716) 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 -- 172.21.15.80:0/2231365793 learned_addr learned my addr 172.21.15.80:0/2231365793 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa6d9d640 1 --2- 172.21.15.80:0/2231365793 >> v2:172.21.15.87:3300/0 conn(0x7ffaa80c6de0 0x7ffaa80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffa9ffff640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa80cb960 0x7ffaa80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 -- 172.21.15.80:0/2231365793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa80cb960 msgr2=0x7ffaa80cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa80cb960 0x7ffaa80cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 -- 172.21.15.80:0/2231365793 >> v2:172.21.15.87:3300/0 conn(0x7ffaa80c6de0 msgr2=0x7ffaa80c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:35.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 --2- 172.21.15.80:0/2231365793 >> v2:172.21.15.87:3300/0 conn(0x7ffaa80c6de0 0x7ffaa80c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.541+0000 7ffaa659c640 1 -- 172.21.15.80:0/2231365793 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80c7e10 con 0x7ffaa815c640 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaa659c640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa815c640 0x7ffaa80b3990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80b7580 tx=0x7ffa9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5edac5875fb3f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaa5d9b640 1 -- 172.21.15.80:0/2231365793 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98035020 con 0x7ffaa815c640 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaa5d9b640 1 -- 172.21.15.80:0/2231365793 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98031870 con 0x7ffaa815c640 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaa5d9b640 1 -- 172.21.15.80:0/2231365793 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031c40 con 0x7ffaa815c640 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 -- 172.21.15.80:0/2231365793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa815c640 msgr2=0x7ffaa80b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa815c640 0x7ffaa80b3990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80b7580 tx=0x7ffa9802b910 comp rx=0 tx=0).stop 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 -- 172.21.15.80:0/2231365793 shutdown_connections 2024-04-16T15:36:35.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 --2- 172.21.15.80:0/2231365793 >> v2:172.21.15.87:3300/0 conn(0x7ffaa80c6de0 0x7ffaa80c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa80cb960 0x7ffaa80cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.542+0000 7ffaacc47640 1 --2- 172.21.15.80:0/2231365793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa815c640 0x7ffaa80b3990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.543+0000 7ffaacc47640 1 -- 172.21.15.80:0/2231365793 >> 172.21.15.80:0/2231365793 conn(0x7ffaa80d13a0 msgr2=0x7ffaa80d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.543+0000 7ffaacc47640 1 -- 172.21.15.80:0/2231365793 shutdown_connections 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.543+0000 7ffaacc47640 1 -- 172.21.15.80:0/2231365793 wait complete. 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.544+0000 7ffaacc47640 1 Processor -- start 2024-04-16T15:36:35.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.544+0000 7ffaacc47640 1 -- start start 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa80c6de0 0x7ffaa8148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa815c640 0x7ffaa80cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80c68c0 con 0x7ffaa80cb960 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80c65e0 con 0x7ffaa80c6de0 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa80c7ae0 con 0x7ffaa815c640 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50728/0 (socket says 172.21.15.80:50728) 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 -- 172.21.15.80:0/3480342965 learned_addr learned my addr 172.21.15.80:0/3480342965 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:35.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 -- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa815c640 msgr2=0x7ffaa80cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa815c640 0x7ffaa80cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 -- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa80c6de0 msgr2=0x7ffaa8148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaa659c640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa80c6de0 0x7ffaa8148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa80c6de0 0x7ffaa8148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 -- 172.21.15.80:0/3480342965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa8143910 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9ffff640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e820 tx=0x7ffa9000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90017070 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9000c940 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000cd30 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa80b19f0 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.545+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81e7410 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.546+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8069150 con 0x7ffaa80cb960 2024-04-16T15:36:35.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.547+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa9001a070 con 0x7ffaa80cb960 2024-04-16T15:36:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.547+0000 7ffa9effd640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 0x7ffa8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.547+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ffa9008bc00 con 0x7ffaa80cb960 2024-04-16T15:36:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.547+0000 7ffaa659c640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 0x7ffa8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.548+0000 7ffaa659c640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 0x7ffa8806ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa98036000 tx=0x7ffa9803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.552+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa90092080 con 0x7ffaa80cb960 2024-04-16T15:36:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.729+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffaa815b980 con 0x7ffaa80cb960 2024-04-16T15:36:35.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.729+0000 7ffa9effd640 1 -- 172.21.15.80:0/3480342965 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ffa90059cc0 con 0x7ffaa80cb960 2024-04-16T15:36:35.729 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:35.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 msgr2=0x7ffa8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 0x7ffa8806ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa98036000 tx=0x7ffa9803c040 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 msgr2=0x7ffaa81433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e820 tx=0x7ffa9000ece0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 shutdown_connections 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ffa8806c920 0x7ffa8806ede0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ffaa815c640 0x7ffaa80cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffaa80cb960 0x7ffaa81433d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 --2- 172.21.15.80:0/3480342965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa80c6de0 0x7ffaa8148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 >> 172.21.15.80:0/3480342965 conn(0x7ffaa80d13a0 msgr2=0x7ffaa815b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 shutdown_connections 2024-04-16T15:36:35.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.731+0000 7ffaacc47640 1 -- 172.21.15.80:0/3480342965 wait complete. 2024-04-16T15:36:35.741 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:35.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.848+0000 7fed952eb640 1 Processor -- start 2024-04-16T15:36:35.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.848+0000 7fed952eb640 1 -- start start 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed952eb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fed900d1700 0x7fed900d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed952eb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed900cfd90 con 0x7fed900b74e0 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed952eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed900d0050 con 0x7fed90161f20 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed952eb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fed900d0330 con 0x7fed900d1700 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed8e7fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fed900b74e0 0x7fed900d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45640/0 (socket says 172.21.15.80:45640) 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed8e7fc640 1 -- 172.21.15.80:0/2766813993 learned_addr learned my addr 172.21.15.80:0/2766813993 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed8f7fe640 1 --2- 172.21.15.80:0/2766813993 >> v2:172.21.15.87:3300/0 conn(0x7fed900d1700 0x7fed900d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243656415 0 0) 0x7fed900cfd90 con 0x7fed900b74e0 2024-04-16T15:36:35.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.849+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed78003520 con 0x7fed900b74e0 2024-04-16T15:36:35.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.850+0000 7fed8f7fe640 1 -- 172.21.15.80:0/2766813993 >> v1:172.21.15.87:6789/0 conn(0x7fed90161f20 legacy=0x7fed900cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.850+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079824717 0 0) 0x7fed900d0050 con 0x7fed90161f20 2024-04-16T15:36:35.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.850+0000 7fed8f7fe640 1 -- 172.21.15.80:0/2766813993 >> v1:172.21.15.80:6789/0 conn(0x7fed900b74e0 legacy=0x7fed900d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.850+0000 7fed8f7fe640 1 -- 172.21.15.80:0/2766813993 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed900d0610 con 0x7fed900d1700 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.850+0000 7fed8f7fe640 1 --2- 172.21.15.80:0/2766813993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed900d1700 0x7fed900d27e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed88009d90 tx=0x7fed8802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680c846c7b637fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88039070 con 0x7fed900d1700 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8802cd00 con 0x7fed900d1700 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed8dffb640 1 -- 172.21.15.80:0/2766813993 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88034640 con 0x7fed900d1700 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 -- 172.21.15.80:0/2766813993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed900d1700 msgr2=0x7fed900d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 --2- 172.21.15.80:0/2766813993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed900d1700 0x7fed900d27e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed88009d90 tx=0x7fed8802bf50 comp rx=0 tx=0).stop 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 -- 172.21.15.80:0/2766813993 shutdown_connections 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 --2- 172.21.15.80:0/2766813993 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed900d1700 0x7fed900d27e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 -- 172.21.15.80:0/2766813993 >> 172.21.15.80:0/2766813993 conn(0x7fed9008c000 msgr2=0x7fed900d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:35.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 -- 172.21.15.80:0/2766813993 shutdown_connections 2024-04-16T15:36:35.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.851+0000 7fed952eb640 1 -- 172.21.15.80:0/2766813993 wait complete. 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 Processor -- start 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 -- start start 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b74e0 0x7fed9015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 0x7fed900c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fed900cf940 con 0x7fed900d1700 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fed900b5730 con 0x7fed90161f20 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed952eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fed900cfac0 con 0x7fed900b74e0 2024-04-16T15:36:35.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed8e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed8e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50738/0 (socket says 172.21.15.80:50738) 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.853+0000 7fed8e7fc640 1 -- 172.21.15.80:0/2412227074 learned_addr learned my addr 172.21.15.80:0/2412227074 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8f7fe640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 0x7fed900c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8effd640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b74e0 0x7fed9015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 -- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b74e0 msgr2=0x7fed9015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b74e0 0x7fed9015a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 -- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 msgr2=0x7fed900c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 0x7fed900c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 -- 172.21.15.80:0/2412227074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed901f4a70 con 0x7fed900d1700 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8f7fe640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 0x7fed900c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed8e7fc640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fed8400c410 tx=0x7fed8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84017070 con 0x7fed900d1700 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed84005ce0 con 0x7fed900d1700 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed901f4d50 con 0x7fed900d1700 2024-04-16T15:36:35.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840072f0 con 0x7fed900d1700 2024-04-16T15:36:35.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.854+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed901f5310 con 0x7fed900d1700 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.855+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed901554f0 con 0x7fed900d1700 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.856+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed8401a070 con 0x7fed900d1700 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.856+0000 7fed777fe640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 0x7fed7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.856+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fed8408b370 con 0x7fed900d1700 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.856+0000 7fed8effd640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 0x7fed7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:35.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.856+0000 7fed8effd640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 0x7fed7c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed80000f60 tx=0x7fed80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:35.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:35.860+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed84059460 con 0x7fed900d1700 2024-04-16T15:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.039+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fed90068a40 con 0x7fed900d1700 2024-04-16T15:36:36.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.039+0000 7fed777fe640 1 -- 172.21.15.80:0/2412227074 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fed84058d60 con 0x7fed900d1700 2024-04-16T15:36:36.039 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 msgr2=0x7fed7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 0x7fed7c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fed80000f60 tx=0x7fed80009040 comp rx=0 tx=0).stop 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 msgr2=0x7fed901583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fed8400c410 tx=0x7fed8400c8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 shutdown_connections 2024-04-16T15:36:36.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fed90161f20 0x7fed900c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fed900d1700 0x7fed901583f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fed7c06c8f0 0x7fed7c06edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 --2- 172.21.15.80:0/2412227074 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fed900b74e0 0x7fed9015a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.041+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 >> 172.21.15.80:0/2412227074 conn(0x7fed9008c000 msgr2=0x7fed900b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.042+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 shutdown_connections 2024-04-16T15:36:36.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.042+0000 7fed952eb640 1 -- 172.21.15.80:0/2412227074 wait complete. 2024-04-16T15:36:36.052 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:36.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.160+0000 7f7d4227e640 1 Processor -- start 2024-04-16T15:36:36.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.160+0000 7f7d4227e640 1 -- start start 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d4227e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d3c161f20 0x7f7d3c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d4227e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7d3c0b74e0 0x7f7d3c0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d4227e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c0cfd90 con 0x7f7d3c0d0ff0 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d4227e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3c0d0050 con 0x7f7d3c161f20 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d4227e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3c0d0330 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d3c161f20 0x7f7d3c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f7d3c161f20 0x7f7d3c0cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50742/0 (socket says 172.21.15.80:50742) 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 -- 172.21.15.80:0/958185740 learned_addr learned my addr 172.21.15.80:0/958185740 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 -- 172.21.15.80:0/958185740 >> v2:172.21.15.87:3300/0 conn(0x7f7d3c0b74e0 msgr2=0x7f7d3c0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 --2- 172.21.15.80:0/958185740 >> v2:172.21.15.87:3300/0 conn(0x7f7d3c0b74e0 0x7f7d3c0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 -- 172.21.15.80:0/958185740 >> v1:172.21.15.87:6789/0 conn(0x7f7d3c0d0ff0 legacy=0x7f7d3c0d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.161+0000 7f7d3bfff640 1 -- 172.21.15.80:0/958185740 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c0d0610 con 0x7f7d3c161f20 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.162+0000 7f7d3bfff640 1 --2- 172.21.15.80:0/958185740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c161f20 0x7f7d3c0cf230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c08e690 tx=0x7f7d2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c4279128f663cf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.162+0000 7f7d3affd640 1 -- 172.21.15.80:0/958185740 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c035020 con 0x7f7d3c161f20 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.162+0000 7f7d3affd640 1 -- 172.21.15.80:0/958185740 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c031870 con 0x7f7d3c161f20 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.162+0000 7f7d3affd640 1 -- 172.21.15.80:0/958185740 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c031c40 con 0x7f7d3c161f20 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 -- 172.21.15.80:0/958185740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c161f20 msgr2=0x7f7d3c0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 --2- 172.21.15.80:0/958185740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c161f20 0x7f7d3c0cf230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c08e690 tx=0x7f7d2c02b910 comp rx=0 tx=0).stop 2024-04-16T15:36:36.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 -- 172.21.15.80:0/958185740 shutdown_connections 2024-04-16T15:36:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 --2- 172.21.15.80:0/958185740 >> v2:172.21.15.87:3300/0 conn(0x7f7d3c0b74e0 0x7f7d3c0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 --2- 172.21.15.80:0/958185740 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c161f20 0x7f7d3c0cf230 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 -- 172.21.15.80:0/958185740 >> 172.21.15.80:0/958185740 conn(0x7f7d3c08c000 msgr2=0x7f7d3c0d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 -- 172.21.15.80:0/958185740 shutdown_connections 2024-04-16T15:36:36.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.163+0000 7f7d4227e640 1 -- 172.21.15.80:0/958185740 wait complete. 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.164+0000 7f7d4227e640 1 Processor -- start 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.164+0000 7f7d4227e640 1 -- start start 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d3c0d0ff0 0x7f7d3c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 0x7f7d3c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0d1460 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0b5730 con 0x7f7d3c0d0ff0 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d4227e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c0d15e0 con 0x7f7d3c161f20 2024-04-16T15:36:36.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d3bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d3bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50746/0 (socket says 172.21.15.80:50746) 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d3bfff640 1 -- 172.21.15.80:0/2509965429 learned_addr learned my addr 172.21.15.80:0/2509965429 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.165+0000 7f7d3b7fe640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d3c0d0ff0 0x7f7d3c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d4081b640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 0x7f7d3c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 -- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 msgr2=0x7f7d3c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 0x7f7d3c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 -- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d3c0d0ff0 msgr2=0x7f7d3c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d3c0d0ff0 0x7f7d3c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 -- 172.21.15.80:0/2509965429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c0cc930 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d4081b640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 0x7f7d3c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d3bfff640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000c00 tx=0x7f7d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c03ad60 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c0443f0 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0447e0 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c0cd8e0 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.166+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c06cd60 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.167+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c0ba570 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.168+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d2c04b060 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.168+0000 7f7d38ff9640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 0x7f7d1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.168+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7d2c0ae010 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.168+0000 7f7d3b7fe640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 0x7f7d1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.169+0000 7f7d3b7fe640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 0x7f7d1c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0b6e30 tx=0x7f7d24009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.173+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d3c0ba570 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.363 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.364+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d3c08c3e0 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.364+0000 7f7d38ff9640 1 -- 172.21.15.80:0/2509965429 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f7d3c08c3e0 con 0x7f7d3c0b74e0 2024-04-16T15:36:36.364 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:36.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 msgr2=0x7f7d1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 0x7f7d1c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0b6e30 tx=0x7f7d24009110 comp rx=0 tx=0).stop 2024-04-16T15:36:36.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 msgr2=0x7f7d3c1f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000c00 tx=0x7f7d2c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.366 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 shutdown_connections 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d1c06c8f0 0x7f7d1c06edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7d3c161f20 0x7f7d3c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d3c0d0ff0 0x7f7d3c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 --2- 172.21.15.80:0/2509965429 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7d3c0b74e0 0x7f7d3c1f7c30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.366+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 >> 172.21.15.80:0/2509965429 conn(0x7f7d3c08c000 msgr2=0x7f7d3c0d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.367+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 shutdown_connections 2024-04-16T15:36:36.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.367+0000 7f7d4227e640 1 -- 172.21.15.80:0/2509965429 wait complete. 2024-04-16T15:36:36.377 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2024-04-16T15:36:36.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:36.377 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-16T15:36:36.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:36.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:36:36.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:36.407 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T15:36:36.464 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:36.464 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:36.484 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:36.484 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:36.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:36.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.650+0000 7f28581d4640 1 Processor -- start 2024-04-16T15:36:36.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.650+0000 7f28581d4640 1 -- start start 2024-04-16T15:36:36.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f28581d4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28500b3840 0x7f28500b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f28581d4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28500ceab0 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f28581d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28500b42e0 con 0x7f2850144f00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f28581d4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f28500cf0e0 con 0x7f28500b3840 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2856771640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f28500b5a00 0x7f28500b5e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45642/0 (socket says 172.21.15.80:45642) 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2856771640 1 -- 172.21.15.80:0/742118527 learned_addr learned my addr 172.21.15.80:0/742118527 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258984507 0 0) 0x7f28500ceab0 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f283c005730 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> v2:172.21.15.87:3300/0 conn(0x7f28500b3840 0x7f28500b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 568521889 0 0) 0x7f283c005730 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 >> v2:172.21.15.87:3300/0 conn(0x7f28500b3840 msgr2=0x7f28500b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 --2- 172.21.15.80:0/742118527 >> v2:172.21.15.87:3300/0 conn(0x7f28500b3840 0x7f28500b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 >> v1:172.21.15.87:6789/0 conn(0x7f2850144f00 legacy=0x7f28500cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500ced70 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f28480019f0 con 0x7f28500b5a00 2024-04-16T15:36:36.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> v2:172.21.15.87:3300/0 conn(0x7f28500b3840 0x7f28500b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 >> v1:172.21.15.80:6789/0 conn(0x7f28500b5a00 legacy=0x7f28500b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c005bc0 0x7f283c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 0x7f283c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f283c0074f0 0x7f283c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28500cf0e0 con 0x7f283c006a10 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f283c00e3c0 con 0x7f283c005bc0 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.651+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f283c00e5c0 con 0x7f283c0074f0 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 0x7f283c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f2855f70640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c005bc0 0x7f283c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f2856771640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f283c0074f0 0x7f283c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 -- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f283c0074f0 msgr2=0x7f283c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f283c0074f0 0x7f283c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 -- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c005bc0 msgr2=0x7f283c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c005bc0 0x7f283c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f285576f640 1 -- 172.21.15.80:0/742118527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c005730 con 0x7f283c006a10 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f2856771640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f283c0074f0 0x7f283c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.652+0000 7f2856771640 1 -- 172.21.15.80:0/742118527 reap_dead start 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f285576f640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 0x7f283c006e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f283c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ca3af83ea3f560 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284000f040 con 0x7f283c006a10 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2840004230 con 0x7f283c006a10 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f2854f6e640 1 -- 172.21.15.80:0/742118527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840003610 con 0x7f283c006a10 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 -- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 msgr2=0x7f283c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 0x7f283c006e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f283c007a40 comp rx=0 tx=0).stop 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 -- 172.21.15.80:0/742118527 shutdown_connections 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 --2- 172.21.15.80:0/742118527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f283c006a10 0x7f283c006e90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 -- 172.21.15.80:0/742118527 >> 172.21.15.80:0/742118527 conn(0x7f28500b2940 msgr2=0x7f285006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 -- 172.21.15.80:0/742118527 shutdown_connections 2024-04-16T15:36:36.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.653+0000 7f28581d4640 1 -- 172.21.15.80:0/742118527 wait complete. 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 Processor -- start 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 -- start start 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 0x7f28500ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 0x7f28500ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f28501452e0 con 0x7f28500ae800 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f28500b45c0 con 0x7f283c006a10 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f28581d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2850145460 con 0x7f28500abe60 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f2856771640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f2856771640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50778/0 (socket says 172.21.15.80:50778) 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.655+0000 7f2856771640 1 -- 172.21.15.80:0/2410043497 learned_addr learned my addr 172.21.15.80:0/2410043497 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2855f70640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 0x7f28500ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f285576f640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 0x7f28500ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 -- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 msgr2=0x7f28500ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 0x7f28500ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 -- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 msgr2=0x7f28500ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 0x7f28500ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 -- 172.21.15.80:0/2410043497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500af050 con 0x7f28500ae800 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f285576f640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 0x7f28500ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2855f70640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 0x7f28500ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:36.660 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f2856771640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2848002230 tx=0x7f284800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284800eb90 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848018070 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28500af330 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848013420 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.656+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28500a97b0 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.657+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2850068a40 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.658+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28480135c0 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.658+0000 7f28467fc640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 0x7f283406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.658+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f284808c200 con 0x7f28500ae800 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.658+0000 7f2855f70640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 0x7f283406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.659+0000 7f2855f70640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 0x7f283406ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f284c005600 tx=0x7f284c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.662+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f284805a2f0 con 0x7f28500ae800 2024-04-16T15:36:36.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.846+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f285006c520 con 0x7f28500ae800 2024-04-16T15:36:36.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.847+0000 7f28467fc640 1 -- 172.21.15.80:0/2410043497 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f284808c020 con 0x7f28500ae800 2024-04-16T15:36:36.847 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:36.847 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.849+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 msgr2=0x7f283406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.849+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 0x7f283406ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f284c005600 tx=0x7f284c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.849+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 msgr2=0x7f28500a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.849+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2848002230 tx=0x7f284800e530 comp rx=0 tx=0).stop 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 shutdown_connections 2024-04-16T15:36:36.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f28500ae800 0x7f28500a9fb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f283406c920 0x7f283406ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f28500abe60 0x7f28500ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 --2- 172.21.15.80:0/2410043497 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f283c006a10 0x7f28500ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 >> 172.21.15.80:0/2410043497 conn(0x7f28500b2940 msgr2=0x7f28500b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 shutdown_connections 2024-04-16T15:36:36.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.850+0000 7f28581d4640 1 -- 172.21.15.80:0/2410043497 wait complete. 2024-04-16T15:36:36.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:36.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:36.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.969+0000 7f04c06eb640 1 Processor -- start 2024-04-16T15:36:36.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.969+0000 7f04c06eb640 1 -- start start 2024-04-16T15:36:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04c06eb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04b8161f20 0x7f04b80cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04c06eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04c06eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b80cfd90 con 0x7f04b80d0ff0 2024-04-16T15:36:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04c06eb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f04b80d0050 con 0x7f04b8161f20 2024-04-16T15:36:36.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04c06eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80d0330 con 0x7f04b80b74e0 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04be487640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f04b8161f20 0x7f04b80cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:54430/0 (socket says 172.21.15.80:54430) 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 -- 172.21.15.80:0/1316772865 learned_addr learned my addr 172.21.15.80:0/1316772865 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 -- 172.21.15.80:0/1316772865 >> v2:172.21.15.87:3300/0 conn(0x7f04b8161f20 msgr2=0x7f04b80cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 --2- 172.21.15.80:0/1316772865 >> v2:172.21.15.87:3300/0 conn(0x7f04b8161f20 0x7f04b80cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 -- 172.21.15.80:0/1316772865 >> v1:172.21.15.87:6789/0 conn(0x7f04b80d0ff0 legacy=0x7f04b80d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.970+0000 7f04bdc86640 1 -- 172.21.15.80:0/1316772865 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80d0610 con 0x7f04b80b74e0 2024-04-16T15:36:36.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.971+0000 7f04bdc86640 1 --2- 172.21.15.80:0/1316772865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009870 tx=0x7f04b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2cb0ae2f54602cb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.971+0000 7f04bd485640 1 -- 172.21.15.80:0/1316772865 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4034070 con 0x7f04b80b74e0 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.971+0000 7f04bd485640 1 -- 172.21.15.80:0/1316772865 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b4030840 con 0x7f04b80b74e0 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.971+0000 7f04bd485640 1 -- 172.21.15.80:0/1316772865 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4030c10 con 0x7f04b80b74e0 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 -- 172.21.15.80:0/1316772865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 msgr2=0x7f04b80cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1316772865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009870 tx=0x7f04b402b980 comp rx=0 tx=0).stop 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 -- 172.21.15.80:0/1316772865 shutdown_connections 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1316772865 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b80b74e0 0x7f04b80cf770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1316772865 >> v2:172.21.15.87:3300/0 conn(0x7f04b8161f20 0x7f04b80cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 -- 172.21.15.80:0/1316772865 >> 172.21.15.80:0/1316772865 conn(0x7f04b808c000 msgr2=0x7f04b80d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 -- 172.21.15.80:0/1316772865 shutdown_connections 2024-04-16T15:36:36.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.972+0000 7f04c06eb640 1 -- 172.21.15.80:0/1316772865 wait complete. 2024-04-16T15:36:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.973+0000 7f04c06eb640 1 Processor -- start 2024-04-16T15:36:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.973+0000 7f04c06eb640 1 -- start start 2024-04-16T15:36:36.974 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b80d0ff0 0x7f04b8160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b8161f20 0x7f04b815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80d1480 con 0x7f04b80b74e0 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80b5730 con 0x7f04b80d0ff0 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04c06eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80d1600 con 0x7f04b8161f20 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50780/0 (socket says 172.21.15.80:50780) 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 -- 172.21.15.80:0/1345967031 learned_addr learned my addr 172.21.15.80:0/1345967031 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04bdc86640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b80d0ff0 0x7f04b8160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04bec88640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b8161f20 0x7f04b815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 -- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b8161f20 msgr2=0x7f04b815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b8161f20 0x7f04b815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 -- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b80d0ff0 msgr2=0x7f04b8160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b80d0ff0 0x7f04b8160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:36.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.974+0000 7f04be487640 1 -- 172.21.15.80:0/1345967031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b815f7f0 con 0x7f04b80b74e0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04be487640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04a800e870 tx=0x7f04a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8017070 con 0x7f04b80b74e0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a800c940 con 0x7f04b80b74e0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b815fa60 con 0x7f04b80b74e0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a800cd30 con 0x7f04b80b74e0 2024-04-16T15:36:36.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.975+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b8160020 con 0x7f04b80b74e0 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.976+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b8068a40 con 0x7f04b80b74e0 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.976+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04a801a070 con 0x7f04b80b74e0 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.977+0000 7f04aeffd640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.977+0000 7f04bdc86640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.977+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f04a808be20 con 0x7f04b80b74e0 2024-04-16T15:36:36.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.977+0000 7f04bdc86640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 0x7f049c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f04b4036000 tx=0x7f04b403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:36.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:36.981+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f04a8059e50 con 0x7f04b80b74e0 2024-04-16T15:36:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.164+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f04b80d1900 con 0x7f04b80b74e0 2024-04-16T15:36:37.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.164+0000 7f04aeffd640 1 -- 172.21.15.80:0/1345967031 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f04a8059750 con 0x7f04b80b74e0 2024-04-16T15:36:37.164 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 msgr2=0x7f049c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 0x7f049c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f04b4036000 tx=0x7f04b403b040 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 msgr2=0x7f04b80caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04a800e870 tx=0x7f04a800ed30 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 shutdown_connections 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f049c06c8f0 0x7f049c06edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f04b8161f20 0x7f04b815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f04b80d0ff0 0x7f04b8160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 --2- 172.21.15.80:0/1345967031 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f04b80b74e0 0x7f04b80caeb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 >> 172.21.15.80:0/1345967031 conn(0x7f04b808c000 msgr2=0x7f04b806ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 shutdown_connections 2024-04-16T15:36:37.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.167+0000 7f04c06eb640 1 -- 172.21.15.80:0/1345967031 wait complete. 2024-04-16T15:36:37.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:37.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.285+0000 7f1391031640 1 Processor -- start 2024-04-16T15:36:37.285 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.285+0000 7f1391031640 1 -- start start 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f1391031640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 0x7f138c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f1391031640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f138c0c6de0 0x7f138c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f1391031640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138c15ca20 con 0x7f138c15c640 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f1391031640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f138c0cf180 con 0x7f138c0c6de0 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f1391031640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f138c0c7e10 con 0x7f138c0cb960 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f138b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f138c0c6de0 0x7f138c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.286+0000 7f138b59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f138c0c6de0 0x7f138c0c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50782/0 (socket says 172.21.15.80:50782) 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 -- 172.21.15.80:0/4014579739 learned_addr learned my addr 172.21.15.80:0/4014579739 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138a59c640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 0x7f138c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 -- 172.21.15.80:0/4014579739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 msgr2=0x7f138c0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 0x7f138c0cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 -- 172.21.15.80:0/4014579739 >> v1:172.21.15.87:6789/0 conn(0x7f138c15c640 legacy=0x7f138c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 -- 172.21.15.80:0/4014579739 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c0c6300 con 0x7f138c0c6de0 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138a59c640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 0x7f138c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.287+0000 7f138b59e640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0c6de0 0x7f138c0c7270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1384009e50 tx=0x7f138402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8dbf98e808857f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1389d9b640 1 -- 172.21.15.80:0/4014579739 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138402ca70 con 0x7f138c0c6de0 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1389d9b640 1 -- 172.21.15.80:0/4014579739 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138402cc10 con 0x7f138c0c6de0 2024-04-16T15:36:37.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1389d9b640 1 -- 172.21.15.80:0/4014579739 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13840343f0 con 0x7f138c0c6de0 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 -- 172.21.15.80:0/4014579739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0c6de0 msgr2=0x7f138c0c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0c6de0 0x7f138c0c7270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1384009e50 tx=0x7f138402bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 -- 172.21.15.80:0/4014579739 shutdown_connections 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0c6de0 0x7f138c0c7270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 --2- 172.21.15.80:0/4014579739 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c0cb960 0x7f138c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 -- 172.21.15.80:0/4014579739 >> 172.21.15.80:0/4014579739 conn(0x7f138c0d13a0 msgr2=0x7f138c0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 -- 172.21.15.80:0/4014579739 shutdown_connections 2024-04-16T15:36:37.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.288+0000 7f1391031640 1 -- 172.21.15.80:0/4014579739 wait complete. 2024-04-16T15:36:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.291+0000 7f1391031640 1 Processor -- start 2024-04-16T15:36:37.290 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.291+0000 7f1391031640 1 -- start start 2024-04-16T15:36:37.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 0x7f138c14ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 0x7f138c0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0c7ae0 con 0x7f138c0cb960 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0c68c0 con 0x7f138c0c6de0 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f1391031640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f138c0c80f0 con 0x7f138c15c640 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50786/0 (socket says 172.21.15.80:50786) 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 -- 172.21.15.80:0/2308678593 learned_addr learned my addr 172.21.15.80:0/2308678593 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138b59e640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 0x7f138c0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138ad9d640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 0x7f138c14ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 -- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 msgr2=0x7f138c0af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 0x7f138c0af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 -- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 msgr2=0x7f138c14ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 0x7f138c14ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 -- 172.21.15.80:0/2308678593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c0ca460 con 0x7f138c0cb960 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138b59e640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 0x7f138c0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138ad9d640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 0x7f138c14ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.292+0000 7f138a59c640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f138000c820 tx=0x7f138000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.293+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380015070 con 0x7f138c0cb960 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.293+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1380007a30 con 0x7f138c0cb960 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.293+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380007e00 con 0x7f138c0cb960 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.293+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c0ca740 con 0x7f138c0cb960 2024-04-16T15:36:37.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.293+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c0cad00 con 0x7f138c0cb960 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.294+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c069150 con 0x7f138c0cb960 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.294+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1380018070 con 0x7f138c0cb960 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.295+0000 7f13737fe640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 0x7f137806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.295+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f138008bf20 con 0x7f138c0cb960 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.295+0000 7f138ad9d640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 0x7f137806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.295+0000 7f138ad9d640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 0x7f137806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f137c003eb0 tx=0x7f137c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.300+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1380059f50 con 0x7f138c0cb960 2024-04-16T15:36:37.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.472+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f138c14b320 con 0x7f138c0cb960 2024-04-16T15:36:37.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.473+0000 7f13737fe640 1 -- 172.21.15.80:0/2308678593 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f1380059850 con 0x7f138c0cb960 2024-04-16T15:36:37.472 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:37.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 msgr2=0x7f137806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 0x7f137806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f137c003eb0 tx=0x7f137c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 msgr2=0x7f138c0af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f138000c820 tx=0x7f138000cc20 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 shutdown_connections 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f137806c8f0 0x7f137806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f138c15c640 0x7f138c0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f138c0cb960 0x7f138c0af320 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 --2- 172.21.15.80:0/2308678593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f138c0c6de0 0x7f138c14ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 >> 172.21.15.80:0/2308678593 conn(0x7f138c0d13a0 msgr2=0x7f138c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 shutdown_connections 2024-04-16T15:36:37.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.475+0000 7f1391031640 1 -- 172.21.15.80:0/2308678593 wait complete. 2024-04-16T15:36:37.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:37.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.593+0000 7fbbd60d3640 1 Processor -- start 2024-04-16T15:36:37.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.593+0000 7fbbd60d3640 1 -- start start 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbd60d3640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbd0145020 0x7fbbd006ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbd60d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd006f480 0x7fbbd00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbd60d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd015bd50 con 0x7fbbd00cd820 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbd60d3640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd015c030 con 0x7fbbd0145020 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbd60d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd015c310 con 0x7fbbd006f480 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbd0145020 0x7fbbd006ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbbd0145020 0x7fbbd006ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50794/0 (socket says 172.21.15.80:50794) 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 -- 172.21.15.80:0/713964888 learned_addr learned my addr 172.21.15.80:0/713964888 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:37.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 -- 172.21.15.80:0/713964888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd006f480 msgr2=0x7fbbd00cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbceffd640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd006f480 0x7fbbd00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd006f480 0x7fbbd00cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 -- 172.21.15.80:0/713964888 >> v1:172.21.15.87:6789/0 conn(0x7fbbd00cd820 legacy=0x7fbbd00cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.594+0000 7fbbcf7fe640 1 -- 172.21.15.80:0/713964888 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd015c5f0 con 0x7fbbd0145020 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.595+0000 7fbbcf7fe640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd0145020 0x7fbbd006ef40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009e50 tx=0x7fbbc002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94209d0981ff71c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.595+0000 7fbbce7fc640 1 -- 172.21.15.80:0/713964888 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc002ca70 con 0x7fbbd0145020 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.595+0000 7fbbce7fc640 1 -- 172.21.15.80:0/713964888 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc002cc10 con 0x7fbbd0145020 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.595+0000 7fbbce7fc640 1 -- 172.21.15.80:0/713964888 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00343f0 con 0x7fbbd0145020 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 -- 172.21.15.80:0/713964888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd0145020 msgr2=0x7fbbd006ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd0145020 0x7fbbd006ef40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009e50 tx=0x7fbbc002bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 -- 172.21.15.80:0/713964888 shutdown_connections 2024-04-16T15:36:37.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd006f480 0x7fbbd00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/713964888 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd0145020 0x7fbbd006ef40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 -- 172.21.15.80:0/713964888 >> 172.21.15.80:0/713964888 conn(0x7fbbd0067d90 msgr2=0x7fbbd006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 -- 172.21.15.80:0/713964888 shutdown_connections 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.596+0000 7fbbd60d3640 1 -- 172.21.15.80:0/713964888 wait complete. 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.597+0000 7fbbd60d3640 1 Processor -- start 2024-04-16T15:36:37.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.597+0000 7fbbd60d3640 1 -- start start 2024-04-16T15:36:37.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd006f480 0x7fbbd013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd0145020 0x7fbbd0168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd00b3f90 con 0x7fbbd00cd820 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd00b3e10 con 0x7fbbd006f480 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd00cf9d0 con 0x7fbbd0145020 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50800/0 (socket says 172.21.15.80:50800) 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 -- 172.21.15.80:0/881137512 learned_addr learned my addr 172.21.15.80:0/881137512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 -- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd0145020 msgr2=0x7fbbd0168ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd0145020 0x7fbbd0168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 -- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd006f480 msgr2=0x7fbbd013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd006f480 0x7fbbd013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 -- 172.21.15.80:0/881137512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0159ab0 con 0x7fbbd00cd820 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbceffd640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c7f0 tx=0x7fbbc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4015070 con 0x7fbbd00cd820 2024-04-16T15:36:37.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4004240 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd0159d90 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.598+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4007620 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.599+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd015a350 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.599+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd0068a40 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.600+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbc40077c0 con 0x7fbbd00cd820 2024-04-16T15:36:37.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.600+0000 7fbbb7fff640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 0x7fbbbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.600+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbbc408c140 con 0x7fbbd00cd820 2024-04-16T15:36:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.600+0000 7fbbcf7fe640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 0x7fbbbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.601+0000 7fbbcf7fe640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 0x7fbbbc06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0035000 tx=0x7fbbc002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.605+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbc405a200 con 0x7fbbd00cd820 2024-04-16T15:36:37.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.780+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbbd00b36e0 con 0x7fbbd00cd820 2024-04-16T15:36:37.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.780+0000 7fbbb7fff640 1 -- 172.21.15.80:0/881137512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fbbc4059b00 con 0x7fbbd00cd820 2024-04-16T15:36:37.780 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 msgr2=0x7fbbbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 0x7fbbbc06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0035000 tx=0x7fbbc002e000 comp rx=0 tx=0).stop 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 msgr2=0x7fbbd015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c7f0 tx=0x7fbbc400ccb0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 shutdown_connections 2024-04-16T15:36:37.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbbbc06c8f0 0x7fbbbc06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.782+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbbd0145020 0x7fbbd0168ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.783+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbbd00cd820 0x7fbbd015ab50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.783+0000 7fbbd60d3640 1 --2- 172.21.15.80:0/881137512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbd006f480 0x7fbbd013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.783+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 >> 172.21.15.80:0/881137512 conn(0x7fbbd0067d90 msgr2=0x7fbbd00affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.783+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 shutdown_connections 2024-04-16T15:36:37.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.783+0000 7fbbd60d3640 1 -- 172.21.15.80:0/881137512 wait complete. 2024-04-16T15:36:37.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:37.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.899+0000 7f4975dc8640 1 Processor -- start 2024-04-16T15:36:37.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.899+0000 7f4975dc8640 1 -- start start 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.899+0000 7f4975dc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f497015f070 0x7f497006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f4975dc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f497015f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f4975dc8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497006cab0 con 0x7f497015f990 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f4975dc8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f497006d350 con 0x7f497015f070 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f4975dc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4970159290 con 0x7f49700b47d0 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f497015f990 0x7f497006f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45656/0 (socket says 172.21.15.80:45656) 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496ffff640 1 -- 172.21.15.80:0/758701170 learned_addr learned my addr 172.21.15.80:0/758701170 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496effd640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f497015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196839722 0 0) 0x7f497006cab0 con 0x7f497015f990 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496f7fe640 1 --2- 172.21.15.80:0/758701170 >> v2:172.21.15.87:3300/0 conn(0x7f497015f070 0x7f497006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4958003520 con 0x7f497015f990 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1077819578 0 0) 0x7f4958003520 con 0x7f497015f990 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 msgr2=0x7f497015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f497015f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 >> v2:172.21.15.87:3300/0 conn(0x7f497015f070 msgr2=0x7f497006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 --2- 172.21.15.80:0/758701170 >> v2:172.21.15.87:3300/0 conn(0x7f497015f070 0x7f497006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497006cd90 con 0x7f497015f990 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f49680019f0 con 0x7f497015f990 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 >> v1:172.21.15.80:6789/0 conn(0x7f497015f990 legacy=0x7f497006f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49580039b0 0x7f4958003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4958004800 0x7f4958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f49580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f497006d350 con 0x7f4958004800 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4970159290 con 0x7f49580039b0 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f495800ba10 con 0x7f49700b47d0 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496effd640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4958004800 0x7f4958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496f7fe640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49580039b0 0x7f4958003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.900+0000 7f496ffff640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f49580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 -- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 msgr2=0x7f49580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f49700b47d0 0x7f49580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 -- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49580039b0 msgr2=0x7f4958003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49580039b0 0x7f4958003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 -- 172.21.15.80:0/758701170 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958003520 con 0x7f4958004800 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496effd640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4958004800 0x7f4958004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4964009ac0 tx=0x7f4958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3955b86b70270faf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964039070 con 0x7f4958004800 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496402c6b0 con 0x7f4958004800 2024-04-16T15:36:37.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.901+0000 7f496e7fc640 1 -- 172.21.15.80:0/758701170 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964009690 con 0x7f4958004800 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 -- 172.21.15.80:0/758701170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4958004800 msgr2=0x7f4958004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 --2- 172.21.15.80:0/758701170 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4958004800 0x7f4958004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4964009ac0 tx=0x7f4958005830 comp rx=0 tx=0).stop 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f496ffff640 1 -- 172.21.15.80:0/758701170 reap_dead start 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 -- 172.21.15.80:0/758701170 shutdown_connections 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 -- 172.21.15.80:0/758701170 >> 172.21.15.80:0/758701170 conn(0x7f49700d0c30 msgr2=0x7f49700d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 -- 172.21.15.80:0/758701170 shutdown_connections 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.902+0000 7f4975dc8640 1 -- 172.21.15.80:0/758701170 wait complete. 2024-04-16T15:36:37.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.903+0000 7f4975dc8640 1 Processor -- start 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.903+0000 7f4975dc8640 1 -- start start 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 0x7f49701f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 0x7f497015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f49700b4c30 con 0x7f497015c130 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f497006eb70 con 0x7f49701579d0 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f4975dc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f497015bca0 con 0x7f4958004800 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50812/0 (socket says 172.21.15.80:50812) 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 -- 172.21.15.80:0/2592336561 learned_addr learned my addr 172.21.15.80:0/2592336561 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496ffff640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 0x7f497015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496f7fe640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 0x7f49701f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 -- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 msgr2=0x7f49701f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 0x7f49701f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 -- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 msgr2=0x7f497015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:37.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.904+0000 7f496effd640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 0x7f497015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f496effd640 1 -- 172.21.15.80:0/2592336561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4970157e60 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f496ffff640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 0x7f497015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f496f7fe640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 0x7f49701f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f496effd640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4964037040 tx=0x7f4964004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964042020 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496403a040 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497015d4a0 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964039070 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.905+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497015b370 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.906+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4970068a40 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.906+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4964045020 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.907+0000 7f4957fff640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 0x7f495c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.907+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f49640ad370 con 0x7f497015c130 2024-04-16T15:36:37.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.907+0000 7f496f7fe640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 0x7f495c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:37.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.907+0000 7f496f7fe640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 0x7f495c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4960009bc0 tx=0x7f4960008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:37.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:37.912+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f496404c070 con 0x7f497015c130 2024-04-16T15:36:38.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.086+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4970158040 con 0x7f497015c130 2024-04-16T15:36:38.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.086+0000 7f4957fff640 1 -- 172.21.15.80:0/2592336561 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f4970157e60 con 0x7f497015c130 2024-04-16T15:36:38.086 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 msgr2=0x7f495c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 0x7f495c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4960009bc0 tx=0x7f4960008040 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 msgr2=0x7f497015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4964037040 tx=0x7f4964004730 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 shutdown_connections 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f49701579d0 0x7f497015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f497015c130 0x7f497015aa00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f495c06c8f0 0x7f495c06edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 --2- 172.21.15.80:0/2592336561 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4958004800 0x7f49701f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 >> 172.21.15.80:0/2592336561 conn(0x7f49700d0c30 msgr2=0x7f49700b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 shutdown_connections 2024-04-16T15:36:38.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.089+0000 7f4975dc8640 1 -- 172.21.15.80:0/2592336561 wait complete. 2024-04-16T15:36:38.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:38.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.204+0000 7f6be580d640 1 Processor -- start 2024-04-16T15:36:38.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.204+0000 7f6be580d640 1 -- start start 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6be580d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6be0145020 0x7f6be006ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6be580d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be006f480 0x7f6be00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6be580d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be015bd50 con 0x7f6be00cd820 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6be580d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6be015c030 con 0x7f6be006f480 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6be580d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6be015c310 con 0x7f6be0145020 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6bde7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6be006f480 0x7f6be00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6bdf7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6be00cd820 0x7f6be00cf2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45658/0 (socket says 172.21.15.80:45658) 2024-04-16T15:36:38.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6bdf7fe640 1 -- 172.21.15.80:0/2557108226 learned_addr learned my addr 172.21.15.80:0/2557108226 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.205+0000 7f6bdeffd640 1 --2- 172.21.15.80:0/2557108226 >> v2:172.21.15.87:3300/0 conn(0x7f6be0145020 0x7f6be006ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bde7fc640 1 -- 172.21.15.80:0/2557108226 >> v2:172.21.15.87:3300/0 conn(0x7f6be0145020 msgr2=0x7f6be006ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/2557108226 >> v2:172.21.15.87:3300/0 conn(0x7f6be0145020 0x7f6be006ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bde7fc640 1 -- 172.21.15.80:0/2557108226 >> v1:172.21.15.80:6789/0 conn(0x7f6be00cd820 legacy=0x7f6be00cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bde7fc640 1 -- 172.21.15.80:0/2557108226 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be015c5f0 con 0x7f6be006f480 2024-04-16T15:36:38.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bddffb640 1 -- 172.21.15.80:0/2557108226 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018279158 0 0) 0x7f6be015bd50 con 0x7f6be00cd820 2024-04-16T15:36:38.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/2557108226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be00cd2e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6be006c660 tx=0x7f6bd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8610dc59631abe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bddffb640 1 -- 172.21.15.80:0/2557108226 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4035020 con 0x7f6be006f480 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bddffb640 1 -- 172.21.15.80:0/2557108226 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd4031830 con 0x7f6be006f480 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.206+0000 7f6bddffb640 1 -- 172.21.15.80:0/2557108226 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4031c00 con 0x7f6be006f480 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 -- 172.21.15.80:0/2557108226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 msgr2=0x7f6be00cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 --2- 172.21.15.80:0/2557108226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be00cd2e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6be006c660 tx=0x7f6bd402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 -- 172.21.15.80:0/2557108226 shutdown_connections 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 --2- 172.21.15.80:0/2557108226 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be00cd2e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 --2- 172.21.15.80:0/2557108226 >> v2:172.21.15.87:3300/0 conn(0x7f6be0145020 0x7f6be006ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 -- 172.21.15.80:0/2557108226 >> 172.21.15.80:0/2557108226 conn(0x7f6be0067d90 msgr2=0x7f6be006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 -- 172.21.15.80:0/2557108226 shutdown_connections 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.207+0000 7f6be580d640 1 -- 172.21.15.80:0/2557108226 wait complete. 2024-04-16T15:36:38.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.208+0000 7f6be580d640 1 Processor -- start 2024-04-16T15:36:38.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.208+0000 7f6be580d640 1 -- start start 2024-04-16T15:36:38.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 0x7f6be0157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 0x7f6be0157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6be00b3f90 con 0x7f6be006f480 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6be00b3e10 con 0x7f6be0145020 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6be580d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6be00cf9d0 con 0x7f6be00cd820 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6bdeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6bdeffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50834/0 (socket says 172.21.15.80:50834) 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6bdeffd640 1 -- 172.21.15.80:0/870603213 learned_addr learned my addr 172.21.15.80:0/870603213 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.209+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 0x7f6be0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdf7fe640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 0x7f6be0157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 -- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 msgr2=0x7f6be0157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 0x7f6be0157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 -- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 msgr2=0x7f6be0157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 0x7f6be0157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 -- 172.21.15.80:0/870603213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be015a570 con 0x7f6be006f480 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdf7fe640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 0x7f6be0157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:38.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 0x7f6be0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bdeffd640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d5f0 tx=0x7f6bd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00125f0 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd0019070 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00129d0 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be015a850 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.210+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be015ae10 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.211+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be0068a40 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.211+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bd0012b70 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.212+0000 7f6bc7fff640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.212+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6bd008c280 con 0x7f6be006f480 2024-04-16T15:36:38.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.212+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.212+0000 7f6bde7fc640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4036000 tx=0x7f6bd4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.216+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6bd005a340 con 0x7f6be006f480 2024-04-16T15:36:38.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.401+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6be0144840 con 0x7f6be006f480 2024-04-16T15:36:38.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.401+0000 7f6bc7fff640 1 -- 172.21.15.80:0/870603213 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6bd0059c40 con 0x7f6be006f480 2024-04-16T15:36:38.399 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:38.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 msgr2=0x7f6bcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4036000 tx=0x7f6bd4008030 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 msgr2=0x7f6be0137640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d5f0 tx=0x7f6bd000dab0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 shutdown_connections 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6be0145020 0x7f6be0157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6bcc06c8f0 0x7f6bcc06edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6be00cd820 0x7f6be0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 --2- 172.21.15.80:0/870603213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6be006f480 0x7f6be0137640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 >> 172.21.15.80:0/870603213 conn(0x7f6be0067d90 msgr2=0x7f6be00ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 shutdown_connections 2024-04-16T15:36:38.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.403+0000 7f6be580d640 1 -- 172.21.15.80:0/870603213 wait complete. 2024-04-16T15:36:38.413 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:38.413 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:38.432 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:38.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.536+0000 7fb8d802c640 1 Processor -- start 2024-04-16T15:36:38.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 -- start start 2024-04-16T15:36:38.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb8d015ef80 0x7fb8d015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d00cfbf0 con 0x7fb8d00d1450 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d0162900 con 0x7fb8d015ef80 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.537+0000 7fb8d802c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d0162ec0 con 0x7fb8d00cf780 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d55c7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb8d015ef80 0x7fb8d015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:54508/0 (socket says 172.21.15.80:54508) 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d5dc8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb8d00d1450 0x7fb8d00d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:34518/0 (socket says 172.21.15.80:34518) 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 -- 172.21.15.80:0/2368681246 learned_addr learned my addr 172.21.15.80:0/2368681246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d4dc6640 1 -- 172.21.15.80:0/2368681246 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014247473 0 0) 0x7fb8d00cfbf0 con 0x7fb8d00d1450 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 -- 172.21.15.80:0/2368681246 >> v2:172.21.15.87:3300/0 conn(0x7fb8d015ef80 msgr2=0x7fb8d015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 --2- 172.21.15.80:0/2368681246 >> v2:172.21.15.87:3300/0 conn(0x7fb8d015ef80 0x7fb8d015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 -- 172.21.15.80:0/2368681246 >> v1:172.21.15.87:6789/0 conn(0x7fb8d00d1450 legacy=0x7fb8d00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.538+0000 7fb8d65c9640 1 -- 172.21.15.80:0/2368681246 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d00cfeb0 con 0x7fb8d00cf780 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.539+0000 7fb8d65c9640 1 --2- 172.21.15.80:0/2368681246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009870 tx=0x7fb8c802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff68150d96e0182b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.539+0000 7fb8d4dc6640 1 -- 172.21.15.80:0/2368681246 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8035020 con 0x7fb8d00cf780 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.539+0000 7fb8d4dc6640 1 -- 172.21.15.80:0/2368681246 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8031640 con 0x7fb8d00cf780 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.539+0000 7fb8d4dc6640 1 -- 172.21.15.80:0/2368681246 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c802d040 con 0x7fb8d00cf780 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 -- 172.21.15.80:0/2368681246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 msgr2=0x7fb8d0163350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 --2- 172.21.15.80:0/2368681246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009870 tx=0x7fb8c802b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 -- 172.21.15.80:0/2368681246 shutdown_connections 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 --2- 172.21.15.80:0/2368681246 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00cf780 0x7fb8d0163350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 --2- 172.21.15.80:0/2368681246 >> v2:172.21.15.87:3300/0 conn(0x7fb8d015ef80 0x7fb8d015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 -- 172.21.15.80:0/2368681246 >> 172.21.15.80:0/2368681246 conn(0x7fb8d006ce20 msgr2=0x7fb8d006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 -- 172.21.15.80:0/2368681246 shutdown_connections 2024-04-16T15:36:38.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.540+0000 7fb8d802c640 1 -- 172.21.15.80:0/2368681246 wait complete. 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.541+0000 7fb8d802c640 1 Processor -- start 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.541+0000 7fb8d802c640 1 -- start start 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 0x7fb8d0150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00d1450 0x7fb8d00ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d0162b50 con 0x7fb8d015ef80 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d0163890 con 0x7fb8d00cf780 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d802c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d00d2ff0 con 0x7fb8d00d1450 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50846/0 (socket says 172.21.15.80:50846) 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 -- 172.21.15.80:0/1132863833 learned_addr learned my addr 172.21.15.80:0/1132863833 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d55c7640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00d1450 0x7fb8d00ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d5dc8640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 0x7fb8d0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 -- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00d1450 msgr2=0x7fb8d00ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00d1450 0x7fb8d00ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 -- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 msgr2=0x7fb8d0150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 0x7fb8d0150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 -- 172.21.15.80:0/1132863833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d00cbb40 con 0x7fb8d015ef80 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d5dc8640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 0x7fb8d0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.542+0000 7fb8d65c9640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009990 tx=0x7fb8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.543+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8040070 con 0x7fb8d015ef80 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.543+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80399f0 con 0x7fb8d015ef80 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.543+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8035040 con 0x7fb8d015ef80 2024-04-16T15:36:38.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.543+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d00cbe20 con 0x7fb8d015ef80 2024-04-16T15:36:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.543+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d00cc3e0 con 0x7fb8d015ef80 2024-04-16T15:36:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.544+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d0068a40 con 0x7fb8d015ef80 2024-04-16T15:36:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.544+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8c8038020 con 0x7fb8d015ef80 2024-04-16T15:36:38.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.544+0000 7fb8ce7fc640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 0x7fb8bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.545+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c80ad8d0 con 0x7fb8d015ef80 2024-04-16T15:36:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.545+0000 7fb8d5dc8640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 0x7fb8bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.545+0000 7fb8d5dc8640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 0x7fb8bc06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0007fd0 tx=0x7fb8c0005b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.549+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8c807b870 con 0x7fb8d015ef80 2024-04-16T15:36:38.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.724+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8d00d2920 con 0x7fb8d015ef80 2024-04-16T15:36:38.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.725+0000 7fb8ce7fc640 1 -- 172.21.15.80:0/1132863833 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7fb8c80abe20 con 0x7fb8d015ef80 2024-04-16T15:36:38.724 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:38.725 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 msgr2=0x7fb8bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 0x7fb8bc06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0007fd0 tx=0x7fb8c0005b70 comp rx=0 tx=0).stop 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 msgr2=0x7fb8d00cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009990 tx=0x7fb8c80046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 shutdown_connections 2024-04-16T15:36:38.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb8d015ef80 0x7fb8d00cdaf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8bc06c8f0 0x7fb8bc06edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb8d00d1450 0x7fb8d00ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 --2- 172.21.15.80:0/1132863833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8d00cf780 0x7fb8d0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 >> 172.21.15.80:0/1132863833 conn(0x7fb8d006ce20 msgr2=0x7fb8d015f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 shutdown_connections 2024-04-16T15:36:38.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.727+0000 7fb8d802c640 1 -- 172.21.15.80:0/1132863833 wait complete. 2024-04-16T15:36:38.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:38.737 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.845+0000 7ff8f0688640 1 Processor -- start 2024-04-16T15:36:38.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.845+0000 7ff8f0688640 1 -- start start 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8f0688640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8e815e950 0x7ff8e80b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8f0688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e80d1a20 0x7ff8e80cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8f0688640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e8163560 con 0x7ff8e815ed30 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8f0688640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80b8090 con 0x7ff8e815e950 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8f0688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e8162fa0 con 0x7ff8e80d1a20 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8e815e950 0x7ff8e80b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff8e815e950 0x7ff8e80b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50856/0 (socket says 172.21.15.80:50856) 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 -- 172.21.15.80:0/964339140 learned_addr learned my addr 172.21.15.80:0/964339140 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8eec25640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e80d1a20 0x7ff8e80cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 -- 172.21.15.80:0/964339140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e80d1a20 msgr2=0x7ff8e80cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e80d1a20 0x7ff8e80cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 -- 172.21.15.80:0/964339140 >> v1:172.21.15.87:6789/0 conn(0x7ff8e815ed30 legacy=0x7ff8e8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:38.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.846+0000 7ff8ee424640 1 -- 172.21.15.80:0/964339140 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8163280 con 0x7ff8e815e950 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.847+0000 7ff8ee424640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e80b7b50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009e50 tx=0x7ff8e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26a1d309f9fa9d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.847+0000 7ff8ed422640 1 -- 172.21.15.80:0/964339140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e402ca70 con 0x7ff8e815e950 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.847+0000 7ff8ed422640 1 -- 172.21.15.80:0/964339140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e402cc10 con 0x7ff8e815e950 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.847+0000 7ff8ed422640 1 -- 172.21.15.80:0/964339140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40343f0 con 0x7ff8e815e950 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 -- 172.21.15.80:0/964339140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 msgr2=0x7ff8e80b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e80b7b50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009e50 tx=0x7ff8e402bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 -- 172.21.15.80:0/964339140 shutdown_connections 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e80d1a20 0x7ff8e80cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 --2- 172.21.15.80:0/964339140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e80b7b50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 -- 172.21.15.80:0/964339140 >> 172.21.15.80:0/964339140 conn(0x7ff8e80b6430 msgr2=0x7ff8e80b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 -- 172.21.15.80:0/964339140 shutdown_connections 2024-04-16T15:36:38.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.848+0000 7ff8f0688640 1 -- 172.21.15.80:0/964339140 wait complete. 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.849+0000 7ff8f0688640 1 Processor -- start 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.849+0000 7ff8f0688640 1 -- start start 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 0x7ff8e8161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 0x7ff8e8161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80cfce0 con 0x7ff8e815e950 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80d2bc0 con 0x7ff8e80d1a20 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8f0688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e80cfe60 con 0x7ff8e815ed30 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50860/0 (socket says 172.21.15.80:50860) 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 -- 172.21.15.80:0/3832256213 learned_addr learned my addr 172.21.15.80:0/3832256213 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:38.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8ee424640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 0x7ff8e8161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8eec25640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 0x7ff8e8161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 -- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 msgr2=0x7ff8e8161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 0x7ff8e8161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 -- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 msgr2=0x7ff8e8161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 0x7ff8e8161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 -- 172.21.15.80:0/3832256213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8160570 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8eec25640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 0x7ff8e8161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8ee424640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 0x7ff8e8161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8edc23640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800b3f0 tx=0x7ff8d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.850+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8015020 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.851+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d8011830 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.851+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e8160850 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.851+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011c20 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.851+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e8151800 con 0x7ff8e815e950 2024-04-16T15:36:38.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.851+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e806d9a0 con 0x7ff8e815e950 2024-04-16T15:36:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.852+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8d8018020 con 0x7ff8e815e950 2024-04-16T15:36:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.853+0000 7ff8deffd640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 0x7ff8cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.853+0000 7ff8ee424640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 0x7ff8cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:38.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.853+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff8d808bb90 con 0x7ff8e815e950 2024-04-16T15:36:38.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.853+0000 7ff8ee424640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 0x7ff8cc06edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4035000 tx=0x7ff8e4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:38.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:38.857+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8e806d9a0 con 0x7ff8e815e950 2024-04-16T15:36:39.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.032+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8e815c480 con 0x7ff8e815e950 2024-04-16T15:36:39.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.032+0000 7ff8deffd640 1 -- 172.21.15.80:0/3832256213 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff8d801f030 con 0x7ff8e815e950 2024-04-16T15:36:39.031 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 msgr2=0x7ff8cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 0x7ff8cc06edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4035000 tx=0x7ff8e4030000 comp rx=0 tx=0).stop 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 msgr2=0x7ff8e81512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800b3f0 tx=0x7ff8d800b8b0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 shutdown_connections 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff8cc06c8f0 0x7ff8cc06edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff8e815ed30 0x7ff8e8161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff8e815e950 0x7ff8e81512c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 --2- 172.21.15.80:0/3832256213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff8e80d1a20 0x7ff8e8161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.034+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 >> 172.21.15.80:0/3832256213 conn(0x7ff8e80b6430 msgr2=0x7ff8e806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.035+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 shutdown_connections 2024-04-16T15:36:39.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.035+0000 7ff8f0688640 1 -- 172.21.15.80:0/3832256213 wait complete. 2024-04-16T15:36:39.044 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:39.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.152+0000 7fbffe19d640 1 Processor -- start 2024-04-16T15:36:39.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbffe19d640 1 -- start start 2024-04-16T15:36:39.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbffe19d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbff80cba80 0x7fbff80b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbffe19d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff806c5c0 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbffe19d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff806ba40 con 0x7fbff80d0dd0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbffe19d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbff806bd20 con 0x7fbff80cba80 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbff77fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbff815eaa0 0x7fbff80d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45660/0 (socket says 172.21.15.80:45660) 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.153+0000 7fbff77fe640 1 -- 172.21.15.80:0/1995549932 learned_addr learned my addr 172.21.15.80:0/1995549932 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbfeeffd640 1 --2- 172.21.15.80:0/1995549932 >> v2:172.21.15.87:3300/0 conn(0x7fbff80cba80 0x7fbff80b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91583267 0 0) 0x7fbff806c5c0 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe4003520 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1263624890 0 0) 0x7fbfe4003520 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 >> v2:172.21.15.87:3300/0 conn(0x7fbff80cba80 msgr2=0x7fbff80b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 --2- 172.21.15.80:0/1995549932 >> v2:172.21.15.87:3300/0 conn(0x7fbff80cba80 0x7fbff80b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 >> v1:172.21.15.87:6789/0 conn(0x7fbff80d0dd0 legacy=0x7fbff80b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff806c000 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fbfe8001670 con 0x7fbff815eaa0 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 >> v1:172.21.15.80:6789/0 conn(0x7fbff815eaa0 legacy=0x7fbff80d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 0x7fbfe4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfe40043b0 0x7fbfe4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe4005080 0x7fbfe400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbff806bd20 con 0x7fbfe40039b0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe400bfe0 con 0x7fbfe4005080 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe400c1e0 con 0x7fbfe40043b0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 0x7fbfe4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff7fff640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe4005080 0x7fbfe400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbfeeffd640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfe40043b0 0x7fbfe4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 -- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfe40043b0 msgr2=0x7fbfe4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfe40043b0 0x7fbfe4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 -- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe4005080 msgr2=0x7fbfe400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe4005080 0x7fbfe400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff7fff640 1 -- 172.21.15.80:0/1995549932 reap_dead start 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbff77fe640 1 -- 172.21.15.80:0/1995549932 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe4003520 con 0x7fbfe40039b0 2024-04-16T15:36:39.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.154+0000 7fbfeeffd640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbfe40043b0 0x7fbfe4004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.155+0000 7fbff77fe640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 0x7fbfe4003d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c190 tx=0x7fbfe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fd496eb7ced58c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.155+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8007cc0 con 0x7fbfe40039b0 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.155+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8030070 con 0x7fbfe40039b0 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.155+0000 7fbff6ffd640 1 -- 172.21.15.80:0/1995549932 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8005d50 con 0x7fbfe40039b0 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 -- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 msgr2=0x7fbfe4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 0x7fbfe4003d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c190 tx=0x7fbfe4005830 comp rx=0 tx=0).stop 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 -- 172.21.15.80:0/1995549932 shutdown_connections 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 --2- 172.21.15.80:0/1995549932 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbfe40039b0 0x7fbfe4003d90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 -- 172.21.15.80:0/1995549932 >> 172.21.15.80:0/1995549932 conn(0x7fbff80b2fa0 msgr2=0x7fbff80b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 -- 172.21.15.80:0/1995549932 shutdown_connections 2024-04-16T15:36:39.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.156+0000 7fbffe19d640 1 -- 172.21.15.80:0/1995549932 wait complete. 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.157+0000 7fbffe19d640 1 Processor -- start 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.157+0000 7fbffe19d640 1 -- start start 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe40039b0 0x7fbff81f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbff81f8290 0x7fbff814c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80b3ac0 con 0x7fbff8160050 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbff815ee80 con 0x7fbfe40039b0 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbffe19d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbff80b3c40 con 0x7fbff81f8290 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50874/0 (socket says 172.21.15.80:50874) 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 -- 172.21.15.80:0/2224577019 learned_addr learned my addr 172.21.15.80:0/2224577019 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:39.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff77fe640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe40039b0 0x7fbff81f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbfeeffd640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbff81f8290 0x7fbff814c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 -- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbff81f8290 msgr2=0x7fbff814c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbff81f8290 0x7fbff814c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 -- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe40039b0 msgr2=0x7fbff81f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe40039b0 0x7fbff81f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.158+0000 7fbff7fff640 1 -- 172.21.15.80:0/2224577019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff81f4950 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbff7fff640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbff80c4f10 tx=0x7fbff000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0019070 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff0006e20 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81f4c30 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0003b90 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.159+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff80ca6e0 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.160+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff80cfcc0 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.160+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbff001c070 con 0x7fbff8160050 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.161+0000 7fbff4ff9640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 0x7fbfd806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.161+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbff008b1f0 con 0x7fbff8160050 2024-04-16T15:36:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.161+0000 7fbff77fe640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 0x7fbfd806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.161+0000 7fbff77fe640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 0x7fbfd806ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.165+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbff80cfcc0 con 0x7fbff8160050 2024-04-16T15:36:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.343+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbff8069150 con 0x7fbff8160050 2024-04-16T15:36:39.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.343+0000 7fbff4ff9640 1 -- 172.21.15.80:0/2224577019 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fbff0058bd0 con 0x7fbff8160050 2024-04-16T15:36:39.342 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 msgr2=0x7fbfd806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 0x7fbfd806ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8034000 tx=0x7fbfe8009030 comp rx=0 tx=0).stop 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 msgr2=0x7fbff80c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbff80c4f10 tx=0x7fbff000ff70 comp rx=0 tx=0).stop 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 shutdown_connections 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbff8160050 0x7fbff80c8500 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbfd806c920 0x7fbfd806ede0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbff81f8290 0x7fbff814c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 --2- 172.21.15.80:0/2224577019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbfe40039b0 0x7fbff81f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 >> 172.21.15.80:0/2224577019 conn(0x7fbff80b2fa0 msgr2=0x7fbff80ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 shutdown_connections 2024-04-16T15:36:39.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.345+0000 7fbffe19d640 1 -- 172.21.15.80:0/2224577019 wait complete. 2024-04-16T15:36:39.355 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:39.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.462+0000 7fe3caf8d640 1 Processor -- start 2024-04-16T15:36:39.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.462+0000 7fe3caf8d640 1 -- start start 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3caf8d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3c415e950 0x7fe3c40b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3caf8d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe3c415ed30 0x7fe3c4162690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3caf8d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c4163560 con 0x7fe3c40d1a20 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3caf8d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c40b8090 con 0x7fe3c415e950 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3caf8d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c4162fa0 con 0x7fe3c415ed30 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c8d29640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe3c415e950 0x7fe3c40b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c952a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe3c40d1a20 0x7fe3c40cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45664/0 (socket says 172.21.15.80:45664) 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c952a640 1 -- 172.21.15.80:0/3737844018 learned_addr learned my addr 172.21.15.80:0/3737844018 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c8d29640 1 -- 172.21.15.80:0/3737844018 >> v2:172.21.15.87:3300/0 conn(0x7fe3c415ed30 msgr2=0x7fe3c4162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c8d29640 1 --2- 172.21.15.80:0/3737844018 >> v2:172.21.15.87:3300/0 conn(0x7fe3c415ed30 0x7fe3c4162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c8d29640 1 -- 172.21.15.80:0/3737844018 >> v1:172.21.15.80:6789/0 conn(0x7fe3c40d1a20 legacy=0x7fe3c40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c8d29640 1 -- 172.21.15.80:0/3737844018 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c4163280 con 0x7fe3c415e950 2024-04-16T15:36:39.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.463+0000 7fe3c37fe640 1 -- 172.21.15.80:0/3737844018 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034516315 0 0) 0x7fe3c4163560 con 0x7fe3c40d1a20 2024-04-16T15:36:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.464+0000 7fe3c8d29640 1 --2- 172.21.15.80:0/3737844018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c415e950 0x7fe3c40b7b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3c408c9a0 tx=0x7fe3b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450b21b2277720df server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.464+0000 7fe3c37fe640 1 -- 172.21.15.80:0/3737844018 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8035020 con 0x7fe3c415e950 2024-04-16T15:36:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.464+0000 7fe3c37fe640 1 -- 172.21.15.80:0/3737844018 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b8031830 con 0x7fe3c415e950 2024-04-16T15:36:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.464+0000 7fe3c37fe640 1 -- 172.21.15.80:0/3737844018 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8031c00 con 0x7fe3c415e950 2024-04-16T15:36:39.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 -- 172.21.15.80:0/3737844018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c415e950 msgr2=0x7fe3c40b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/3737844018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c415e950 0x7fe3c40b7b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3c408c9a0 tx=0x7fe3b802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 -- 172.21.15.80:0/3737844018 shutdown_connections 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/3737844018 >> v2:172.21.15.87:3300/0 conn(0x7fe3c415ed30 0x7fe3c4162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/3737844018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c415e950 0x7fe3c40b7b50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 -- 172.21.15.80:0/3737844018 >> 172.21.15.80:0/3737844018 conn(0x7fe3c40b6430 msgr2=0x7fe3c40b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 -- 172.21.15.80:0/3737844018 shutdown_connections 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.465+0000 7fe3caf8d640 1 -- 172.21.15.80:0/3737844018 wait complete. 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.466+0000 7fe3caf8d640 1 Processor -- start 2024-04-16T15:36:39.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.466+0000 7fe3caf8d640 1 -- start start 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 0x7fe3c40d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3c415ed30 0x7fe3c40d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4162bd0 con 0x7fe3c40d1a20 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c40d2bc0 con 0x7fe3c415e950 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c4162d50 con 0x7fe3c415ed30 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50894/0 (socket says 172.21.15.80:50894) 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 -- 172.21.15.80:0/2676688745 learned_addr learned my addr 172.21.15.80:0/2676688745 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c952a640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3c415ed30 0x7fe3c40d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c3fff640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 0x7fe3c40d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 -- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3c415ed30 msgr2=0x7fe3c40d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.468 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3c415ed30 0x7fe3c40d4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 -- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 msgr2=0x7fe3c40d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 0x7fe3c40d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 -- 172.21.15.80:0/2676688745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41f5450 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c3fff640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 0x7fe3c40d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c8d29640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009890 tx=0x7fe3b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b803ba80 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b803bc40 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c4158f80 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.467+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80453f0 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.468+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c4158c70 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.469+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c4068a40 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.469+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3b8038020 con 0x7fe3c40d1a20 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.469+0000 7fe3c17fa640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 0x7fe3a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.469+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe3b80addc0 con 0x7fe3c40d1a20 2024-04-16T15:36:39.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.469+0000 7fe3c3fff640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 0x7fe3a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.470+0000 7fe3c3fff640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 0x7fe3a806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3c41f8cf0 tx=0x7fe3b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.474+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3b8040070 con 0x7fe3c40d1a20 2024-04-16T15:36:39.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.649+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3c40b7360 con 0x7fe3c40d1a20 2024-04-16T15:36:39.647 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.649+0000 7fe3c17fa640 1 -- 172.21.15.80:0/2676688745 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fe3b807bdf0 con 0x7fe3c40d1a20 2024-04-16T15:36:39.648 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:39.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 msgr2=0x7fe3a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 0x7fe3a806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3c41f8cf0 tx=0x7fe3b0008040 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 msgr2=0x7fe3c40ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009890 tx=0x7fe3b80046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 shutdown_connections 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe3a806c8f0 0x7fe3a806edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe3c415ed30 0x7fe3c40d4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe3c415e950 0x7fe3c40d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 --2- 172.21.15.80:0/2676688745 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe3c40d1a20 0x7fe3c40ca960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 >> 172.21.15.80:0/2676688745 conn(0x7fe3c40b6430 msgr2=0x7fe3c406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 shutdown_connections 2024-04-16T15:36:39.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.651+0000 7fe3caf8d640 1 -- 172.21.15.80:0/2676688745 wait complete. 2024-04-16T15:36:39.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:39.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.767+0000 7fd4ed02c640 1 Processor -- start 2024-04-16T15:36:39.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.767+0000 7fd4ed02c640 1 -- start start 2024-04-16T15:36:39.767 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4ed02c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4e80b2c00 0x7fd4e80d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4ed02c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4e809b180 0x7fd4e80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4ed02c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e80ccba0 con 0x7fd4e80b3190 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4ed02c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e80b2fe0 con 0x7fd4e809b180 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4ed02c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e80d34f0 con 0x7fd4e80b2c00 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4e809b180 0x7fd4e80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd4e809b180 0x7fd4e80d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50898/0 (socket says 172.21.15.80:50898) 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 -- 172.21.15.80:0/1875057256 learned_addr learned my addr 172.21.15.80:0/1875057256 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e6d9d640 1 --2- 172.21.15.80:0/1875057256 >> v2:172.21.15.87:3300/0 conn(0x7fd4e80b2c00 0x7fd4e80d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 -- 172.21.15.80:0/1875057256 >> v2:172.21.15.87:3300/0 conn(0x7fd4e80b2c00 msgr2=0x7fd4e80d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 --2- 172.21.15.80:0/1875057256 >> v2:172.21.15.87:3300/0 conn(0x7fd4e80b2c00 0x7fd4e80d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 -- 172.21.15.80:0/1875057256 >> v1:172.21.15.87:6789/0 conn(0x7fd4e80b3190 legacy=0x7fd4e809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.768+0000 7fd4e759e640 1 -- 172.21.15.80:0/1875057256 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e80d3210 con 0x7fd4e809b180 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.769+0000 7fd4e759e640 1 --2- 172.21.15.80:0/1875057256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80d0a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8073590 tx=0x7fd4e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253207345a265a7b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.769+0000 7fd4e5d9b640 1 -- 172.21.15.80:0/1875057256 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0034070 con 0x7fd4e809b180 2024-04-16T15:36:39.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.769+0000 7fd4e5d9b640 1 -- 172.21.15.80:0/1875057256 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e0030860 con 0x7fd4e809b180 2024-04-16T15:36:39.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.769+0000 7fd4e5d9b640 1 -- 172.21.15.80:0/1875057256 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0030c30 con 0x7fd4e809b180 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1875057256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 msgr2=0x7fd4e80d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1875057256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80d0a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8073590 tx=0x7fd4e002b9a0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1875057256 shutdown_connections 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1875057256 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80d0a50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1875057256 >> v2:172.21.15.87:3300/0 conn(0x7fd4e80b2c00 0x7fd4e80d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1875057256 >> 172.21.15.80:0/1875057256 conn(0x7fd4e80d2550 msgr2=0x7fd4e80d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1875057256 shutdown_connections 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.770+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1875057256 wait complete. 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.771+0000 7fd4ed02c640 1 Processor -- start 2024-04-16T15:36:39.770 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.771+0000 7fd4ed02c640 1 -- start start 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e80b2c00 0x7fd4e80b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e80b3190 0x7fd4e814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e806dcb0 con 0x7fd4e809b180 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e806d940 con 0x7fd4e80b2c00 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4ed02c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e80d0f90 con 0x7fd4e80b3190 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50900/0 (socket says 172.21.15.80:50900) 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4e6d9d640 1 -- 172.21.15.80:0/1546048790 learned_addr learned my addr 172.21.15.80:0/1546048790 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4e759e640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e80b3190 0x7fd4e814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.772+0000 7fd4e659c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e80b2c00 0x7fd4e80b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 -- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e80b3190 msgr2=0x7fd4e814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e80b3190 0x7fd4e814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 -- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e80b2c00 msgr2=0x7fd4e80b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e80b2c00 0x7fd4e80b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 -- 172.21.15.80:0/1546048790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e80b6ba0 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4e6d9d640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009db0 tx=0x7fd4d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8018020 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d8014480 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8014850 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e80b72a0 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.773+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e80b67e0 con 0x7fd4e809b180 2024-04-16T15:36:39.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.774+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e8068a40 con 0x7fd4e809b180 2024-04-16T15:36:39.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.774+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4d8005d10 con 0x7fd4e809b180 2024-04-16T15:36:39.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.775+0000 7fd4cf7fe640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 0x7fd4d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:39.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.775+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd4d808ccd0 con 0x7fd4e809b180 2024-04-16T15:36:39.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.775+0000 7fd4e659c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 0x7fd4d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:39.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.775+0000 7fd4e659c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 0x7fd4d406ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc007fd0 tx=0x7fd4dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:39.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.779+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd4d8022030 con 0x7fd4e809b180 2024-04-16T15:36:39.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.954+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd4e80b84d0 con 0x7fd4e809b180 2024-04-16T15:36:39.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.954+0000 7fd4cf7fe640 1 -- 172.21.15.80:0/1546048790 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fd4d8010040 con 0x7fd4e809b180 2024-04-16T15:36:39.953 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 msgr2=0x7fd4d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 0x7fd4d406ede0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc007fd0 tx=0x7fd4dc009040 comp rx=0 tx=0).stop 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 msgr2=0x7fd4e80c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009db0 tx=0x7fd4d800c490 comp rx=0 tx=0).stop 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 shutdown_connections 2024-04-16T15:36:39.955 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.956+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd4d406c920 0x7fd4d406ede0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4e80b3190 0x7fd4e814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4e80b2c00 0x7fd4e80b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 --2- 172.21.15.80:0/1546048790 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4e809b180 0x7fd4e80c9620 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 >> 172.21.15.80:0/1546048790 conn(0x7fd4e80d2550 msgr2=0x7fd4e80718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 shutdown_connections 2024-04-16T15:36:39.956 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:39.957+0000 7fd4ed02c640 1 -- 172.21.15.80:0/1546048790 wait complete. 2024-04-16T15:36:39.966 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:40.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.072+0000 7feb1564a640 1 Processor -- start 2024-04-16T15:36:40.070 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.072+0000 7feb1564a640 1 -- start start 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb1564a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb10161f20 0x7feb100cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb1564a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb100d1700 0x7feb100cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb1564a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb100cfd90 con 0x7feb100b74e0 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb1564a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7feb100d0050 con 0x7feb10161f20 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb1564a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feb100d0330 con 0x7feb100d1700 2024-04-16T15:36:40.072 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb10161f20 0x7feb100cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb067fc640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7feb100b74e0 0x7feb100d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45674/0 (socket says 172.21.15.80:45674) 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7feb10161f20 0x7feb100cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50912/0 (socket says 172.21.15.80:50912) 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb067fc640 1 -- 172.21.15.80:0/880702846 learned_addr learned my addr 172.21.15.80:0/880702846 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0f7fe640 1 --2- 172.21.15.80:0/880702846 >> v2:172.21.15.87:3300/0 conn(0x7feb100d1700 0x7feb100cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 -- 172.21.15.80:0/880702846 >> v2:172.21.15.87:3300/0 conn(0x7feb100d1700 msgr2=0x7feb100cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 --2- 172.21.15.80:0/880702846 >> v2:172.21.15.87:3300/0 conn(0x7feb100d1700 0x7feb100cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 -- 172.21.15.80:0/880702846 >> v1:172.21.15.80:6789/0 conn(0x7feb100b74e0 legacy=0x7feb100d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0effd640 1 -- 172.21.15.80:0/880702846 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100d0610 con 0x7feb10161f20 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.073+0000 7feb0e7fc640 1 -- 172.21.15.80:0/880702846 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590019443 0 0) 0x7feb100cfd90 con 0x7feb100b74e0 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.074+0000 7feb0effd640 1 --2- 172.21.15.80:0/880702846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb10161f20 0x7feb100cf230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb100b5f60 tx=0x7feb0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42c633d0ba050c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.074+0000 7feb0e7fc640 1 -- 172.21.15.80:0/880702846 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00035020 con 0x7feb10161f20 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.074+0000 7feb0e7fc640 1 -- 172.21.15.80:0/880702846 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb00031830 con 0x7feb10161f20 2024-04-16T15:36:40.073 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.074+0000 7feb0e7fc640 1 -- 172.21.15.80:0/880702846 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00031c00 con 0x7feb10161f20 2024-04-16T15:36:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 -- 172.21.15.80:0/880702846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb10161f20 msgr2=0x7feb100cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 --2- 172.21.15.80:0/880702846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb10161f20 0x7feb100cf230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb100b5f60 tx=0x7feb0002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 -- 172.21.15.80:0/880702846 shutdown_connections 2024-04-16T15:36:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 --2- 172.21.15.80:0/880702846 >> v2:172.21.15.87:3300/0 conn(0x7feb100d1700 0x7feb100cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.076 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 --2- 172.21.15.80:0/880702846 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb10161f20 0x7feb100cf230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 -- 172.21.15.80:0/880702846 >> 172.21.15.80:0/880702846 conn(0x7feb1008c000 msgr2=0x7feb100d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 -- 172.21.15.80:0/880702846 shutdown_connections 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.075+0000 7feb1564a640 1 -- 172.21.15.80:0/880702846 wait complete. 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.076+0000 7feb1564a640 1 Processor -- start 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.076+0000 7feb1564a640 1 -- start start 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb100b74e0 0x7feb10150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb10161f20 0x7feb100cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7feb100d27e0 con 0x7feb100d1700 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feb100b5730 con 0x7feb10161f20 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7feb100d2960 con 0x7feb100b74e0 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50914/0 (socket says 172.21.15.80:50914) 2024-04-16T15:36:40.077 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 -- 172.21.15.80:0/4100544506 learned_addr learned my addr 172.21.15.80:0/4100544506 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 -- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb100b74e0 msgr2=0x7feb10150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb100b74e0 0x7feb10150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 -- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb10161f20 msgr2=0x7feb100cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb10161f20 0x7feb100cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 -- 172.21.15.80:0/4100544506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100c97c0 con 0x7feb100d1700 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb067fc640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c4d0 tx=0x7feaf800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8018070 con 0x7feb100d1700 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8007500 con 0x7feb100d1700 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb100c9aa0 con 0x7feb100d1700 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8004a20 con 0x7feb100d1700 2024-04-16T15:36:40.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.077+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb100ca060 con 0x7feb100d1700 2024-04-16T15:36:40.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.078+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb10068a40 con 0x7feb100d1700 2024-04-16T15:36:40.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.079+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feaf801b070 con 0x7feb100d1700 2024-04-16T15:36:40.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.079+0000 7feb07fff640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 0x7feaf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.079+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7feaf808b260 con 0x7feb100d1700 2024-04-16T15:36:40.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.079+0000 7feb0effd640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 0x7feaf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.080+0000 7feb0effd640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 0x7feaf006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb00036000 tx=0x7feb00030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.084+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feaf8059290 con 0x7feb100d1700 2024-04-16T15:36:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.273+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feb1006bac0 con 0x7feb100d1700 2024-04-16T15:36:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.274+0000 7feb07fff640 1 -- 172.21.15.80:0/4100544506 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7feaf8058b90 con 0x7feb100d1700 2024-04-16T15:36:40.272 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.275+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 msgr2=0x7feaf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.275+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 0x7feaf006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb00036000 tx=0x7feb00030000 comp rx=0 tx=0).stop 2024-04-16T15:36:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.275+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 msgr2=0x7feb100ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.274 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.275+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c4d0 tx=0x7feaf800c990 comp rx=0 tx=0).stop 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 shutdown_connections 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb10161f20 0x7feb100cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7feb100d1700 0x7feb100ca860 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7feaf006c8f0 0x7feaf006edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 --2- 172.21.15.80:0/4100544506 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7feb100b74e0 0x7feb10150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 >> 172.21.15.80:0/4100544506 conn(0x7feb1008c000 msgr2=0x7feb100b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 shutdown_connections 2024-04-16T15:36:40.275 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.276+0000 7feb1564a640 1 -- 172.21.15.80:0/4100544506 wait complete. 2024-04-16T15:36:40.285 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-04-16T15:36:40.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:40.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-16T15:36:40.319 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:40.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:36:40.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:40.320 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T15:36:40.476 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:40.476 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:40.492 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:40.493 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:40.549 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.694+0000 7f6c92869640 1 Processor -- start 2024-04-16T15:36:40.693 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.694+0000 7f6c92869640 1 -- start start 2024-04-16T15:36:40.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c92869640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 0x7f6c8c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c92869640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c8c15eaa0 0x7f6c8c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c92869640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0b4010 con 0x7f6c8c0ca770 2024-04-16T15:36:40.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c92869640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8c0b3800 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c92869640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c06c8f0 con 0x7f6c8c0d1010 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c90e06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6c8c15eaa0 0x7f6c8c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c8bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6c8c0ca770 0x7f6c8c0cab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45684/0 (socket says 172.21.15.80:45684) 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.695+0000 7f6c8bfff640 1 -- 172.21.15.80:0/3631778652 learned_addr learned my addr 172.21.15.80:0/3631778652 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c8b7fe640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 0x7f6c8c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c90e06640 1 -- 172.21.15.80:0/3631778652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 msgr2=0x7f6c8c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c90e06640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 0x7f6c8c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c90e06640 1 -- 172.21.15.80:0/3631778652 >> v1:172.21.15.80:6789/0 conn(0x7f6c8c0ca770 legacy=0x7f6c8c0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c8affd640 1 -- 172.21.15.80:0/3631778652 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185558154 0 0) 0x7f6c8c0b4010 con 0x7f6c8c0ca770 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c90e06640 1 -- 172.21.15.80:0/3631778652 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0cf100 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c8b7fe640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 0x7f6c8c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.696+0000 7f6c90e06640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0ae360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009d90 tx=0x7f6c8402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c21a4eeb95d0ee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c8affd640 1 -- 172.21.15.80:0/3631778652 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84039070 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c8affd640 1 -- 172.21.15.80:0/3631778652 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8402cc50 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c8affd640 1 -- 172.21.15.80:0/3631778652 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84034440 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 -- 172.21.15.80:0/3631778652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 msgr2=0x7f6c8c0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0ae360 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009d90 tx=0x7f6c8402bea0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 -- 172.21.15.80:0/3631778652 shutdown_connections 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0ae360 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 --2- 172.21.15.80:0/3631778652 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0d1010 0x7f6c8c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 -- 172.21.15.80:0/3631778652 >> 172.21.15.80:0/3631778652 conn(0x7f6c8c09aa70 msgr2=0x7f6c8c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 -- 172.21.15.80:0/3631778652 shutdown_connections 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.697+0000 7f6c92869640 1 -- 172.21.15.80:0/3631778652 wait complete. 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.698+0000 7f6c92869640 1 Processor -- start 2024-04-16T15:36:40.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 -- start start 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0ca770 0x7f6c8c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8c0d1010 0x7f6c8c0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cf3a0 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0b3d30 con 0x7f6c8c0d1010 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c92869640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0ae8a0 con 0x7f6c8c0ca770 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c90e06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c90e06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50934/0 (socket says 172.21.15.80:50934) 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.699+0000 7f6c90e06640 1 -- 172.21.15.80:0/3412697776 learned_addr learned my addr 172.21.15.80:0/3412697776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c8bfff640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0ca770 0x7f6c8c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c8b7fe640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8c0d1010 0x7f6c8c0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 -- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0ca770 msgr2=0x7f6c8c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0ca770 0x7f6c8c0cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 -- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8c0d1010 msgr2=0x7f6c8c0d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8c0d1010 0x7f6c8c0d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 -- 172.21.15.80:0/3412697776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c158db0 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c90e06640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c84037040 tx=0x7f6c84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84044030 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8402ca50 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c0cdb40 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84039040 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.700+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c15f3e0 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.701+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c068a40 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.701+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c84047070 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.702+0000 7f6c88ff9640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 0x7f6c7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.702+0000 7f6c8bfff640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 0x7f6c7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.702+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6c840ae500 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.702+0000 7f6c8bfff640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 0x7f6c7806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007fd0 tx=0x7f6c7c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:40.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.706+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c8404e070 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.881+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c8c15d640 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.883+0000 7f6c88ff9640 1 -- 172.21.15.80:0/3412697776 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f6c8c158db0 con 0x7f6c8c15eaa0 2024-04-16T15:36:40.881 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:40.881 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.884+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 msgr2=0x7f6c7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.884+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 0x7f6c7806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007fd0 tx=0x7f6c7c007de0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.884+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 msgr2=0x7f6c8c0d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.884+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c84037040 tx=0x7f6c84004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 shutdown_connections 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c8c15eaa0 0x7f6c8c0d1e70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6c8c0d1010 0x7f6c8c0d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6c7806c8f0 0x7f6c7806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 --2- 172.21.15.80:0/3412697776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6c8c0ca770 0x7f6c8c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 >> 172.21.15.80:0/3412697776 conn(0x7f6c8c09aa70 msgr2=0x7f6c8c0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 shutdown_connections 2024-04-16T15:36:40.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:40.885+0000 7f6c92869640 1 -- 172.21.15.80:0/3412697776 wait complete. 2024-04-16T15:36:40.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:40.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.002+0000 7f53ea2a5640 1 Processor -- start 2024-04-16T15:36:41.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.002+0000 7f53ea2a5640 1 -- start start 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53ea2a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f53e415ee40 0x7f53e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53ea2a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53e40b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53ea2a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e40d14f0 con 0x7f53e415ea60 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53ea2a5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f53e40b1950 con 0x7f53e415ee40 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53ea2a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f53e40d17d0 con 0x7f53e40afc40 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e3fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f53e415ea60 0x7f53e406cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45692/0 (socket says 172.21.15.80:45692) 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e3fff640 1 -- 172.21.15.80:0/3234083284 learned_addr learned my addr 172.21.15.80:0/3234083284 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e8842640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53e40b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53dbfff640 1 --2- 172.21.15.80:0/3234083284 >> v2:172.21.15.87:3300/0 conn(0x7f53e415ee40 0x7f53e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325763458 0 0) 0x7f53e40d14f0 con 0x7f53e415ea60 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d0003520 con 0x7f53e415ea60 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3211872982 0 0) 0x7f53d0003520 con 0x7f53e415ea60 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 msgr2=0x7f53e40b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53e40b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 >> v2:172.21.15.87:3300/0 conn(0x7f53e415ee40 msgr2=0x7f53e406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 --2- 172.21.15.80:0/3234083284 >> v2:172.21.15.87:3300/0 conn(0x7f53e415ee40 0x7f53e406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e40af440 con 0x7f53e415ea60 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e8842640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53e40b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f53d4001670 con 0x7f53e415ea60 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 >> v1:172.21.15.80:6789/0 conn(0x7f53e415ea60 legacy=0x7f53e406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d00039b0 0x7f53d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53d0004d40 0x7f53d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53e40b1950 con 0x7f53d00039b0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f53e40d17d0 con 0x7f53d0004d40 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f53d000b9c0 con 0x7f53e40afc40 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.003+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d00039b0 0x7f53d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53dbfff640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e8842640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53d0004d40 0x7f53d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 -- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 msgr2=0x7f53d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e40afc40 0x7f53d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 -- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53d0004d40 msgr2=0x7f53d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53d0004d40 0x7f53d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 -- 172.21.15.80:0/3234083284 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d0003520 con 0x7f53d00039b0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e8842640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53d0004d40 0x7f53d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.004+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d00039b0 0x7f53d0003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c210 tx=0x7f53d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3175c66f909720c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4007d50 con 0x7f53d00039b0 2024-04-16T15:36:41.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d4030070 con 0x7f53d00039b0 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53e37fe640 1 -- 172.21.15.80:0/3234083284 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d402cda0 con 0x7f53d00039b0 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3234083284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d00039b0 msgr2=0x7f53d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3234083284 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53d00039b0 0x7f53d0003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c210 tx=0x7f53d0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53e8842640 1 -- 172.21.15.80:0/3234083284 reap_dead start 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3234083284 shutdown_connections 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3234083284 >> 172.21.15.80:0/3234083284 conn(0x7f53e40b4060 msgr2=0x7f53e40b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3234083284 shutdown_connections 2024-04-16T15:36:41.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.005+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3234083284 wait complete. 2024-04-16T15:36:41.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.006+0000 7f53ea2a5640 1 Processor -- start 2024-04-16T15:36:41.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.006+0000 7f53ea2a5640 1 -- start start 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e414bef0 0x7f53e414a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e40b3300 0x7f53e40b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f53e40d1260 con 0x7f53e40cba30 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f53e40d10e0 con 0x7f53e40b3300 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53ea2a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f53e409ba80 con 0x7f53e414bef0 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50940/0 (socket says 172.21.15.80:50940) 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 -- 172.21.15.80:0/3222798731 learned_addr learned my addr 172.21.15.80:0/3222798731 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e414bef0 0x7f53e414a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 -- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e414bef0 msgr2=0x7f53e414a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e414bef0 0x7f53e414a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 -- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e40b3300 msgr2=0x7f53e40b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e40b3300 0x7f53e40b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.007+0000 7f53e8842640 1 -- 172.21.15.80:0/3222798731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e414d360 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53e8842640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e4072890 tx=0x7f53dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011d40 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc01b070 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e40caf50 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc003990 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.008+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e40cb510 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.009+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4069150 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.009+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53dc005d10 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.010+0000 7f53e17fa640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 0x7f53c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.010+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f53dc08c420 con 0x7f53e40cba30 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.010+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 0x7f53c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.010+0000 7f53e3fff640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 0x7f53c406ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53d4034000 tx=0x7f53d4039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.014+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53dc025020 con 0x7f53e40cba30 2024-04-16T15:36:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.191+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53e40cad20 con 0x7f53e40cba30 2024-04-16T15:36:41.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.192+0000 7f53e17fa640 1 -- 172.21.15.80:0/3222798731 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f53dc05a450 con 0x7f53e40cba30 2024-04-16T15:36:41.190 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:41.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 msgr2=0x7f53c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 0x7f53c406ede0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53d4034000 tx=0x7f53d4039040 comp rx=0 tx=0).stop 2024-04-16T15:36:41.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 msgr2=0x7f53e40cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53e4072890 tx=0x7f53dc009f90 comp rx=0 tx=0).stop 2024-04-16T15:36:41.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 shutdown_connections 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f53e40cba30 0x7f53e40cbeb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.193+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e40b3300 0x7f53e40b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.194+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f53c406c920 0x7f53c406ede0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.194+0000 7f53ea2a5640 1 --2- 172.21.15.80:0/3222798731 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f53e414bef0 0x7f53e414a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.194+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 >> 172.21.15.80:0/3222798731 conn(0x7f53e40b4060 msgr2=0x7f53e415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.194+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 shutdown_connections 2024-04-16T15:36:41.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.194+0000 7f53ea2a5640 1 -- 172.21.15.80:0/3222798731 wait complete. 2024-04-16T15:36:41.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:41.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.311+0000 7f6794774640 1 Processor -- start 2024-04-16T15:36:41.309 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.311+0000 7f6794774640 1 -- start start 2024-04-16T15:36:41.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6794774640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f678c0ccdb0 0x7f678c0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6794774640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c06bad0 con 0x7f678c0d03d0 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6794774640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c06bdb0 con 0x7f678c0cf8e0 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6794774640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f678c06c090 con 0x7f678c0ccdb0 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6791d0f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f678c0ccdb0 0x7f678c0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6792d11640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f678c0d03d0 0x7f678c06c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45694/0 (socket says 172.21.15.80:45694) 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6792d11640 1 -- 172.21.15.80:0/3770146038 learned_addr learned my addr 172.21.15.80:0/3770146038 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6791d0f640 1 -- 172.21.15.80:0/3770146038 >> v1:172.21.15.87:6789/0 conn(0x7f678c0cf8e0 legacy=0x7f678c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6791d0f640 1 -- 172.21.15.80:0/3770146038 >> v1:172.21.15.80:6789/0 conn(0x7f678c0d03d0 legacy=0x7f678c06c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f679150e640 1 -- 172.21.15.80:0/3770146038 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473243813 0 0) 0x7f678c06bad0 con 0x7f678c0d03d0 2024-04-16T15:36:41.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.312+0000 7f6791d0f640 1 -- 172.21.15.80:0/3770146038 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c06c370 con 0x7f678c0ccdb0 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f6791d0f640 1 --2- 172.21.15.80:0/3770146038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0ccdb0 0x7f678c0cdca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097a0 tx=0x7f677c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75cb883733c7061 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f679150e640 1 -- 172.21.15.80:0/3770146038 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c0315a0 con 0x7f678c0ccdb0 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f679150e640 1 -- 172.21.15.80:0/3770146038 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c037070 con 0x7f678c0ccdb0 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f679150e640 1 -- 172.21.15.80:0/3770146038 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c031960 con 0x7f678c0ccdb0 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f6794774640 1 -- 172.21.15.80:0/3770146038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0ccdb0 msgr2=0x7f678c0cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.313+0000 7f6794774640 1 --2- 172.21.15.80:0/3770146038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0ccdb0 0x7f678c0cdca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097a0 tx=0x7f677c02b840 comp rx=0 tx=0).stop 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.314+0000 7f6794774640 1 -- 172.21.15.80:0/3770146038 shutdown_connections 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.314+0000 7f6794774640 1 --2- 172.21.15.80:0/3770146038 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0ccdb0 0x7f678c0cdca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.314+0000 7f6794774640 1 -- 172.21.15.80:0/3770146038 >> 172.21.15.80:0/3770146038 conn(0x7f678c0d0c30 msgr2=0x7f678c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.314+0000 7f6794774640 1 -- 172.21.15.80:0/3770146038 shutdown_connections 2024-04-16T15:36:41.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.314+0000 7f6794774640 1 -- 172.21.15.80:0/3770146038 wait complete. 2024-04-16T15:36:41.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 Processor -- start 2024-04-16T15:36:41.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 -- start start 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 0x7f678c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f678c0cf8e0 0x7f678c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f678c0b00f0 con 0x7f678c0d03d0 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f678c0ce2b0 con 0x7f678c0cf8e0 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.315+0000 7f6794774640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f678c15a9d0 con 0x7f678c0ccdb0 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50956/0 (socket says 172.21.15.80:50956) 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 -- 172.21.15.80:0/3646543461 learned_addr learned my addr 172.21.15.80:0/3646543461 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:41.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792510640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 0x7f678c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6791d0f640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f678c0cf8e0 0x7f678c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 -- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 msgr2=0x7f678c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 0x7f678c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 -- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f678c0cf8e0 msgr2=0x7f678c13d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f678c0cf8e0 0x7f678c13d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 -- 172.21.15.80:0/3646543461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c15acb0 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792510640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 0x7f678c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6792d11640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f678400c7a0 tx=0x7f678400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784018070 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678400a640 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678c15af90 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678400aab0 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.316+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678c15b550 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.317+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678c068a40 con 0x7f678c0d03d0 2024-04-16T15:36:41.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.318+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f678401b070 con 0x7f678c0d03d0 2024-04-16T15:36:41.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.318+0000 7f6782ffd640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 0x7f677006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.318+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f678408b5b0 con 0x7f678c0d03d0 2024-04-16T15:36:41.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.318+0000 7f6792510640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 0x7f677006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.319+0000 7f6792510640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 0x7f677006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6788007fd0 tx=0x7f6788009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.322+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67840595e0 con 0x7f678c0d03d0 2024-04-16T15:36:41.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.498+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f678c159fe0 con 0x7f678c0d03d0 2024-04-16T15:36:41.496 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.498+0000 7f6782ffd640 1 -- 172.21.15.80:0/3646543461 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6784058ee0 con 0x7f678c0d03d0 2024-04-16T15:36:41.496 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:41.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 msgr2=0x7f677006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 0x7f677006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6788007fd0 tx=0x7f6788009040 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 msgr2=0x7f678c150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f678400c7a0 tx=0x7f678400cc60 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 shutdown_connections 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f678c0d03d0 0x7f678c150200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f678c0cf8e0 0x7f678c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f677006c8f0 0x7f677006edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 --2- 172.21.15.80:0/3646543461 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f678c0ccdb0 0x7f678c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 >> 172.21.15.80:0/3646543461 conn(0x7f678c0d0c30 msgr2=0x7f678c0b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 shutdown_connections 2024-04-16T15:36:41.499 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.500+0000 7f6794774640 1 -- 172.21.15.80:0/3646543461 wait complete. 2024-04-16T15:36:41.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.616+0000 7efdabf1c640 1 Processor -- start 2024-04-16T15:36:41.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 -- start start 2024-04-16T15:36:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efda406f650 0x7efda40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 0x7efda415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda415bd50 con 0x7efda4145020 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7efda415c030 con 0x7efda406f650 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.617+0000 7efdabf1c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efda415c310 con 0x7efda40cd820 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efda406f650 0x7efda40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7efda406f650 0x7efda40cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50958/0 (socket says 172.21.15.80:50958) 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 -- 172.21.15.80:0/2866344114 learned_addr learned my addr 172.21.15.80:0/2866344114 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efdaa4b9640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 0x7efda415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 -- 172.21.15.80:0/2866344114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 msgr2=0x7efda415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 0x7efda415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 -- 172.21.15.80:0/2866344114 >> v1:172.21.15.87:6789/0 conn(0x7efda4145020 legacy=0x7efda406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efda94b7640 1 -- 172.21.15.80:0/2866344114 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda415c5f0 con 0x7efda406f650 2024-04-16T15:36:41.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.618+0000 7efdaa4b9640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 0x7efda415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efda94b7640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda406f650 0x7efda40cd2e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efd94009870 tx=0x7efd9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba6c143d31d1b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efda8cb6640 1 -- 172.21.15.80:0/2866344114 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94035020 con 0x7efda406f650 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efda8cb6640 1 -- 172.21.15.80:0/2866344114 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94031640 con 0x7efda406f650 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efda8cb6640 1 -- 172.21.15.80:0/2866344114 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9402d040 con 0x7efda406f650 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 -- 172.21.15.80:0/2866344114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda406f650 msgr2=0x7efda40cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda406f650 0x7efda40cd2e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efd94009870 tx=0x7efd9402b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 -- 172.21.15.80:0/2866344114 shutdown_connections 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda40cd820 0x7efda415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 --2- 172.21.15.80:0/2866344114 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda406f650 0x7efda40cd2e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 -- 172.21.15.80:0/2866344114 >> 172.21.15.80:0/2866344114 conn(0x7efda4067d90 msgr2=0x7efda406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 -- 172.21.15.80:0/2866344114 shutdown_connections 2024-04-16T15:36:41.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.619+0000 7efdabf1c640 1 -- 172.21.15.80:0/2866344114 wait complete. 2024-04-16T15:36:41.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 Processor -- start 2024-04-16T15:36:41.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 -- start start 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda406f650 0x7efda41571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40cd820 0x7efda415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efda40b3f90 con 0x7efda4145020 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efda40b3e10 con 0x7efda40cd820 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdabf1c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efda415f770 con 0x7efda406f650 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdaa4b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdaa4b9640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50970/0 (socket says 172.21.15.80:50970) 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.621+0000 7efdaa4b9640 1 -- 172.21.15.80:0/959339408 learned_addr learned my addr 172.21.15.80:0/959339408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efda9cb8640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda406f650 0x7efda41571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efda94b7640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40cd820 0x7efda415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 -- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda406f650 msgr2=0x7efda41571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda406f650 0x7efda41571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 -- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40cd820 msgr2=0x7efda415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40cd820 0x7efda415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 -- 172.21.15.80:0/959339408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda4159860 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdaa4b9640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd9c007ef0 tx=0x7efd9c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c01a070 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9c003b90 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00de20 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda4159b40 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.622+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda415a100 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.623+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda4139b30 con 0x7efda4145020 2024-04-16T15:36:41.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.624+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd9c01d070 con 0x7efda4145020 2024-04-16T15:36:41.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.624+0000 7efd9a7fc640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 0x7efd8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.624+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efd9c08c040 con 0x7efda4145020 2024-04-16T15:36:41.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.624+0000 7efda9cb8640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 0x7efd8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.624+0000 7efda9cb8640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 0x7efd8806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efda0006fd0 tx=0x7efda0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.628+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd9c010070 con 0x7efda4145020 2024-04-16T15:36:41.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.802+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efda41410b0 con 0x7efda4145020 2024-04-16T15:36:41.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.803+0000 7efd9a7fc640 1 -- 172.21.15.80:0/959339408 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7efd9c059ab0 con 0x7efda4145020 2024-04-16T15:36:41.801 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:41.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 msgr2=0x7efd8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 0x7efd8806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efda0006fd0 tx=0x7efda0008040 comp rx=0 tx=0).stop 2024-04-16T15:36:41.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 msgr2=0x7efda4141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd9c007ef0 tx=0x7efd9c00d4a0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 shutdown_connections 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efda4145020 0x7efda4141990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efda40cd820 0x7efda415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efd8806c920 0x7efd8806ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 --2- 172.21.15.80:0/959339408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efda406f650 0x7efda41571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 >> 172.21.15.80:0/959339408 conn(0x7efda4067d90 msgr2=0x7efda40b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 shutdown_connections 2024-04-16T15:36:41.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.805+0000 7efdabf1c640 1 -- 172.21.15.80:0/959339408 wait complete. 2024-04-16T15:36:41.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.922+0000 7f83fe39d640 1 Processor -- start 2024-04-16T15:36:41.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 -- start start 2024-04-16T15:36:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83f809aa70 0x7f83f80d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80b33d0 0x7f83f809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f80ce780 con 0x7f83f806cab0 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f83f80d0830 con 0x7f83f809aa70 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.923+0000 7f83fe39d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f83f809b390 con 0x7f83f80b33d0 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fd39b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f83f809aa70 0x7f83f80d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fdb9c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f83f806cab0 0x7f83f806cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45696/0 (socket says 172.21.15.80:45696) 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fdb9c640 1 -- 172.21.15.80:0/3222947903 learned_addr learned my addr 172.21.15.80:0/3222947903 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fcb9a640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80b33d0 0x7f83f809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fd39b640 1 -- 172.21.15.80:0/3222947903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80b33d0 msgr2=0x7f83f809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fd39b640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80b33d0 0x7f83f809ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fd39b640 1 -- 172.21.15.80:0/3222947903 >> v1:172.21.15.80:6789/0 conn(0x7f83f806cab0 legacy=0x7f83f806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83fd39b640 1 -- 172.21.15.80:0/3222947903 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f80b26d0 con 0x7f83f809aa70 2024-04-16T15:36:41.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.924+0000 7f83ebfff640 1 -- 172.21.15.80:0/3222947903 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129432130 0 0) 0x7f83f80ce780 con 0x7f83f806cab0 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fd39b640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f809aa70 0x7f83f80d2e40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0097a0 tx=0x7f83ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d202541de5bea9b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83ebfff640 1 -- 172.21.15.80:0/3222947903 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec035020 con 0x7f83f809aa70 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83ebfff640 1 -- 172.21.15.80:0/3222947903 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec031830 con 0x7f83f809aa70 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83ebfff640 1 -- 172.21.15.80:0/3222947903 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec031c00 con 0x7f83f809aa70 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 -- 172.21.15.80:0/3222947903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f809aa70 msgr2=0x7f83f80d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f809aa70 0x7f83f80d2e40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0097a0 tx=0x7f83ec02b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 -- 172.21.15.80:0/3222947903 shutdown_connections 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f80b33d0 0x7f83f809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 --2- 172.21.15.80:0/3222947903 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f809aa70 0x7f83f80d2e40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 -- 172.21.15.80:0/3222947903 >> 172.21.15.80:0/3222947903 conn(0x7f83f80d2320 msgr2=0x7f83f80d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.925+0000 7f83fe39d640 1 -- 172.21.15.80:0/3222947903 shutdown_connections 2024-04-16T15:36:41.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.926+0000 7f83fe39d640 1 -- 172.21.15.80:0/3222947903 wait complete. 2024-04-16T15:36:41.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 Processor -- start 2024-04-16T15:36:41.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 -- start start 2024-04-16T15:36:41.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f809aa70 0x7f83f80b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80b33d0 0x7f83f80b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f83f80b2f70 con 0x7f83f806cab0 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f83f80b2c90 con 0x7f83f80b33d0 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fe39d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f83f80d0470 con 0x7f83f809aa70 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fd39b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fd39b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50990/0 (socket says 172.21.15.80:50990) 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.927+0000 7f83fd39b640 1 -- 172.21.15.80:0/756908870 learned_addr learned my addr 172.21.15.80:0/756908870 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fcb9a640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f809aa70 0x7f83f80b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 -- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f809aa70 msgr2=0x7f83f80b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f809aa70 0x7f83f80b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 -- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80b33d0 msgr2=0x7f83f80b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80b33d0 0x7f83f80b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 -- 172.21.15.80:0/756908870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f80caef0 con 0x7f83f806cab0 2024-04-16T15:36:41.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fd39b640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f83ec02bee0 tx=0x7f83ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec041070 con 0x7f83f806cab0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec03b920 con 0x7f83f806cab0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f80cb190 con 0x7f83f806cab0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec035040 con 0x7f83f806cab0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.928+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f80cb750 con 0x7f83f806cab0 2024-04-16T15:36:41.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.929+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f804fd90 con 0x7f83f806cab0 2024-04-16T15:36:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.930+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83ec04c060 con 0x7f83f806cab0 2024-04-16T15:36:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.930+0000 7f83e9ffb640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 0x7f83dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.930+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f83ec0ad9b0 con 0x7f83f806cab0 2024-04-16T15:36:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.930+0000 7f83fcb9a640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 0x7f83dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:41.930 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.931+0000 7f83fcb9a640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 0x7f83dc06ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83f8156200 tx=0x7f83f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:41.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:41.935+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83ec07b960 con 0x7f83f806cab0 2024-04-16T15:36:42.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.108+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f83f80a02d0 con 0x7f83f806cab0 2024-04-16T15:36:42.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.109+0000 7f83e9ffb640 1 -- 172.21.15.80:0/756908870 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f83ec07b260 con 0x7f83f806cab0 2024-04-16T15:36:42.107 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:42.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 msgr2=0x7f83dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 0x7f83dc06ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f83f8156200 tx=0x7f83f4008040 comp rx=0 tx=0).stop 2024-04-16T15:36:42.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 msgr2=0x7f83f8155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f83ec02bee0 tx=0x7f83ec0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 shutdown_connections 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f83f80b33d0 0x7f83f80b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f83dc06c920 0x7f83dc06ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f83f809aa70 0x7f83f80b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 --2- 172.21.15.80:0/756908870 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f83f806cab0 0x7f83f8155a70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 >> 172.21.15.80:0/756908870 conn(0x7f83f80d2320 msgr2=0x7f83f81618d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 shutdown_connections 2024-04-16T15:36:42.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.111+0000 7f83fe39d640 1 -- 172.21.15.80:0/756908870 wait complete. 2024-04-16T15:36:42.121 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:42.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.228+0000 7f10217bd640 1 Processor -- start 2024-04-16T15:36:42.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.228+0000 7f10217bd640 1 -- start start 2024-04-16T15:36:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f10217bd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f101c0d1700 0x7f101c0d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f10217bd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c0cfd90 con 0x7f101c161f20 2024-04-16T15:36:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f10217bd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c0d0050 con 0x7f101c0b74e0 2024-04-16T15:36:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f10217bd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f101c0d0330 con 0x7f101c0d1700 2024-04-16T15:36:42.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f101affd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f101c161f20 0x7f101c0cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45708/0 (socket says 172.21.15.80:45708) 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f101affd640 1 -- 172.21.15.80:0/3397427385 learned_addr learned my addr 172.21.15.80:0/3397427385 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646638323 0 0) 0x7f101c0cfd90 con 0x7f101c161f20 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1004003520 con 0x7f101c161f20 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f101b7fe640 1 --2- 172.21.15.80:0/3397427385 >> v2:172.21.15.87:3300/0 conn(0x7f101c0d1700 0x7f101c0d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 341768745 0 0) 0x7f1004003520 con 0x7f101c161f20 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 >> v2:172.21.15.87:3300/0 conn(0x7f101c0d1700 msgr2=0x7f101c0d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 --2- 172.21.15.80:0/3397427385 >> v2:172.21.15.87:3300/0 conn(0x7f101c0d1700 0x7f101c0d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 >> v1:172.21.15.87:6789/0 conn(0x7f101c0b74e0 legacy=0x7f101c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c0d0610 con 0x7f101c161f20 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.229+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f100c0019f0 con 0x7f101c161f20 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 >> v1:172.21.15.80:6789/0 conn(0x7f101c161f20 legacy=0x7f101c0cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 0x7f1004003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1004004800 0x7f1004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10040051c0 0x7f100400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0d0330 con 0x7f10040039b0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f100400c110 con 0x7f1004004800 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f100400c310 con 0x7f10040051c0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 0x7f1004003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101a7fc640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1004004800 0x7f1004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101b7fe640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10040051c0 0x7f100400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 -- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10040051c0 msgr2=0x7f100400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10040051c0 0x7f100400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 -- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1004004800 msgr2=0x7f1004004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1004004800 0x7f1004004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101affd640 1 -- 172.21.15.80:0/3397427385 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1004003520 con 0x7f10040039b0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101b7fe640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f10040051c0 0x7f100400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.230+0000 7f101b7fe640 1 -- 172.21.15.80:0/3397427385 reap_dead start 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f101affd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 0x7f1004003dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a850 tx=0x7f1004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8f8ae41394895c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c00a4a0 con 0x7f10040039b0 2024-04-16T15:36:42.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c034650 con 0x7f10040039b0 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f1019ffb640 1 -- 172.21.15.80:0/3397427385 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ce60 con 0x7f10040039b0 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 -- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 msgr2=0x7f1004003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 0x7f1004003dd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a850 tx=0x7f1004005830 comp rx=0 tx=0).stop 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 -- 172.21.15.80:0/3397427385 shutdown_connections 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 --2- 172.21.15.80:0/3397427385 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10040039b0 0x7f1004003dd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 -- 172.21.15.80:0/3397427385 >> 172.21.15.80:0/3397427385 conn(0x7f101c08c000 msgr2=0x7f101c0d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 -- 172.21.15.80:0/3397427385 shutdown_connections 2024-04-16T15:36:42.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.231+0000 7f10217bd640 1 -- 172.21.15.80:0/3397427385 wait complete. 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 Processor -- start 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 -- start start 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 0x7f101c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 0x7f101c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0d0ff0 con 0x7f101c15f3b0 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0b5730 con 0x7f10040039b0 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.233+0000 7f10217bd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f101c0d1170 con 0x7f101c144720 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51004/0 (socket says 172.21.15.80:51004) 2024-04-16T15:36:42.236 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 -- 172.21.15.80:0/1214392673 learned_addr learned my addr 172.21.15.80:0/1214392673 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101b7fe640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 0x7f101c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101affd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 0x7f101c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 -- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 msgr2=0x7f101c144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 0x7f101c144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 -- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 msgr2=0x7f101c154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 0x7f101c154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 -- 172.21.15.80:0/1214392673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c156900 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101b7fe640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 0x7f101c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101affd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 0x7f101c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f101a7fc640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f101000f850 tx=0x7f101000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101000fe40 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010018070 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101000d6d0 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c156be0 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.234+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c1571a0 con 0x7f101c15f3b0 2024-04-16T15:36:42.237 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.235+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c068a40 con 0x7f101c15f3b0 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.235+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f101000d870 con 0x7f101c15f3b0 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.236+0000 7f10037fe640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 0x7f100806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.236+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f101008be10 con 0x7f101c15f3b0 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.236+0000 7f101affd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 0x7f100806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.236+0000 7f101affd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 0x7f100806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f100c034000 tx=0x7f100c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.240+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1010059db0 con 0x7f101c15f3b0 2024-04-16T15:36:42.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.428+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f101c0d1d10 con 0x7f101c15f3b0 2024-04-16T15:36:42.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.428+0000 7f10037fe640 1 -- 172.21.15.80:0/1214392673 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f10100596b0 con 0x7f101c15f3b0 2024-04-16T15:36:42.427 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 msgr2=0x7f100806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 0x7f100806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f100c034000 tx=0x7f100c02f000 comp rx=0 tx=0).stop 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 msgr2=0x7f101c15f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f101000f850 tx=0x7f101000fd10 comp rx=0 tx=0).stop 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 shutdown_connections 2024-04-16T15:36:42.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f100806c8f0 0x7f100806edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f101c144720 0x7f101c144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f101c15f3b0 0x7f101c15f810 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 --2- 172.21.15.80:0/1214392673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10040039b0 0x7f101c154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.430+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 >> 172.21.15.80:0/1214392673 conn(0x7f101c08c000 msgr2=0x7f101c0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.431+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 shutdown_connections 2024-04-16T15:36:42.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.431+0000 7f10217bd640 1 -- 172.21.15.80:0/1214392673 wait complete. 2024-04-16T15:36:42.440 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:36:42.440 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:42.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:42.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.600+0000 7f2747b52640 1 Processor -- start 2024-04-16T15:36:42.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.600+0000 7f2747b52640 1 -- start start 2024-04-16T15:36:42.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f2747b52640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274015e920 0x7f27400b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f2747b52640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f27400cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f2747b52640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f274015ed00 con 0x7f27400ccf80 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f2747b52640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f274006b9a0 con 0x7f274015e920 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f2747b52640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f274006bbf0 con 0x7f27400b42d0 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274015e920 0x7f27400b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f274015e920 0x7f27400b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51006/0 (socket says 172.21.15.80:51006) 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 -- 172.21.15.80:0/1582116414 learned_addr learned my addr 172.21.15.80:0/1582116414 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27460ef640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f27400cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 -- 172.21.15.80:0/1582116414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 msgr2=0x7f27400cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f27400cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 -- 172.21.15.80:0/1582116414 >> v1:172.21.15.87:6789/0 conn(0x7f27400ccf80 legacy=0x7f27400b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.601+0000 7f27458ee640 1 -- 172.21.15.80:0/1582116414 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274006c960 con 0x7f274015e920 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.602+0000 7f27458ee640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27400b5d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f273c009870 tx=0x7f273c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2059de7d5712774 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.602+0000 7f27448ec640 1 -- 172.21.15.80:0/1582116414 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0317c0 con 0x7f274015e920 2024-04-16T15:36:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.602+0000 7f27448ec640 1 -- 172.21.15.80:0/1582116414 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f273c037070 con 0x7f274015e920 2024-04-16T15:36:42.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.602+0000 7f27448ec640 1 -- 172.21.15.80:0/1582116414 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c031b80 con 0x7f274015e920 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 -- 172.21.15.80:0/1582116414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 msgr2=0x7f27400b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27400b5d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f273c009870 tx=0x7f273c02b860 comp rx=0 tx=0).stop 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 -- 172.21.15.80:0/1582116414 shutdown_connections 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f27400cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 --2- 172.21.15.80:0/1582116414 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27400b5d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 -- 172.21.15.80:0/1582116414 >> 172.21.15.80:0/1582116414 conn(0x7f27400cd610 msgr2=0x7f27400cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 -- 172.21.15.80:0/1582116414 shutdown_connections 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.603+0000 7f2747b52640 1 -- 172.21.15.80:0/1582116414 wait complete. 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.604+0000 7f2747b52640 1 Processor -- start 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.604+0000 7f2747b52640 1 -- start start 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f274014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 0x7f274015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2740070eb0 con 0x7f274015e920 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f274006cf20 con 0x7f27400ccf80 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f27400cf180 con 0x7f27400b42d0 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51022/0 (socket says 172.21.15.80:51022) 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 -- 172.21.15.80:0/2040265547 learned_addr learned my addr 172.21.15.80:0/2040265547 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27458ee640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f274014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27450ed640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 0x7f274015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 -- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 msgr2=0x7f274014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f274014b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 -- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 msgr2=0x7f274015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 0x7f274015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 -- 172.21.15.80:0/2040265547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274015f8c0 con 0x7f274015e920 2024-04-16T15:36:42.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27458ee640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f274014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27450ed640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 0x7f274015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27460ef640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e10 tx=0x7f273800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738014620 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2738019070 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274015fba0 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738014a20 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.605+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2740160160 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.606+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2740068a40 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.607+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2738014bc0 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.607+0000 7f27367fc640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 0x7f272406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.607+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f273808c7d0 con 0x7f274015e920 2024-04-16T15:36:42.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.607+0000 7f27458ee640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 0x7f272406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.608+0000 7f27458ee640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 0x7f272406ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f273c036000 tx=0x7f273c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.612+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f273805a800 con 0x7f274015e920 2024-04-16T15:36:42.787 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.789+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2740074d10 con 0x7f274015e920 2024-04-16T15:36:42.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.790+0000 7f27367fc640 1 -- 172.21.15.80:0/2040265547 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f273805a100 con 0x7f274015e920 2024-04-16T15:36:42.788 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:42.789 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:42.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 msgr2=0x7f272406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 0x7f272406ede0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f273c036000 tx=0x7f273c008030 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 msgr2=0x7f27401610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e10 tx=0x7f273800e4b0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 shutdown_connections 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f274015e920 0x7f27401610d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27400ccf80 0x7f274015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272406c920 0x7f272406ede0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 --2- 172.21.15.80:0/2040265547 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f27400b42d0 0x7f274014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 >> 172.21.15.80:0/2040265547 conn(0x7f27400cd610 msgr2=0x7f27400b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 shutdown_connections 2024-04-16T15:36:42.791 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.792+0000 7f2747b52640 1 -- 172.21.15.80:0/2040265547 wait complete. 2024-04-16T15:36:42.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:42.802 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:42.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.910+0000 7f55ffb7c640 1 Processor -- start 2024-04-16T15:36:42.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.910+0000 7f55ffb7c640 1 -- start start 2024-04-16T15:36:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55ffb7c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55ffb7c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 0x7f55f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55ffb7c640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f80ceea0 con 0x7f55f8145eb0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55ffb7c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55f80cf180 con 0x7f55f80d1ac0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55ffb7c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80cf460 con 0x7f55f815cdc0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fd918640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f55f8145eb0 0x7f55f80d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45714/0 (socket says 172.21.15.80:45714) 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fd918640 1 -- 172.21.15.80:0/1558607804 learned_addr learned my addr 172.21.15.80:0/1558607804 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fd117640 1 --2- 172.21.15.80:0/1558607804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fe119640 1 --2- 172.21.15.80:0/1558607804 >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 0x7f55f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fc916640 1 -- 172.21.15.80:0/1558607804 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3177447138 0 0) 0x7f55f80ceea0 con 0x7f55f8145eb0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.911+0000 7f55fc916640 1 -- 172.21.15.80:0/1558607804 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55e4003520 con 0x7f55f8145eb0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fd117640 1 -- 172.21.15.80:0/1558607804 >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 msgr2=0x7f55f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fd117640 1 --2- 172.21.15.80:0/1558607804 >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 0x7f55f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fd117640 1 -- 172.21.15.80:0/1558607804 >> v1:172.21.15.80:6789/0 conn(0x7f55f8145eb0 legacy=0x7f55f80d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fd117640 1 -- 172.21.15.80:0/1558607804 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f80cf740 con 0x7f55f815cdc0 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fe119640 1 --2- 172.21.15.80:0/1558607804 >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 0x7f55f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:42.911 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.912+0000 7f55fd117640 1 --2- 172.21.15.80:0/1558607804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f80ce870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55e80097a0 tx=0x7f55e802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698ac33e0406de6d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55fc916640 1 -- 172.21.15.80:0/1558607804 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8035020 con 0x7f55f815cdc0 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55fc916640 1 -- 172.21.15.80:0/1558607804 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e8031830 con 0x7f55f815cdc0 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55fc916640 1 -- 172.21.15.80:0/1558607804 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8031be0 con 0x7f55f815cdc0 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 -- 172.21.15.80:0/1558607804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 msgr2=0x7f55f80ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/1558607804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f80ce870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55e80097a0 tx=0x7f55e802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 -- 172.21.15.80:0/1558607804 shutdown_connections 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/1558607804 >> v2:172.21.15.87:3300/0 conn(0x7f55f80d1ac0 0x7f55f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/1558607804 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f80ce870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 -- 172.21.15.80:0/1558607804 >> 172.21.15.80:0/1558607804 conn(0x7f55f80b6ba0 msgr2=0x7f55f809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 -- 172.21.15.80:0/1558607804 shutdown_connections 2024-04-16T15:36:42.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.913+0000 7f55ffb7c640 1 -- 172.21.15.80:0/1558607804 wait complete. 2024-04-16T15:36:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.914+0000 7f55ffb7c640 1 Processor -- start 2024-04-16T15:36:42.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.914+0000 7f55ffb7c640 1 -- start start 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8145eb0 0x7f55f815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8146410 con 0x7f55f80d1ac0 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8146290 con 0x7f55f8145eb0 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55ffb7c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80d1ef0 con 0x7f55f815cdc0 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51034/0 (socket says 172.21.15.80:51034) 2024-04-16T15:36:42.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 -- 172.21.15.80:0/2349871131 learned_addr learned my addr 172.21.15.80:0/2349871131 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fe119640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd117640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8145eb0 0x7f55f815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 -- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 msgr2=0x7f55f815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f815ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 -- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8145eb0 msgr2=0x7f55f815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8145eb0 0x7f55f815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fd918640 1 -- 172.21.15.80:0/2349871131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f815a310 con 0x7f55f80d1ac0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.915+0000 7f55fe119640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55fd918640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55f400cb40 tx=0x7f55f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017070 con 0x7f55f80d1ac0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f400aca0 con 0x7f55f80d1ac0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4012620 con 0x7f55f80d1ac0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f815a5f0 con 0x7f55f80d1ac0 2024-04-16T15:36:42.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.916+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f80b2a50 con 0x7f55f80d1ac0 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.917+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f8068a40 con 0x7f55f80d1ac0 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.917+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55f401a070 con 0x7f55f80d1ac0 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.918+0000 7f55ee7fc640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 0x7f55dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.918+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f55f408bdd0 con 0x7f55f80d1ac0 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.918+0000 7f55fd117640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 0x7f55dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:42.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.918+0000 7f55fd117640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 0x7f55dc06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55e8036000 tx=0x7f55e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:42.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:42.922+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55f4059e00 con 0x7f55f80d1ac0 2024-04-16T15:36:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.095+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f55f80b0200 con 0x7f55f80d1ac0 2024-04-16T15:36:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.096+0000 7f55ee7fc640 1 -- 172.21.15.80:0/2349871131 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f55f408d0a0 con 0x7f55f80d1ac0 2024-04-16T15:36:43.094 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 msgr2=0x7f55dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 0x7f55dc06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55e8036000 tx=0x7f55e8008030 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 msgr2=0x7f55f813c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55f400cb40 tx=0x7f55f400a060 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 shutdown_connections 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55dc06c8f0 0x7f55dc06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55f815cdc0 0x7f55f815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55f8145eb0 0x7f55f815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 --2- 172.21.15.80:0/2349871131 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55f80d1ac0 0x7f55f813c4f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 >> 172.21.15.80:0/2349871131 conn(0x7f55f80b6ba0 msgr2=0x7f55f8070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 shutdown_connections 2024-04-16T15:36:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.098+0000 7f55ffb7c640 1 -- 172.21.15.80:0/2349871131 wait complete. 2024-04-16T15:36:43.109 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:43.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.216+0000 7ff10ec1b640 1 Processor -- start 2024-04-16T15:36:43.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.216+0000 7ff10ec1b640 1 -- start start 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10ec1b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff108160170 0x7ff1081676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10ec1b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1080ce870 con 0x7ff10809b180 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10ec1b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1080ceb50 con 0x7ff10815fd90 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10ec1b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff1080b22b0 con 0x7ff108160170 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10d1b8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff108160170 0x7ff1081676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10d1b8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff108160170 0x7ff1081676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51040/0 (socket says 172.21.15.80:51040) 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff10d1b8640 1 -- 172.21.15.80:0/1660895780 learned_addr learned my addr 172.21.15.80:0/1660895780 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.217+0000 7ff107fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff10809b180 0x7ff1080ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45720/0 (socket says 172.21.15.80:45720) 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.218+0000 7ff10d1b8640 1 -- 172.21.15.80:0/1660895780 >> v1:172.21.15.87:6789/0 conn(0x7ff10815fd90 legacy=0x7ff10809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.218+0000 7ff10d1b8640 1 -- 172.21.15.80:0/1660895780 >> v1:172.21.15.80:6789/0 conn(0x7ff10809b180 legacy=0x7ff1080ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.218+0000 7ff1077fe640 1 -- 172.21.15.80:0/1660895780 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563697256 0 0) 0x7ff1080ce870 con 0x7ff10809b180 2024-04-16T15:36:43.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.218+0000 7ff10d1b8640 1 -- 172.21.15.80:0/1660895780 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1080b1f40 con 0x7ff108160170 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.218+0000 7ff10d1b8640 1 --2- 172.21.15.80:0/1660895780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff108160170 0x7ff1081676a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e50 tx=0x7ff10002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e426dd95d6bc6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff1077fe640 1 -- 172.21.15.80:0/1660895780 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10002cb20 con 0x7ff108160170 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff1077fe640 1 -- 172.21.15.80:0/1660895780 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10002ccc0 con 0x7ff108160170 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff1077fe640 1 -- 172.21.15.80:0/1660895780 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100034610 con 0x7ff108160170 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1660895780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff108160170 msgr2=0x7ff1081676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1660895780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff108160170 0x7ff1081676a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff100009e50 tx=0x7ff10002bf80 comp rx=0 tx=0).stop 2024-04-16T15:36:43.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1660895780 shutdown_connections 2024-04-16T15:36:43.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1660895780 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff108160170 0x7ff1081676a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1660895780 >> 172.21.15.80:0/1660895780 conn(0x7ff1080b4060 msgr2=0x7ff1080b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1660895780 shutdown_connections 2024-04-16T15:36:43.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.219+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1660895780 wait complete. 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.220+0000 7ff10ec1b640 1 Processor -- start 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.220+0000 7ff10ec1b640 1 -- start start 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10815fd90 0x7ff1081f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff108160170 0x7ff1080b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff10809b7a0 con 0x7ff10809b180 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff1080b3a20 con 0x7ff10815fd90 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10ec1b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff10809b920 con 0x7ff108160170 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10c9b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10c9b7640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51050/0 (socket says 172.21.15.80:51050) 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.221+0000 7ff10c9b7640 1 -- 172.21.15.80:0/1385537534 learned_addr learned my addr 172.21.15.80:0/1385537534 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:43.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff107fff640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10815fd90 0x7ff1081f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10d1b8640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff108160170 0x7ff1080b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 -- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff108160170 msgr2=0x7ff1080b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff108160170 0x7ff1080b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 -- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10815fd90 msgr2=0x7ff1081f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10815fd90 0x7ff1081f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 -- 172.21.15.80:0/1385537534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1081f3690 con 0x7ff10809b180 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10c9b7640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c430 tx=0x7ff0f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8011790 con 0x7ff10809b180 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8017070 con 0x7ff10809b180 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1080c63d0 con 0x7ff10809b180 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8011bb0 con 0x7ff10809b180 2024-04-16T15:36:43.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.222+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1080c6990 con 0x7ff10809b180 2024-04-16T15:36:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.223+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff108069150 con 0x7ff10809b180 2024-04-16T15:36:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.224+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0f801c460 con 0x7ff10809b180 2024-04-16T15:36:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.224+0000 7ff1057fa640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 0x7ff0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.224+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff0f808be00 con 0x7ff10809b180 2024-04-16T15:36:43.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.224+0000 7ff107fff640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 0x7ff0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.224+0000 7ff107fff640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 0x7ff0f406edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1080c7500 tx=0x7ff0fc007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.228+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff1081f3690 con 0x7ff10809b180 2024-04-16T15:36:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.401+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1080c7cf0 con 0x7ff10809b180 2024-04-16T15:36:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.401+0000 7ff1057fa640 1 -- 172.21.15.80:0/1385537534 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ff0f8059e30 con 0x7ff10809b180 2024-04-16T15:36:43.400 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 msgr2=0x7ff0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 0x7ff0f406edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1080c7500 tx=0x7ff0fc007c00 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 msgr2=0x7ff10815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800c430 tx=0x7ff0f800c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 shutdown_connections 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f406c8f0 0x7ff0f406edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff108160170 0x7ff1080b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10815fd90 0x7ff1081f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 --2- 172.21.15.80:0/1385537534 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff10809b180 0x7ff10815b9a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 >> 172.21.15.80:0/1385537534 conn(0x7ff1080b4060 msgr2=0x7ff10809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 shutdown_connections 2024-04-16T15:36:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.403+0000 7ff10ec1b640 1 -- 172.21.15.80:0/1385537534 wait complete. 2024-04-16T15:36:43.413 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.520+0000 7fe6e9559640 1 Processor -- start 2024-04-16T15:36:43.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.520+0000 7fe6e9559640 1 -- start start 2024-04-16T15:36:43.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e9559640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6e40b74e0 0x7fe6e40d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e9559640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e40d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e9559640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e40cfd90 con 0x7fe6e4161f20 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e9559640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e40d0050 con 0x7fe6e40b74e0 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e9559640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e40d0330 con 0x7fe6e40d1530 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e27fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe6e40b74e0 0x7fe6e40d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe6e4161f20 0x7fe6e40cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45728/0 (socket says 172.21.15.80:45728) 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e2ffd640 1 -- 172.21.15.80:0/3597209639 learned_addr learned my addr 172.21.15.80:0/3597209639 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e37fe640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e40d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e27fc640 1 -- 172.21.15.80:0/3597209639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 msgr2=0x7fe6e40d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e27fc640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e40d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e27fc640 1 -- 172.21.15.80:0/3597209639 >> v1:172.21.15.80:6789/0 conn(0x7fe6e4161f20 legacy=0x7fe6e40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e1ffb640 1 -- 172.21.15.80:0/3597209639 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186837497 0 0) 0x7fe6e40cfd90 con 0x7fe6e4161f20 2024-04-16T15:36:43.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.521+0000 7fe6e27fc640 1 -- 172.21.15.80:0/3597209639 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e40d0610 con 0x7fe6e40b74e0 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.522+0000 7fe6e27fc640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e40b74e0 0x7fe6e40d0ff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc0caa6816e8a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.522+0000 7fe6e1ffb640 1 -- 172.21.15.80:0/3597209639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8035020 con 0x7fe6e40b74e0 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.522+0000 7fe6e1ffb640 1 -- 172.21.15.80:0/3597209639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8031830 con 0x7fe6e40b74e0 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.522+0000 7fe6e1ffb640 1 -- 172.21.15.80:0/3597209639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8031c00 con 0x7fe6e40b74e0 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 -- 172.21.15.80:0/3597209639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e40b74e0 msgr2=0x7fe6e40d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e40b74e0 0x7fe6e40d0ff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80097a0 tx=0x7fe6d802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 -- 172.21.15.80:0/3597209639 shutdown_connections 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e40d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 --2- 172.21.15.80:0/3597209639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e40b74e0 0x7fe6e40d0ff0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 -- 172.21.15.80:0/3597209639 >> 172.21.15.80:0/3597209639 conn(0x7fe6e408c000 msgr2=0x7fe6e40d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 -- 172.21.15.80:0/3597209639 shutdown_connections 2024-04-16T15:36:43.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.523+0000 7fe6e9559640 1 -- 172.21.15.80:0/3597209639 wait complete. 2024-04-16T15:36:43.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.524+0000 7fe6e9559640 1 Processor -- start 2024-04-16T15:36:43.524 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.524+0000 7fe6e9559640 1 -- start start 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 0x7fe6e415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e40cf940 con 0x7fe6e4161f20 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e40b5730 con 0x7fe6e40b74e0 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e9559640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e40cfac0 con 0x7fe6e40d1530 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e37fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51068/0 (socket says 172.21.15.80:51068) 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e37fe640 1 -- 172.21.15.80:0/4226281366 learned_addr learned my addr 172.21.15.80:0/4226281366 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e27fc640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.525+0000 7fe6e2ffd640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 0x7fe6e415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 -- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 msgr2=0x7fe6e415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.525 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 -- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 msgr2=0x7fe6e415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 0x7fe6e415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 -- 172.21.15.80:0/4226281366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e40c8360 con 0x7fe6e4161f20 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e2ffd640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 0x7fe6e415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e27fc640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e37fe640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007e60 tx=0x7fe6dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc014420 con 0x7fe6e4161f20 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc019070 con 0x7fe6e4161f20 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e40c8640 con 0x7fe6e4161f20 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc014820 con 0x7fe6e4161f20 2024-04-16T15:36:43.526 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.526+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e40c8c00 con 0x7fe6e4161f20 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.527+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e4068a40 con 0x7fe6e4161f20 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.527+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6dc0149c0 con 0x7fe6e4161f20 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.528+0000 7fe6cb7fe640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.528+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe6dc08c740 con 0x7fe6e4161f20 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.528+0000 7fe6e2ffd640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.527 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.528+0000 7fe6e2ffd640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 0x7fe6d006edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4000f60 tx=0x7fe6d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.532+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6dc05a800 con 0x7fe6e4161f20 2024-04-16T15:36:43.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.707+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6e40d1080 con 0x7fe6e4161f20 2024-04-16T15:36:43.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.707+0000 7fe6cb7fe640 1 -- 172.21.15.80:0/4226281366 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fe6dc05a100 con 0x7fe6e4161f20 2024-04-16T15:36:43.705 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:43.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 msgr2=0x7fe6d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 0x7fe6d006edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4000f60 tx=0x7fe6d4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 msgr2=0x7fe6e41e72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007e60 tx=0x7fe6dc00e4b0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 shutdown_connections 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6e4161f20 0x7fe6e41e72b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6e40d1530 0x7fe6e415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 --2- 172.21.15.80:0/4226281366 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40b74e0 0x7fe6e415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 >> 172.21.15.80:0/4226281366 conn(0x7fe6e408c000 msgr2=0x7fe6e406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 shutdown_connections 2024-04-16T15:36:43.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.709+0000 7fe6e9559640 1 -- 172.21.15.80:0/4226281366 wait complete. 2024-04-16T15:36:43.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:43.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.825+0000 7fef3587e640 1 Processor -- start 2024-04-16T15:36:43.824 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.825+0000 7fef3587e640 1 -- start start 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef3587e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef3015fd90 0x7fef3009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef3587e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef30160170 0x7fef3009afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef3587e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef300ce870 con 0x7fef3009b7a0 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef3587e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fef300b22b0 con 0x7fef3015fd90 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef3587e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fef300ceb50 con 0x7fef30160170 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef2effd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fef3015fd90 0x7fef3009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef2f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fef3009b7a0 0x7fef300b2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45732/0 (socket says 172.21.15.80:45732) 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.826+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2486198802 learned_addr learned my addr 172.21.15.80:0/2486198802 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2e7fc640 1 --2- 172.21.15.80:0/2486198802 >> v2:172.21.15.87:3300/0 conn(0x7fef30160170 0x7fef3009afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2effd640 1 -- 172.21.15.80:0/2486198802 >> v2:172.21.15.87:3300/0 conn(0x7fef30160170 msgr2=0x7fef3009afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:43.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2effd640 1 --2- 172.21.15.80:0/2486198802 >> v2:172.21.15.87:3300/0 conn(0x7fef30160170 0x7fef3009afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2effd640 1 -- 172.21.15.80:0/2486198802 >> v1:172.21.15.80:6789/0 conn(0x7fef3009b7a0 legacy=0x7fef300b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2effd640 1 -- 172.21.15.80:0/2486198802 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300b1f40 con 0x7fef3015fd90 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2dffb640 1 -- 172.21.15.80:0/2486198802 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010525969 0 0) 0x7fef300ce870 con 0x7fef3009b7a0 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.827+0000 7fef2effd640 1 --2- 172.21.15.80:0/2486198802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3015fd90 0x7fef3009aa70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef300c5bf0 tx=0x7fef2002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b1557a3200c819 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef2dffb640 1 -- 172.21.15.80:0/2486198802 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20039070 con 0x7fef3015fd90 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef2dffb640 1 -- 172.21.15.80:0/2486198802 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2002cbf0 con 0x7fef3015fd90 2024-04-16T15:36:43.827 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef2dffb640 1 -- 172.21.15.80:0/2486198802 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20034440 con 0x7fef3015fd90 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 -- 172.21.15.80:0/2486198802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3015fd90 msgr2=0x7fef3009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 --2- 172.21.15.80:0/2486198802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3015fd90 0x7fef3009aa70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef300c5bf0 tx=0x7fef2002be40 comp rx=0 tx=0).stop 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 -- 172.21.15.80:0/2486198802 shutdown_connections 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 --2- 172.21.15.80:0/2486198802 >> v2:172.21.15.87:3300/0 conn(0x7fef30160170 0x7fef3009afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 --2- 172.21.15.80:0/2486198802 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef3015fd90 0x7fef3009aa70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 -- 172.21.15.80:0/2486198802 >> 172.21.15.80:0/2486198802 conn(0x7fef300b4060 msgr2=0x7fef300b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 -- 172.21.15.80:0/2486198802 shutdown_connections 2024-04-16T15:36:43.830 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.828+0000 7fef3587e640 1 -- 172.21.15.80:0/2486198802 wait complete. 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.829+0000 7fef3587e640 1 Processor -- start 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 -- start start 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3009b7a0 0x7fef3015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef3015fd90 0x7fef300ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fef300ce330 con 0x7fef30160170 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fef300ce1b0 con 0x7fef3009b7a0 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef3587e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fef300ce4b0 con 0x7fef3015fd90 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef2f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef2f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51078/0 (socket says 172.21.15.80:51078) 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2727438232 learned_addr learned my addr 172.21.15.80:0/2727438232 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.830+0000 7fef2effd640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3009b7a0 0x7fef3015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2e7fc640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef3015fd90 0x7fef300ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef3015fd90 msgr2=0x7fef300ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.831 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef3015fd90 0x7fef300ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3009b7a0 msgr2=0x7fef3015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3009b7a0 0x7fef3015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 -- 172.21.15.80:0/2727438232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300cb1f0 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef2f7fe640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef2800c440 tx=0x7fef2800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280074e0 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef280047e0 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef300cb4d0 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28004bd0 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.831+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef300cba90 con 0x7fef30160170 2024-04-16T15:36:43.832 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.832+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30069150 con 0x7fef30160170 2024-04-16T15:36:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.832+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef28011070 con 0x7fef30160170 2024-04-16T15:36:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.833+0000 7fef27fff640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 0x7fef1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.833+0000 7fef2effd640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 0x7fef1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.833+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fef2808b940 con 0x7fef30160170 2024-04-16T15:36:43.833 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.834+0000 7fef2effd640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 0x7fef1006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef20036000 tx=0x7fef20030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:43.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:43.838+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef280593b0 con 0x7fef30160170 2024-04-16T15:36:44.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.016+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fef300b3e40 con 0x7fef30160170 2024-04-16T15:36:44.015 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.017+0000 7fef27fff640 1 -- 172.21.15.80:0/2727438232 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fef2805d6b0 con 0x7fef30160170 2024-04-16T15:36:44.015 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.018+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 msgr2=0x7fef1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.018+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 0x7fef1006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef20036000 tx=0x7fef20030000 comp rx=0 tx=0).stop 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.018+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 msgr2=0x7fef300ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.018+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef2800c440 tx=0x7fef2800c900 comp rx=0 tx=0).stop 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 shutdown_connections 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fef30160170 0x7fef300ca590 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fef1006c8f0 0x7fef1006edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fef3015fd90 0x7fef300ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 --2- 172.21.15.80:0/2727438232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef3009b7a0 0x7fef3015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 >> 172.21.15.80:0/2727438232 conn(0x7fef300b4060 msgr2=0x7fef300b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 shutdown_connections 2024-04-16T15:36:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.019+0000 7fef3587e640 1 -- 172.21.15.80:0/2727438232 wait complete. 2024-04-16T15:36:44.028 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.135+0000 7fd46fbc8640 1 Processor -- start 2024-04-16T15:36:44.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.135+0000 7fd46fbc8640 1 -- start start 2024-04-16T15:36:44.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46fbc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4681673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46fbc8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4680d21d0 con 0x7fd468145eb0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46fbc8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4680ceea0 con 0x7fd46815cdc0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46fbc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd4680cf180 con 0x7fd4680ce870 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46d964640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd468145eb0 0x7fd4680d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:45736/0 (socket says 172.21.15.80:45736) 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.136+0000 7fd46d964640 1 -- 172.21.15.80:0/3293395011 learned_addr learned my addr 172.21.15.80:0/3293395011 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46e165640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4681673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681810433 0 0) 0x7fd4680d21d0 con 0x7fd468145eb0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd454003520 con 0x7fd468145eb0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 974356234 0 0) 0x7fd454003520 con 0x7fd468145eb0 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 msgr2=0x7fd4681673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:44.138 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4681673c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 >> v1:172.21.15.87:6789/0 conn(0x7fd46815cdc0 legacy=0x7fd4680d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4680cf460 con 0x7fd468145eb0 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fd464001670 con 0x7fd468145eb0 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 >> v1:172.21.15.80:6789/0 conn(0x7fd468145eb0 legacy=0x7fd4680d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540039e0 0x7fd454003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd454004390 0x7fd454004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4540050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd4680cf180 con 0x7fd4540039e0 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd45400b9c0 con 0x7fd454004390 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd45400bbc0 con 0x7fd4680ce870 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540039e0 0x7fd454003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d163640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd454004390 0x7fd454004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46e165640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4540050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 -- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 msgr2=0x7fd4540050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4680ce870 0x7fd4540050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 -- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd454004390 msgr2=0x7fd454004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd454004390 0x7fd454004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.137+0000 7fd46d964640 1 -- 172.21.15.80:0/3293395011 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd454003520 con 0x7fd4540039e0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.138+0000 7fd46d964640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540039e0 0x7fd454003dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c240 tx=0x7fd454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec444fc94096af96 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.138+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464007d30 con 0x7fd4540039e0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.138+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd464030070 con 0x7fd4540039e0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.138+0000 7fd46c962640 1 -- 172.21.15.80:0/3293395011 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46402cd60 con 0x7fd4540039e0 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 -- 172.21.15.80:0/3293395011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540039e0 msgr2=0x7fd454003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.140 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/3293395011 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd4540039e0 0x7fd454003dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c240 tx=0x7fd454005830 comp rx=0 tx=0).stop 2024-04-16T15:36:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46e165640 1 -- 172.21.15.80:0/3293395011 reap_dead start 2024-04-16T15:36:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 -- 172.21.15.80:0/3293395011 shutdown_connections 2024-04-16T15:36:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 -- 172.21.15.80:0/3293395011 >> 172.21.15.80:0/3293395011 conn(0x7fd4680b6ba0 msgr2=0x7fd46809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 -- 172.21.15.80:0/3293395011 shutdown_connections 2024-04-16T15:36:44.141 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.139+0000 7fd46fbc8640 1 -- 172.21.15.80:0/3293395011 wait complete. 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.140+0000 7fd46fbc8640 1 Processor -- start 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.140+0000 7fd46fbc8640 1 -- start start 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4540039e0 0x7fd46813d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd46809c870 0x7fd46813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd468146290 con 0x7fd468140230 2024-04-16T15:36:44.144 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd4680cfa20 con 0x7fd46809c870 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46fbc8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd468146410 con 0x7fd4540039e0 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51090/0 (socket says 172.21.15.80:51090) 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 -- 172.21.15.80:0/815504156 learned_addr learned my addr 172.21.15.80:0/815504156 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46d964640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4540039e0 0x7fd46813d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46d163640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd46809c870 0x7fd46813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 -- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4540039e0 msgr2=0x7fd46813d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4540039e0 0x7fd46813d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 -- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd46809c870 msgr2=0x7fd46813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd46809c870 0x7fd46813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.145 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 -- 172.21.15.80:0/815504156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46813da70 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd46e165640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd460011c80 tx=0x7fd46000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460015430 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.141+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46001d070 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.142+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46813dd50 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.142+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460015830 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.142+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46813e310 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.143+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46813e510 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.143+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4600159d0 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.143+0000 7fd45e7fc640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 0x7fd44c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.143+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd46008c790 con 0x7fd468140230 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.143+0000 7fd46d964640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 0x7fd44c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.144+0000 7fd46d964640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 0x7fd44c06ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c240 tx=0x7fd464009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.148+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd46813e510 con 0x7fd468140230 2024-04-16T15:36:44.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.335+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd468068a40 con 0x7fd468140230 2024-04-16T15:36:44.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.335+0000 7fd45e7fc640 1 -- 172.21.15.80:0/815504156 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd460010040 con 0x7fd468140230 2024-04-16T15:36:44.334 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 msgr2=0x7fd44c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 0x7fd44c06ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c240 tx=0x7fd464009030 comp rx=0 tx=0).stop 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 msgr2=0x7fd4680b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd460011c80 tx=0x7fd46000f580 comp rx=0 tx=0).stop 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 shutdown_connections 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd468140230 0x7fd4680b51b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd46809c870 0x7fd46813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd44c06c920 0x7fd44c06ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 --2- 172.21.15.80:0/815504156 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd4540039e0 0x7fd46813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 >> 172.21.15.80:0/815504156 conn(0x7fd4680b6ba0 msgr2=0x7fd46806c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 shutdown_connections 2024-04-16T15:36:44.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.337+0000 7fd46fbc8640 1 -- 172.21.15.80:0/815504156 wait complete. 2024-04-16T15:36:44.346 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi080.front.sepia.ceph.com... 2024-04-16T15:36:44.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:44.347 DEBUG:teuthology.orchestra.run.smithi080:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-16T15:36:44.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:44.376 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:36:44.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:44.376 DEBUG:teuthology.orchestra.run.smithi080:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-16T15:36:44.433 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:44.433 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:44.453 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:44.453 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:44.513 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:44.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.618+0000 7f017d1ba640 1 Processor -- start 2024-04-16T15:36:44.617 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.618+0000 7f017d1ba640 1 -- start start 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017d1ba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f017806c0b0 0x7f01780cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017d1ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0178145fb0 0x7f01780cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017d1ba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01780ccd90 con 0x7f0178145a30 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017d1ba640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0178145e10 con 0x7f017806c0b0 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017d1ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f01780b1520 con 0x7f0178145fb0 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f017806c0b0 0x7f01780cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f017806c0b0 0x7f01780cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44748/0 (socket says 172.21.15.80:44748) 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 -- 172.21.15.80:0/1443715963 learned_addr learned my addr 172.21.15.80:0/1443715963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:44.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017759e640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0178145fb0 0x7f01780cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 -- 172.21.15.80:0/1443715963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0178145fb0 msgr2=0x7f01780cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0178145fb0 0x7f01780cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 -- 172.21.15.80:0/1443715963 >> v1:172.21.15.87:6789/0 conn(0x7f0178145a30 legacy=0x7f017806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.619+0000 7f017659c640 1 -- 172.21.15.80:0/1443715963 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01780b1800 con 0x7f017806c0b0 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.620+0000 7f017659c640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f017806c0b0 0x7f01780cd270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac315405047f980 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.620+0000 7f0175d9b640 1 -- 172.21.15.80:0/1443715963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c034070 con 0x7f017806c0b0 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.620+0000 7f0175d9b640 1 -- 172.21.15.80:0/1443715963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c030840 con 0x7f017806c0b0 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.620+0000 7f0175d9b640 1 -- 172.21.15.80:0/1443715963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c030c10 con 0x7f017806c0b0 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 -- 172.21.15.80:0/1443715963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f017806c0b0 msgr2=0x7f01780cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f017806c0b0 0x7f01780cd270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f016c009870 tx=0x7f016c02b980 comp rx=0 tx=0).stop 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 -- 172.21.15.80:0/1443715963 shutdown_connections 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0178145fb0 0x7f01780cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 --2- 172.21.15.80:0/1443715963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f017806c0b0 0x7f01780cd270 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 -- 172.21.15.80:0/1443715963 >> 172.21.15.80:0/1443715963 conn(0x7f017809aa70 msgr2=0x7f01780b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 -- 172.21.15.80:0/1443715963 shutdown_connections 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.621+0000 7f017d1ba640 1 -- 172.21.15.80:0/1443715963 wait complete. 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.622+0000 7f017d1ba640 1 Processor -- start 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.622+0000 7f017d1ba640 1 -- start start 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f017806c0b0 0x7f01780b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0178145a30 0x7f01781e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f01780b2d00 con 0x7f0178145fb0 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f01780b1dc0 con 0x7f0178145a30 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017d1ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f01780b2e80 con 0x7f017806c0b0 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017759e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44756/0 (socket says 172.21.15.80:44756) 2024-04-16T15:36:44.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017759e640 1 -- 172.21.15.80:0/2912525892 learned_addr learned my addr 172.21.15.80:0/2912525892 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f0176d9d640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f017806c0b0 0x7f01780b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.623+0000 7f017659c640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0178145a30 0x7f01781e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 -- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f017806c0b0 msgr2=0x7f01780b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f017806c0b0 0x7f01780b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 -- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0178145a30 msgr2=0x7f01781e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0178145a30 0x7f01781e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 -- 172.21.15.80:0/2912525892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01780b3e40 con 0x7f0178145fb0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017759e640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0170007e60 tx=0x7f017000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170014620 con 0x7f0178145fb0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0170019070 con 0x7f0178145fb0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170014a00 con 0x7f0178145fb0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01780b4100 con 0x7f0178145fb0 2024-04-16T15:36:44.625 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.624+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01780b46c0 con 0x7f0178145fb0 2024-04-16T15:36:44.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.625+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0178068a40 con 0x7f0178145fb0 2024-04-16T15:36:44.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.626+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0170014ba0 con 0x7f0178145fb0 2024-04-16T15:36:44.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.626+0000 7f015f7fe640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 0x7f016406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.626+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f017008c710 con 0x7f0178145fb0 2024-04-16T15:36:44.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.626+0000 7f0176d9d640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 0x7f016406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.627+0000 7f0176d9d640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 0x7f016406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0168000f60 tx=0x7f0168009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.630+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f017005a0f0 con 0x7f0178145fb0 2024-04-16T15:36:44.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.809+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01780ae5b0 con 0x7f0178145fb0 2024-04-16T15:36:44.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.810+0000 7f015f7fe640 1 -- 172.21.15.80:0/2912525892 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f017005e3f0 con 0x7f0178145fb0 2024-04-16T15:36:44.809 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:44.809 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 msgr2=0x7f016406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 0x7f016406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0168000f60 tx=0x7f0168009040 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 msgr2=0x7f017815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0170007e60 tx=0x7f017000e4b0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 shutdown_connections 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0178145fb0 0x7f017815d880 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0178145a30 0x7f01781e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f016406c8f0 0x7f016406edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 --2- 172.21.15.80:0/2912525892 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f017806c0b0 0x7f01780b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 >> 172.21.15.80:0/2912525892 conn(0x7f017809aa70 msgr2=0x7f017806fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 shutdown_connections 2024-04-16T15:36:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.812+0000 7f017d1ba640 1 -- 172.21.15.80:0/2912525892 wait complete. 2024-04-16T15:36:44.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:44.823 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:44.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 Processor -- start 2024-04-16T15:36:44.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 -- start start 2024-04-16T15:36:44.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0d0080 0x7f0bcc0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bcc0ccdc0 con 0x7f0bcc0ce710 2024-04-16T15:36:44.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0bcc0cd380 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.931+0000 7f0bd2904640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0bcc0cd0a0 con 0x7f0bcc0d0080 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0d0080 0x7f0bcc0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:42606/0 (socket says 172.21.15.80:42606) 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 -- 172.21.15.80:0/2989606234 learned_addr learned my addr 172.21.15.80:0/2989606234 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bd0ea1640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0bcc0ce710 0x7f0bcc0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44246/0 (socket says 172.21.15.80:44246) 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 -- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0d0080 msgr2=0x7f0bcc0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 --2- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0d0080 0x7f0bcc0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 -- 172.21.15.80:0/2989606234 >> v1:172.21.15.87:6789/0 conn(0x7f0bcc0ce710 legacy=0x7f0bcc0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.932+0000 7f0bcbfff640 1 -- 172.21.15.80:0/2989606234 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc0b0f20 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bcbfff640 1 --2- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009870 tx=0x7f0bbc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8de1909172905f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bcaffd640 1 -- 172.21.15.80:0/2989606234 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc035020 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bcaffd640 1 -- 172.21.15.80:0/2989606234 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bbc031640 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bcaffd640 1 -- 172.21.15.80:0/2989606234 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc02d040 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bd2904640 1 -- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 msgr2=0x7f0bcc0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.933+0000 7f0bd2904640 1 --2- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009870 tx=0x7f0bbc02b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 -- 172.21.15.80:0/2989606234 shutdown_connections 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 --2- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0d0080 0x7f0bcc0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 --2- 172.21.15.80:0/2989606234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0cdc90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 -- 172.21.15.80:0/2989606234 >> 172.21.15.80:0/2989606234 conn(0x7f0bcc0b2fa0 msgr2=0x7f0bcc0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 -- 172.21.15.80:0/2989606234 shutdown_connections 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.934+0000 7f0bd2904640 1 -- 172.21.15.80:0/2989606234 wait complete. 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.935+0000 7f0bd2904640 1 Processor -- start 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.935+0000 7f0bd2904640 1 -- start start 2024-04-16T15:36:44.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0ce710 0x7f0bcc0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0cc9e0 con 0x7f0bcc0d0080 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc15bb90 con 0x7f0bcc15b7b0 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0bcc0ccb60 con 0x7f0bcc0ce710 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44760/0 (socket says 172.21.15.80:44760) 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 -- 172.21.15.80:0/1263074178 learned_addr learned my addr 172.21.15.80:0/1263074178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcbfff640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0ce710 0x7f0bcc0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd0ea1640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 -- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0ce710 msgr2=0x7f0bcc0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0ce710 0x7f0bcc0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 -- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 msgr2=0x7f0bcc0d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0d1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 -- 172.21.15.80:0/1263074178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc0b4d30 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd0ea1640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bcb7fe640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e9b0 tx=0x7f0bc000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0017070 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc000c9a0 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000cd90 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc0b5010 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.936+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc0c5490 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.937+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bcc069150 con 0x7f0bcc0d0080 2024-04-16T15:36:44.939 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.938+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bc001a070 con 0x7f0bcc0d0080 2024-04-16T15:36:44.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.938+0000 7f0bc8ff9640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 0x7f0bb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:44.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.938+0000 7f0bcbfff640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 0x7f0bb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:44.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.939+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0bc008bea0 con 0x7f0bcc0d0080 2024-04-16T15:36:44.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.939+0000 7f0bcbfff640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 0x7f0bb806ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc036000 tx=0x7f0bbc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:44.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:44.943+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bc0059880 con 0x7f0bcc0d0080 2024-04-16T15:36:45.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.119+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0bcc0cc380 con 0x7f0bcc0d0080 2024-04-16T15:36:45.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.120+0000 7f0bc8ff9640 1 -- 172.21.15.80:0/1263074178 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f0bc005db80 con 0x7f0bcc0d0080 2024-04-16T15:36:45.118 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:45.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 msgr2=0x7f0bb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 0x7f0bb806ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc036000 tx=0x7f0bbc03c040 comp rx=0 tx=0).stop 2024-04-16T15:36:45.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 msgr2=0x7f0bcc0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e9b0 tx=0x7f0bc000ee70 comp rx=0 tx=0).stop 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 shutdown_connections 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0bcc15b7b0 0x7f0bcc0d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0bcc0d0080 0x7f0bcc0d1320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0bb806c920 0x7f0bb806ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 --2- 172.21.15.80:0/1263074178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0bcc0ce710 0x7f0bcc0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 >> 172.21.15.80:0/1263074178 conn(0x7f0bcc0b2fa0 msgr2=0x7f0bcc0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 shutdown_connections 2024-04-16T15:36:45.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.122+0000 7f0bd2904640 1 -- 172.21.15.80:0/1263074178 wait complete. 2024-04-16T15:36:45.131 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 Processor -- start 2024-04-16T15:36:45.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 -- start start 2024-04-16T15:36:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c0cba80 0x7f8a4c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.239 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a4c0d0dd0 0x7f8a4c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c06c5c0 con 0x7f8a4c15eaa0 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4c0cdae0 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.240+0000 7f8a51688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c06ba40 con 0x7f8a4c0cba80 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f8a4c0d0dd0 0x7f8a4c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4affd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8a4c15eaa0 0x7f8a4c0d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50576/0 (socket says 172.21.15.80:50576) 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4affd640 1 -- 172.21.15.80:0/1723234165 learned_addr learned my addr 172.21.15.80:0/1723234165 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a43fff640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c0cba80 0x7f8a4c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4b7fe640 1 -- 172.21.15.80:0/1723234165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c0cba80 msgr2=0x7f8a4c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4b7fe640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c0cba80 0x7f8a4c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4b7fe640 1 -- 172.21.15.80:0/1723234165 >> v1:172.21.15.80:6789/0 conn(0x7f8a4c15eaa0 legacy=0x7f8a4c0d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4a7fc640 1 -- 172.21.15.80:0/1723234165 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44188632 0 0) 0x7f8a4c06c5c0 con 0x7f8a4c15eaa0 2024-04-16T15:36:45.240 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.241+0000 7f8a4b7fe640 1 -- 172.21.15.80:0/1723234165 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c06bd20 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a4b7fe640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c0cd5a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8f3d984defa630 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a4a7fc640 1 -- 172.21.15.80:0/1723234165 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44039070 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a4a7fc640 1 -- 172.21.15.80:0/1723234165 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4402cbc0 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a4a7fc640 1 -- 172.21.15.80:0/1723234165 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44034440 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 -- 172.21.15.80:0/1723234165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 msgr2=0x7f8a4c0cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c0cd5a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4402be10 comp rx=0 tx=0).stop 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 -- 172.21.15.80:0/1723234165 shutdown_connections 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c0cd5a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 --2- 172.21.15.80:0/1723234165 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c0cba80 0x7f8a4c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 -- 172.21.15.80:0/1723234165 >> 172.21.15.80:0/1723234165 conn(0x7f8a4c0b2fa0 msgr2=0x7f8a4c0b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 -- 172.21.15.80:0/1723234165 shutdown_connections 2024-04-16T15:36:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.242+0000 7f8a51688640 1 -- 172.21.15.80:0/1723234165 wait complete. 2024-04-16T15:36:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 Processor -- start 2024-04-16T15:36:45.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 -- start start 2024-04-16T15:36:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 0x7f8a4c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c15eaa0 0x7f8a4c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c15ee80 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c06c2e0 con 0x7f8a4c0cba80 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a51688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0b0f20 con 0x7f8a4c15eaa0 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44772/0 (socket says 172.21.15.80:44772) 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.244+0000 7f8a43fff640 1 -- 172.21.15.80:0/1094803543 learned_addr learned my addr 172.21.15.80:0/1094803543 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a4b7fe640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c15eaa0 0x7f8a4c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a4affd640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 0x7f8a4c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 -- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c15eaa0 msgr2=0x7f8a4c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c15eaa0 0x7f8a4c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 -- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 msgr2=0x7f8a4c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 0x7f8a4c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 -- 172.21.15.80:0/1094803543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0c8c70 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a4affd640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 0x7f8a4c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a43fff640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d800 tx=0x7f8a3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400b6c0 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34019070 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0c8f50 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400ba80 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.245+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c0c9510 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.246+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c069150 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.246+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a3400bc20 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.247+0000 7f8a437fe640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.247+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8a3408c370 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.247+0000 7f8a4affd640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.247+0000 7f8a4affd640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000f60 tx=0x7f8a3c007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.251+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a3405a3a0 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.425+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8a4c0b0690 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.425+0000 7f8a437fe640 1 -- 172.21.15.80:0/1094803543 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f8a34059ca0 con 0x7f8a4c0d0dd0 2024-04-16T15:36:45.424 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:45.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 msgr2=0x7f8a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000f60 tx=0x7f8a3c007ca0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 msgr2=0x7f8a4c14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d800 tx=0x7f8a3400dcc0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 shutdown_connections 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a4c15eaa0 0x7f8a4c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a4c0d0dd0 0x7f8a4c14d9b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 --2- 172.21.15.80:0/1094803543 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a4c0cba80 0x7f8a4c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 >> 172.21.15.80:0/1094803543 conn(0x7f8a4c0b2fa0 msgr2=0x7f8a4c0ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 shutdown_connections 2024-04-16T15:36:45.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.427+0000 7f8a51688640 1 -- 172.21.15.80:0/1094803543 wait complete. 2024-04-16T15:36:45.438 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:45.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.546+0000 7fe67ce35640 1 Processor -- start 2024-04-16T15:36:45.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.546+0000 7fe67ce35640 1 -- start start 2024-04-16T15:36:45.548 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe67ce35640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe67815fd90 0x7fe67809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe67ce35640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780ce870 con 0x7fe678160170 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe67ce35640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6780ceb50 con 0x7fe67809b7a0 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe67ce35640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe6780b22b0 con 0x7fe67815fd90 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe675d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe678160170 0x7fe6780b2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50586/0 (socket says 172.21.15.80:50586) 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.547+0000 7fe675d9b640 1 -- 172.21.15.80:0/309658158 learned_addr learned my addr 172.21.15.80:0/309658158 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67659c640 1 --2- 172.21.15.80:0/309658158 >> v2:172.21.15.87:3300/0 conn(0x7fe67815fd90 0x7fe67809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996345575 0 0) 0x7fe6780ce870 con 0x7fe678160170 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe660003520 con 0x7fe678160170 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2404081296 0 0) 0x7fe660003520 con 0x7fe678160170 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 >> v2:172.21.15.87:3300/0 conn(0x7fe67815fd90 msgr2=0x7fe67809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 --2- 172.21.15.80:0/309658158 >> v2:172.21.15.87:3300/0 conn(0x7fe67815fd90 0x7fe67809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 >> v1:172.21.15.87:6789/0 conn(0x7fe67809b7a0 legacy=0x7fe6780cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780b1f40 con 0x7fe678160170 2024-04-16T15:36:45.549 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fe66c001670 con 0x7fe678160170 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 >> v1:172.21.15.80:6789/0 conn(0x7fe678160170 legacy=0x7fe6780b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6600039b0 0x7fe660003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe660004800 0x7fe660004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe66000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe6780b22b0 con 0x7fe6600051c0 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe66000c160 con 0x7fe660004800 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe66000c360 con 0x7fe6600039b0 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe66000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe67659c640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6600039b0 0x7fe660003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe675d9b640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe660004800 0x7fe660004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 -- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6600039b0 msgr2=0x7fe660003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6600039b0 0x7fe660003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 -- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe660004800 msgr2=0x7fe660004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe660004800 0x7fe660004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.548+0000 7fe676d9d640 1 -- 172.21.15.80:0/309658158 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe660003520 con 0x7fe6600051c0 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.549+0000 7fe676d9d640 1 -- 172.21.15.80:0/309658158 reap_dead start 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.549+0000 7fe676d9d640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe66000b9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe670001750 tx=0x7fe660005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b257d99f81c44abb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.549+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670001370 con 0x7fe6600051c0 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.549+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe670005310 con 0x7fe6600051c0 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.549+0000 7fe67559a640 1 -- 172.21.15.80:0/309658158 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670003830 con 0x7fe6600051c0 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 -- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 msgr2=0x7fe66000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe66000b9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe670001750 tx=0x7fe660005830 comp rx=0 tx=0).stop 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 -- 172.21.15.80:0/309658158 shutdown_connections 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 --2- 172.21.15.80:0/309658158 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe66000b9c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 -- 172.21.15.80:0/309658158 >> 172.21.15.80:0/309658158 conn(0x7fe6780b4060 msgr2=0x7fe6780b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 -- 172.21.15.80:0/309658158 shutdown_connections 2024-04-16T15:36:45.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.550+0000 7fe67ce35640 1 -- 172.21.15.80:0/309658158 wait complete. 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.551+0000 7fe67ce35640 1 Processor -- start 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.551+0000 7fe67ce35640 1 -- start start 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe67814d340 0x7fe6780c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 0x7fe6780cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe67809ae00 con 0x7fe6600051c0 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe67809ac80 con 0x7fe67814d340 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67ce35640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe67809af80 con 0x7fe6780c9b80 2024-04-16T15:36:45.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44790/0 (socket says 172.21.15.80:44790) 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 -- 172.21.15.80:0/974585893 learned_addr learned my addr 172.21.15.80:0/974585893 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe675d9b640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe67814d340 0x7fe6780c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe676d9d640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 0x7fe6780cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 -- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 msgr2=0x7fe6780cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 0x7fe6780cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 -- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe67814d340 msgr2=0x7fe6780c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe67814d340 0x7fe6780c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe67659c640 1 -- 172.21.15.80:0/974585893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780cc5b0 con 0x7fe6600051c0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.552+0000 7fe676d9d640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 0x7fe6780cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe67659c640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe668009f90 tx=0x7fe66800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800fea0 con 0x7fe6600051c0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe668015630 con 0x7fe6600051c0 2024-04-16T15:36:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67815b720 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668015a20 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.553+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67815bce0 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.554+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678069150 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.554+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe668015bc0 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.555+0000 7fe666ffd640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 0x7fe65806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.555+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe66808d010 con 0x7fe6600051c0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.555+0000 7fe675d9b640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 0x7fe65806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.555+0000 7fe675d9b640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 0x7fe65806ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe67806ebf0 tx=0x7fe66c000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.559+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe668019030 con 0x7fe6600051c0 2024-04-16T15:36:45.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.735+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6780c9f60 con 0x7fe6600051c0 2024-04-16T15:36:45.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.735+0000 7fe666ffd640 1 -- 172.21.15.80:0/974585893 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fe668010040 con 0x7fe6600051c0 2024-04-16T15:36:45.734 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 msgr2=0x7fe65806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 0x7fe65806ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe67806ebf0 tx=0x7fe66c000ed0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 msgr2=0x7fe67814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe668009f90 tx=0x7fe66800f580 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 shutdown_connections 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe65806c920 0x7fe65806ede0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe6780c9b80 0x7fe6780cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe67814d340 0x7fe6780c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 --2- 172.21.15.80:0/974585893 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe6600051c0 0x7fe67814db50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 >> 172.21.15.80:0/974585893 conn(0x7fe6780b4060 msgr2=0x7fe6780b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 shutdown_connections 2024-04-16T15:36:45.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.737+0000 7fe67ce35640 1 -- 172.21.15.80:0/974585893 wait complete. 2024-04-16T15:36:45.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:45.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.854+0000 7fab19c37640 1 Processor -- start 2024-04-16T15:36:45.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.854+0000 7fab19c37640 1 -- start start 2024-04-16T15:36:45.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab19c37640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab140ccdb0 0x7fab140cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab19c37640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1406bad0 con 0x7fab140cf8e0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab19c37640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1406bdb0 con 0x7fab140d03d0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab19c37640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fab1406c090 con 0x7fab140ccdb0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab137fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fab140cf8e0 0x7fab140cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50592/0 (socket says 172.21.15.80:50592) 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab137fe640 1 -- 172.21.15.80:0/1990475264 learned_addr learned my addr 172.21.15.80:0/1990475264 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1990475264 >> v2:172.21.15.87:3300/0 conn(0x7fab140ccdb0 0x7fab140cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090537200 0 0) 0x7fab1406bad0 con 0x7fab140cf8e0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab00003520 con 0x7fab140cf8e0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 201440433 0 0) 0x7fab00003520 con 0x7fab140cf8e0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 >> v2:172.21.15.87:3300/0 conn(0x7fab140ccdb0 msgr2=0x7fab140cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 --2- 172.21.15.80:0/1990475264 >> v2:172.21.15.87:3300/0 conn(0x7fab140ccdb0 0x7fab140cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 >> v1:172.21.15.87:6789/0 conn(0x7fab140d03d0 legacy=0x7fab1406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1406c370 con 0x7fab140cf8e0 2024-04-16T15:36:45.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fab04001670 con 0x7fab140cf8e0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 >> v1:172.21.15.80:6789/0 conn(0x7fab140cf8e0 legacy=0x7fab140cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.855+0000 7fab12ffd640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab000039b0 0x7fab00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab12ffd640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab12ffd640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab000051c0 0x7fab0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fab1406c090 con 0x7fab00004800 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab0000c110 con 0x7fab000051c0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fab0000c310 con 0x7fab000039b0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab137fe640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab000039b0 0x7fab00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab13fff640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab000051c0 0x7fab0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 -- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab000039b0 msgr2=0x7fab00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab000039b0 0x7fab00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 -- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab000051c0 msgr2=0x7fab0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:45.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab000051c0 0x7fab0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab0bfff640 1 -- 172.21.15.80:0/1990475264 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab00003520 con 0x7fab00004800 2024-04-16T15:36:45.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.856+0000 7fab13fff640 1 -- 172.21.15.80:0/1990475264 reap_dead start 2024-04-16T15:36:45.860 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 0x7fab00004c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faafc009360 tx=0x7fab00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b972ee4ceb2d14ac server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc040070 con 0x7fab00004800 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc03b400 con 0x7fab00004800 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab12ffd640 1 -- 172.21.15.80:0/1990475264 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc009690 con 0x7fab00004800 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab19c37640 1 -- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 msgr2=0x7fab00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.857+0000 7fab19c37640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 0x7fab00004c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faafc009360 tx=0x7fab00005830 comp rx=0 tx=0).stop 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.858+0000 7fab19c37640 1 -- 172.21.15.80:0/1990475264 shutdown_connections 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.858+0000 7fab19c37640 1 --2- 172.21.15.80:0/1990475264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab00004800 0x7fab00004c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.904 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.858+0000 7fab19c37640 1 -- 172.21.15.80:0/1990475264 >> 172.21.15.80:0/1990475264 conn(0x7fab140d0c30 msgr2=0x7fab140d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.858+0000 7fab19c37640 1 -- 172.21.15.80:0/1990475264 shutdown_connections 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.858+0000 7fab19c37640 1 -- 172.21.15.80:0/1990475264 wait complete. 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.859+0000 7fab19c37640 1 Processor -- start 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.859+0000 7fab19c37640 1 -- start start 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.859+0000 7fab19c37640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab00004800 0x7fab14151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.859+0000 7fab19c37640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab1415b2d0 0x7fab1415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fab140b00f0 con 0x7fab14149990 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fab140ce2b0 con 0x7fab00004800 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fab1414a510 con 0x7fab1415b2d0 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44806/0 (socket says 172.21.15.80:44806) 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 -- 172.21.15.80:0/1737674079 learned_addr learned my addr 172.21.15.80:0/1737674079 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab137fe640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab00004800 0x7fab14151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.905 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 -- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab1415b2d0 msgr2=0x7fab1415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab1415b2d0 0x7fab1415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 -- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab00004800 msgr2=0x7fab14151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab00004800 0x7fab14151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 -- 172.21.15.80:0/1737674079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1415bfa0 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab0bfff640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faafc03e040 tx=0x7faafc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc040040 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc004030 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab14150950 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc004420 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.860+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1415bc90 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.861+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab14068a40 con 0x7fab14149990 2024-04-16T15:36:45.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.862+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faafc003610 con 0x7fab14149990 2024-04-16T15:36:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.862+0000 7fab10ff9640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.862+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faafc0b6e20 con 0x7fab14149990 2024-04-16T15:36:45.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.862+0000 7fab137fe640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:45.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.863+0000 7fab137fe640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 0x7faaf406ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab04001650 tx=0x7fab04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:45.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:45.866+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faafc084ee0 con 0x7fab14149990 2024-04-16T15:36:46.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.044+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fab14150e70 con 0x7fab14149990 2024-04-16T15:36:46.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.044+0000 7fab10ff9640 1 -- 172.21.15.80:0/1737674079 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7faafc0847e0 con 0x7fab14149990 2024-04-16T15:36:46.043 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 msgr2=0x7faaf406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 0x7faaf406ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab04001650 tx=0x7fab04009040 comp rx=0 tx=0).stop 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 msgr2=0x7fab14141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faafc03e040 tx=0x7faafc004730 comp rx=0 tx=0).stop 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 shutdown_connections 2024-04-16T15:36:46.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faaf406c920 0x7faaf406ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fab1415b2d0 0x7fab1415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fab14149990 0x7fab14141970 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 --2- 172.21.15.80:0/1737674079 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab00004800 0x7fab14151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.046+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 >> 172.21.15.80:0/1737674079 conn(0x7fab140d0c30 msgr2=0x7fab1406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.047+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 shutdown_connections 2024-04-16T15:36:46.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.047+0000 7fab19c37640 1 -- 172.21.15.80:0/1737674079 wait complete. 2024-04-16T15:36:46.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.162+0000 7fb5f6fd4640 1 Processor -- start 2024-04-16T15:36:46.160 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.162+0000 7fb5f6fd4640 1 -- start start 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f6fd4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5f00724e0 0x7fb5f0167580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f6fd4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f0161120 con 0x7fb5f015ccf0 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f6fd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f0160b60 con 0x7fb5f0145ea0 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f6fd4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f0160900 con 0x7fb5f00724e0 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f5571640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb5f00724e0 0x7fb5f0167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5effff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb5f015ccf0 0x7fb5f0071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50594/0 (socket says 172.21.15.80:50594) 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5effff640 1 -- 172.21.15.80:0/1268452214 learned_addr learned my addr 172.21.15.80:0/1268452214 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f5571640 1 -- 172.21.15.80:0/1268452214 >> v1:172.21.15.87:6789/0 conn(0x7fb5f0145ea0 legacy=0x7fb5f01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f5571640 1 -- 172.21.15.80:0/1268452214 >> v1:172.21.15.80:6789/0 conn(0x7fb5f015ccf0 legacy=0x7fb5f0071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.163+0000 7fb5f5571640 1 -- 172.21.15.80:0/1268452214 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f0160e40 con 0x7fb5f00724e0 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5f5571640 1 --2- 172.21.15.80:0/1268452214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f0167580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009d90 tx=0x7fb5e802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144496c574fafc08 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/1268452214 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8039070 con 0x7fb5f00724e0 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/1268452214 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e802cbd0 con 0x7fb5f00724e0 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5ef7fe640 1 -- 172.21.15.80:0/1268452214 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8034440 con 0x7fb5f00724e0 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/1268452214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 msgr2=0x7fb5f0167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/1268452214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f0167580 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009d90 tx=0x7fb5e802be20 comp rx=0 tx=0).stop 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/1268452214 shutdown_connections 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.164+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/1268452214 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f0167580 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.165+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/1268452214 >> 172.21.15.80:0/1268452214 conn(0x7fb5f0067d90 msgr2=0x7fb5f006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.165+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/1268452214 shutdown_connections 2024-04-16T15:36:46.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.165+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/1268452214 wait complete. 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.166+0000 7fb5f6fd4640 1 Processor -- start 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.166+0000 7fb5f6fd4640 1 -- start start 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f0145ea0 0x7fb5f00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f015ccf0 0x7fb5f00ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f015f670 con 0x7fb5f00724e0 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0146280 con 0x7fb5f015ccf0 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f015f7f0 con 0x7fb5f0145ea0 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44834/0 (socket says 172.21.15.80:44834) 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 -- 172.21.15.80:0/2775450850 learned_addr learned my addr 172.21.15.80:0/2775450850 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:46.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 -- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f0145ea0 msgr2=0x7fb5f00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f0145ea0 0x7fb5f00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 -- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f015ccf0 msgr2=0x7fb5f00ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f015ccf0 0x7fb5f00ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 -- 172.21.15.80:0/2775450850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f00a9f50 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f4d70640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c430 tx=0x7fb5e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4011790 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e4017070 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f00aa230 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4011bb0 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.167+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f015c2f0 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.168+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f00b0000 con 0x7fb5f00724e0 2024-04-16T15:36:46.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.169+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5e401c460 con 0x7fb5f00724e0 2024-04-16T15:36:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.169+0000 7fb5ed7fa640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 0x7fb5d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.169+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb5e408bd20 con 0x7fb5f00724e0 2024-04-16T15:36:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.169+0000 7fb5effff640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 0x7fb5d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.170+0000 7fb5effff640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 0x7fb5d406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000f60 tx=0x7fb5dc007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.173+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5e4059de0 con 0x7fb5f00724e0 2024-04-16T15:36:46.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.362+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5f0068a40 con 0x7fb5f00724e0 2024-04-16T15:36:46.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.363+0000 7fb5ed7fa640 1 -- 172.21.15.80:0/2775450850 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb5e40596e0 con 0x7fb5f00724e0 2024-04-16T15:36:46.361 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 msgr2=0x7fb5d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 0x7fb5d406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc000f60 tx=0x7fb5dc007a80 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 msgr2=0x7fb5f015bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c430 tx=0x7fb5e400c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 shutdown_connections 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb5f015ccf0 0x7fb5f00ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb5d406c8f0 0x7fb5d406edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb5f0145ea0 0x7fb5f00a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 --2- 172.21.15.80:0/2775450850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb5f00724e0 0x7fb5f015bdb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 >> 172.21.15.80:0/2775450850 conn(0x7fb5f0067d90 msgr2=0x7fb5f00b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 shutdown_connections 2024-04-16T15:36:46.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.365+0000 7fb5f6fd4640 1 -- 172.21.15.80:0/2775450850 wait complete. 2024-04-16T15:36:46.374 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:36:46.375 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:36:46.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.499+0000 7f50fdfca640 1 Processor -- start 2024-04-16T15:36:46.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.499+0000 7f50fdfca640 1 -- start start 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50fdfca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50f815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50fdfca640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f815cc20 con 0x7f50f815c3d0 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50fdfca640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f813eb70 con 0x7f50f815f9f0 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50fdfca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f50f815c940 con 0x7f50f8141b10 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f50f815c3d0 0x7f50f80b5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50600/0 (socket says 172.21.15.80:50600) 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f7fff640 1 -- 172.21.15.80:0/1498505447 learned_addr learned my addr 172.21.15.80:0/1498505447 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484879185 0 0) 0x7f50f815cc20 con 0x7f50f815c3d0 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e0003520 con 0x7f50f815c3d0 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f6ffd640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50f815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1090457316 0 0) 0x7f50e0003520 con 0x7f50f815c3d0 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 msgr2=0x7f50f815fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50f815fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 >> v1:172.21.15.87:6789/0 conn(0x7f50f815f9f0 legacy=0x7f50f815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8141030 con 0x7f50f815c3d0 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.500+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f50f0001670 con 0x7f50f815c3d0 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 >> v1:172.21.15.80:6789/0 conn(0x7f50f815c3d0 legacy=0x7f50f80b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e00039e0 0x7f50e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50f815c940 con 0x7f50e0004d40 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50e000baf0 con 0x7f50e00039e0 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f50e000bcf0 con 0x7f50f8141b10 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f6ffd640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f77fe640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e00039e0 0x7f50e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 -- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 msgr2=0x7f50e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8141b10 0x7f50e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 -- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e00039e0 msgr2=0x7f50e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50e00039e0 0x7f50e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.501+0000 7f50f7fff640 1 -- 172.21.15.80:0/1498505447 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e0003520 con 0x7f50e0004d40 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50f7fff640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50e00051c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c240 tx=0x7f50e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c72d54c7c59330a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0007d10 con 0x7f50e0004d40 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0030070 con 0x7f50e0004d40 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50f67fc640 1 -- 172.21.15.80:0/1498505447 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f002cd80 con 0x7f50e0004d40 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 -- 172.21.15.80:0/1498505447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 msgr2=0x7f50e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1498505447 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50e00051c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f50f000c240 tx=0x7f50e0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:46.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50f7fff640 1 -- 172.21.15.80:0/1498505447 reap_dead start 2024-04-16T15:36:46.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 -- 172.21.15.80:0/1498505447 shutdown_connections 2024-04-16T15:36:46.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 -- 172.21.15.80:0/1498505447 >> 172.21.15.80:0/1498505447 conn(0x7f50f80b2940 msgr2=0x7f50f806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 -- 172.21.15.80:0/1498505447 shutdown_connections 2024-04-16T15:36:46.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.502+0000 7f50fdfca640 1 -- 172.21.15.80:0/1498505447 wait complete. 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 Processor -- start 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 -- start start 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50f80a94d0 0x7f50f80a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8142f10 0x7f50f8143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50f80b6070 con 0x7f50e0004d40 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50f81415f0 con 0x7f50f80a94d0 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.504+0000 7f50fdfca640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f50f80b61f0 con 0x7f50f8142f10 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44862/0 (socket says 172.21.15.80:44862) 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 -- 172.21.15.80:0/1722732939 learned_addr learned my addr 172.21.15.80:0/1722732939 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 -- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8142f10 msgr2=0x7f50f8143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.507 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8142f10 0x7f50f8143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 -- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50f80a94d0 msgr2=0x7f50f80a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50f80a94d0 0x7f50f80a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 -- 172.21.15.80:0/1722732939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8143c90 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50f77fe640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50e800f7a0 tx=0x7f50e800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e80050d0 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e8018070 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e800d730 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f8143f70 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.505+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f8144530 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.506+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f8068a40 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.507+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50e800d8d0 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.507+0000 7f50dffff640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 0x7f50e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.507+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f50e808bd90 con 0x7f50e0004d40 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.507+0000 7f50f6ffd640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 0x7f50e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.508+0000 7f50f6ffd640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 0x7f50e406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50f81424e0 tx=0x7f50ec009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.512+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50e8059dc0 con 0x7f50e0004d40 2024-04-16T15:36:46.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.687+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50f80b5ce0 con 0x7f50e0004d40 2024-04-16T15:36:46.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.689+0000 7f50dffff640 1 -- 172.21.15.80:0/1722732939 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f50e80596c0 con 0x7f50e0004d40 2024-04-16T15:36:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:46.687 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:46.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 msgr2=0x7f50e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 0x7f50e406ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50f81424e0 tx=0x7f50ec009750 comp rx=0 tx=0).stop 2024-04-16T15:36:46.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 msgr2=0x7f50f8155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50e800f7a0 tx=0x7f50e800fc60 comp rx=0 tx=0).stop 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 shutdown_connections 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f50e406c920 0x7f50e406ede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50f8142f10 0x7f50f8143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50f80a94d0 0x7f50f80a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 --2- 172.21.15.80:0/1722732939 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50e0004d40 0x7f50f8155860 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 >> 172.21.15.80:0/1722732939 conn(0x7f50f80b2940 msgr2=0x7f50f80ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 shutdown_connections 2024-04-16T15:36:46.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.691+0000 7f50fdfca640 1 -- 172.21.15.80:0/1722732939 wait complete. 2024-04-16T15:36:46.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:46.701 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:46.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.814+0000 7f8a287af640 1 Processor -- start 2024-04-16T15:36:46.813 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.814+0000 7f8a287af640 1 -- start start 2024-04-16T15:36:46.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.815+0000 7f8a287af640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a200b74e0 0x7f8a200d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.815+0000 7f8a287af640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a200cfd90 con 0x7f8a200d1530 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.815+0000 7f8a287af640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a200d0050 con 0x7f8a20161f20 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.815+0000 7f8a287af640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8a200d1980 con 0x7f8a200b74e0 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a26d4c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8a200d1530 0x7f8a200d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50606/0 (socket says 172.21.15.80:50606) 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a26d4c640 1 -- 172.21.15.80:0/789943603 learned_addr learned my addr 172.21.15.80:0/789943603 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25d4a640 1 --2- 172.21.15.80:0/789943603 >> v2:172.21.15.87:3300/0 conn(0x7f8a200b74e0 0x7f8a200d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854330565 0 0) 0x7f8a200cfd90 con 0x7f8a200d1530 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a0c003520 con 0x7f8a200d1530 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866544889 0 0) 0x7f8a200d0050 con 0x7f8a20161f20 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a200cfd90 con 0x7f8a20161f20 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25d4a640 1 -- 172.21.15.80:0/789943603 >> v1:172.21.15.87:6789/0 conn(0x7f8a20161f20 legacy=0x7f8a200cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25d4a640 1 -- 172.21.15.80:0/789943603 >> v1:172.21.15.80:6789/0 conn(0x7f8a200d1530 legacy=0x7f8a200d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.815 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.816+0000 7f8a25d4a640 1 -- 172.21.15.80:0/789943603 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a200d0330 con 0x7f8a200b74e0 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.817+0000 7f8a25d4a640 1 --2- 172.21.15.80:0/789943603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a200d0ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3733fa218e3b436 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.817+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c034070 con 0x7f8a200b74e0 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.817+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c030610 con 0x7f8a200b74e0 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.817+0000 7f8a25549640 1 -- 172.21.15.80:0/789943603 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0309e0 con 0x7f8a200b74e0 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 -- 172.21.15.80:0/789943603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 msgr2=0x7f8a200d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 --2- 172.21.15.80:0/789943603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a200d0ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b960 comp rx=0 tx=0).stop 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 -- 172.21.15.80:0/789943603 shutdown_connections 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 --2- 172.21.15.80:0/789943603 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a200d0ff0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 -- 172.21.15.80:0/789943603 >> 172.21.15.80:0/789943603 conn(0x7f8a2008c000 msgr2=0x7f8a200d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:46.817 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 -- 172.21.15.80:0/789943603 shutdown_connections 2024-04-16T15:36:46.818 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.818+0000 7f8a287af640 1 -- 172.21.15.80:0/789943603 wait complete. 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.819+0000 7f8a287af640 1 Processor -- start 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.819+0000 7f8a287af640 1 -- start start 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a20153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a20161f20 0x7f8a20160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200b5730 con 0x7f8a200d1530 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20162300 con 0x7f8a200b74e0 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a287af640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200cf940 con 0x7f8a20161f20 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44876/0 (socket says 172.21.15.80:44876) 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 -- 172.21.15.80:0/3946755468 learned_addr learned my addr 172.21.15.80:0/3946755468 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a26d4c640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a20161f20 0x7f8a20160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.820 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a2654b640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a20153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 -- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a20161f20 msgr2=0x7f8a20160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a20161f20 0x7f8a20160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 -- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 msgr2=0x7f8a20153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a20153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.820+0000 7f8a25d4a640 1 -- 172.21.15.80:0/3946755468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2015f180 con 0x7f8a200d1530 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a25d4a640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c02bf70 tx=0x7f8a1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c034040 con 0x7f8a200d1530 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c03aaa0 con 0x7f8a200d1530 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c006e10 con 0x7f8a200d1530 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2015f460 con 0x7f8a200d1530 2024-04-16T15:36:46.821 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.821+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2015fa20 con 0x7f8a200d1530 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.822+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20068a40 con 0x7f8a200d1530 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.822+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a1c04b060 con 0x7f8a200d1530 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.823+0000 7f8a16ffd640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 0x7f8a0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.823+0000 7f8a2654b640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 0x7f8a0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.823+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8a1c0adab0 con 0x7f8a200d1530 2024-04-16T15:36:46.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.824+0000 7f8a2654b640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 0x7f8a0406ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007fd0 tx=0x7f8a10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:46.826 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:46.828+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a1c03f070 con 0x7f8a200d1530 2024-04-16T15:36:46.895 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:36:46.898 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:36:47.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.009+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8a200d1d10 con 0x7f8a200d1530 2024-04-16T15:36:47.007 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.009+0000 7f8a16ffd640 1 -- 172.21.15.80:0/3946755468 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f8a1c07b490 con 0x7f8a200d1530 2024-04-16T15:36:47.008 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 msgr2=0x7f8a0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 0x7f8a0406ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007fd0 tx=0x7f8a10009040 comp rx=0 tx=0).stop 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 msgr2=0x7f8a20160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c02bf70 tx=0x7f8a1c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 shutdown_connections 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8a0406c920 0x7f8a0406ede0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8a20161f20 0x7f8a20160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8a200d1530 0x7f8a20160a10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 --2- 172.21.15.80:0/3946755468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a200b74e0 0x7f8a20153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 >> 172.21.15.80:0/3946755468 conn(0x7f8a2008c000 msgr2=0x7f8a2006cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 shutdown_connections 2024-04-16T15:36:47.011 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.011+0000 7f8a287af640 1 -- 172.21.15.80:0/3946755468 wait complete. 2024-04-16T15:36:47.021 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:47.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.129+0000 7fe513e88640 1 Processor -- start 2024-04-16T15:36:47.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.129+0000 7fe513e88640 1 -- start start 2024-04-16T15:36:47.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe513e88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe513e88640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe50c0afc40 0x7fe50c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe513e88640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c0d14f0 con 0x7fe50c15ea60 2024-04-16T15:36:47.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe513e88640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe50c0b1950 con 0x7fe50c0afc40 2024-04-16T15:36:47.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe513e88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c0d17d0 con 0x7fe50c15ee40 2024-04-16T15:36:47.130 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe50c0afc40 0x7fe50c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe50c0afc40 0x7fe50c0b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44890/0 (socket says 172.21.15.80:44890) 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 -- 172.21.15.80:0/2556450173 learned_addr learned my addr 172.21.15.80:0/2556450173 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe511423640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 -- 172.21.15.80:0/2556450173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 msgr2=0x7fe50c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 -- 172.21.15.80:0/2556450173 >> v1:172.21.15.87:6789/0 conn(0x7fe50c15ea60 legacy=0x7fe50c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.130+0000 7fe512425640 1 -- 172.21.15.80:0/2556450173 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c0af440 con 0x7fe50c0afc40 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe512425640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c0b00f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe504009e50 tx=0x7fe50402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93dcf00eccec89d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe510c22640 1 -- 172.21.15.80:0/2556450173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50402c9e0 con 0x7fe50c0afc40 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe510c22640 1 -- 172.21.15.80:0/2556450173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50402cb80 con 0x7fe50c0afc40 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe510c22640 1 -- 172.21.15.80:0/2556450173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040343f0 con 0x7fe50c0afc40 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe513e88640 1 -- 172.21.15.80:0/2556450173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 msgr2=0x7fe50c0b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.131+0000 7fe513e88640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c0b00f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe504009e50 tx=0x7fe50402be40 comp rx=0 tx=0).stop 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 -- 172.21.15.80:0/2556450173 shutdown_connections 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c0b00f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 --2- 172.21.15.80:0/2556450173 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 -- 172.21.15.80:0/2556450173 >> 172.21.15.80:0/2556450173 conn(0x7fe50c0b4060 msgr2=0x7fe50c0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 -- 172.21.15.80:0/2556450173 shutdown_connections 2024-04-16T15:36:47.135 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.132+0000 7fe513e88640 1 -- 172.21.15.80:0/2556450173 wait complete. 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.133+0000 7fe513e88640 1 Processor -- start 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.133+0000 7fe513e88640 1 -- start start 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe50c15ea60 0x7fe50c15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0d1260 con 0x7fe50c0afc40 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0d10e0 con 0x7fe50c15ea60 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c09ba80 con 0x7fe50c15ee40 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44904/0 (socket says 172.21.15.80:44904) 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 -- 172.21.15.80:0/4130469418 learned_addr learned my addr 172.21.15.80:0/4130469418 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511423640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe50c15ea60 0x7fe50c15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe512425640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 -- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 msgr2=0x7fe50c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 -- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe50c15ea60 msgr2=0x7fe50c15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe50c15ea60 0x7fe50c15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 -- 172.21.15.80:0/4130469418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c15c2e0 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe511c24640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c430 tx=0x7fe50800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508011790 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe508017070 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508011bb0 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c0ce370 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.134+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c0cddb0 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.135+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c069150 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.136+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe50801c460 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.136+0000 7fe5027fc640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 0x7fe4f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.136+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe50808bbe0 con 0x7fe50c0afc40 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.136+0000 7fe511423640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 0x7fe4f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.137 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.137+0000 7fe511423640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 0x7fe4f006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe50c1e9410 tx=0x7fe4fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.139 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.141+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe508059650 con 0x7fe50c0afc40 2024-04-16T15:36:47.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.318+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe50c0b2850 con 0x7fe50c0afc40 2024-04-16T15:36:47.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.318+0000 7fe5027fc640 1 -- 172.21.15.80:0/4130469418 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fe50805d950 con 0x7fe50c0afc40 2024-04-16T15:36:47.317 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.320+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 msgr2=0x7fe4f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.320+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 0x7fe4f006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe50c1e9410 tx=0x7fe4fc008040 comp rx=0 tx=0).stop 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.320+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 msgr2=0x7fe50c15bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.320+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c430 tx=0x7fe50800c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 shutdown_connections 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe4f006c8f0 0x7fe4f006edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe50c15ee40 0x7fe50c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe50c15ea60 0x7fe50c15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 --2- 172.21.15.80:0/4130469418 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe50c0afc40 0x7fe50c15bda0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 >> 172.21.15.80:0/4130469418 conn(0x7fe50c0b4060 msgr2=0x7fe50c15db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 shutdown_connections 2024-04-16T15:36:47.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.321+0000 7fe513e88640 1 -- 172.21.15.80:0/4130469418 wait complete. 2024-04-16T15:36:47.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.440+0000 7fd6d51a1640 1 Processor -- start 2024-04-16T15:36:47.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.440+0000 7fd6d51a1640 1 -- start start 2024-04-16T15:36:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d51a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d0161d60 0x7fd6d01622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d51a1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd6d00d4c60 0x7fd6d00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d51a1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d00cf5b0 con 0x7fd6d00d36d0 2024-04-16T15:36:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d51a1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d00b7460 con 0x7fd6d00d4c60 2024-04-16T15:36:47.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d51a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d00cf890 con 0x7fd6d0161d60 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6d49a0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd6d00d4c60 0x7fd6d00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6c7fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd6d00d36d0 0x7fd6d0162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50614/0 (socket says 172.21.15.80:50614) 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6c7fff640 1 -- 172.21.15.80:0/3311859163 learned_addr learned my addr 172.21.15.80:0/3311859163 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.441+0000 7fd6cffff640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d0161d60 0x7fd6d01622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6d49a0640 1 -- 172.21.15.80:0/3311859163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d0161d60 msgr2=0x7fd6d01622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6d49a0640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d0161d60 0x7fd6d01622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6d49a0640 1 -- 172.21.15.80:0/3311859163 >> v1:172.21.15.80:6789/0 conn(0x7fd6d00d36d0 legacy=0x7fd6d0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6d49a0640 1 -- 172.21.15.80:0/3311859163 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d00cfb70 con 0x7fd6d00d4c60 2024-04-16T15:36:47.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6cf7fe640 1 -- 172.21.15.80:0/3311859163 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499990 0 0) 0x7fd6d00cf5b0 con 0x7fd6d00d36d0 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.442+0000 7fd6d49a0640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00b78f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009d90 tx=0x7fd6c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43e87927975dd83 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6cf7fe640 1 -- 172.21.15.80:0/3311859163 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8039070 con 0x7fd6d00d4c60 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6cf7fe640 1 -- 172.21.15.80:0/3311859163 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c802cc50 con 0x7fd6d00d4c60 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6cf7fe640 1 -- 172.21.15.80:0/3311859163 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8034440 con 0x7fd6d00d4c60 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 -- 172.21.15.80:0/3311859163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d00d4c60 msgr2=0x7fd6d00b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00b78f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009d90 tx=0x7fd6c802bea0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 -- 172.21.15.80:0/3311859163 shutdown_connections 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00b78f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/3311859163 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d0161d60 0x7fd6d01622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 -- 172.21.15.80:0/3311859163 >> 172.21.15.80:0/3311859163 conn(0x7fd6d008c000 msgr2=0x7fd6d00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 -- 172.21.15.80:0/3311859163 shutdown_connections 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.443+0000 7fd6d51a1640 1 -- 172.21.15.80:0/3311859163 wait complete. 2024-04-16T15:36:47.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.444+0000 7fd6d51a1640 1 Processor -- start 2024-04-16T15:36:47.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.444+0000 7fd6d51a1640 1 -- start start 2024-04-16T15:36:47.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d00d36d0 0x7fd6d015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d00cffd0 con 0x7fd6d0161d60 2024-04-16T15:36:47.446 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d00cfe50 con 0x7fd6d00d4c60 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d51a1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d00b7e30 con 0x7fd6d00d36d0 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44908/0 (socket says 172.21.15.80:44908) 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 -- 172.21.15.80:0/1313249659 learned_addr learned my addr 172.21.15.80:0/1313249659 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6c7fff640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6cffff640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d00d36d0 0x7fd6d015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 -- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d00d36d0 msgr2=0x7fd6d015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d00d36d0 0x7fd6d015add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 -- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6d00d4c60 msgr2=0x7fd6d00cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.445+0000 7fd6d49a0640 1 -- 172.21.15.80:0/1313249659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d00cc7d0 con 0x7fd6d0161d60 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6d49a0640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8037040 tx=0x7fd6c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8039050 con 0x7fd6d0161d60 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c8045070 con 0x7fd6d0161d60 2024-04-16T15:36:47.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8009450 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d00ccab0 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.446+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d00cd070 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.447+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d004fd90 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.447+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6c803e610 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.448+0000 7fd6cd7fa640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.448+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd6c80ae8d0 con 0x7fd6d0161d60 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.448+0000 7fd6cffff640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.448+0000 7fd6cffff640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 0x7fd6b006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009970 tx=0x7fd6c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.450 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.452+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6c807c990 con 0x7fd6d0161d60 2024-04-16T15:36:47.626 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.628+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd6d00ba4d0 con 0x7fd6d0161d60 2024-04-16T15:36:47.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.628+0000 7fd6cd7fa640 1 -- 172.21.15.80:0/1313249659 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fd6c80ace20 con 0x7fd6d0161d60 2024-04-16T15:36:47.627 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 msgr2=0x7fd6b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 0x7fd6b006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009970 tx=0x7fd6c0008040 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 msgr2=0x7fd6d00c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8037040 tx=0x7fd6c8004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 shutdown_connections 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd6d0161d60 0x7fd6d00c8040 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6d00d4c60 0x7fd6d00cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd6b006c8f0 0x7fd6b006edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 --2- 172.21.15.80:0/1313249659 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd6d00d36d0 0x7fd6d015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 >> 172.21.15.80:0/1313249659 conn(0x7fd6d008c000 msgr2=0x7fd6d00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 shutdown_connections 2024-04-16T15:36:47.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.630+0000 7fd6d51a1640 1 -- 172.21.15.80:0/1313249659 wait complete. 2024-04-16T15:36:47.640 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:47.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.746+0000 7ff2fb688640 1 Processor -- start 2024-04-16T15:36:47.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 -- start start 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2f415fd90 0x7ff2f409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2f409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f40ce870 con 0x7ff2f4160170 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f40b22b0 con 0x7ff2f415fd90 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2fb688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40ceb50 con 0x7ff2f409b7a0 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2f8c23640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff2f4160170 0x7ff2f40b2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50616/0 (socket says 172.21.15.80:50616) 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.747+0000 7ff2f8c23640 1 -- 172.21.15.80:0/867146499 learned_addr learned my addr 172.21.15.80:0/867146499 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> v2:172.21.15.87:3300/0 conn(0x7ff2f415fd90 0x7ff2f409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9c25640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2f409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688499861 0 0) 0x7ff2f40ce870 con 0x7ff2f4160170 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e0003520 con 0x7ff2f4160170 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2380544808 0 0) 0x7ff2e0003520 con 0x7ff2f4160170 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 msgr2=0x7ff2f409afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2f409afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 >> v2:172.21.15.87:3300/0 conn(0x7ff2f415fd90 msgr2=0x7ff2f409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 --2- 172.21.15.80:0/867146499 >> v2:172.21.15.87:3300/0 conn(0x7ff2f415fd90 0x7ff2f409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40b1f40 con 0x7ff2f4160170 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7ff2e4001670 con 0x7ff2f4160170 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> v2:172.21.15.87:3300/0 conn(0x7ff2f415fd90 0x7ff2f409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 >> v1:172.21.15.80:6789/0 conn(0x7ff2f4160170 legacy=0x7ff2f40b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2e0004d40 0x7ff2e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40b22b0 con 0x7ff2e00039b0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40ceb50 con 0x7ff2e0004d40 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e000b9c0 con 0x7ff2f409b7a0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9c25640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2e0004d40 0x7ff2e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 -- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 msgr2=0x7ff2e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 -- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2e0004d40 msgr2=0x7ff2e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2e0004d40 0x7ff2e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f9424640 1 -- 172.21.15.80:0/867146499 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e0003520 con 0x7ff2e00039b0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.748+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f409b7a0 0x7ff2e0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.749+0000 7ff2f9424640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2e0003dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e350 tx=0x7ff2e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb63ce483da5be1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.749+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0039070 con 0x7ff2e00039b0 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.749+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f002ce00 con 0x7ff2e00039b0 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.749+0000 7ff2ebfff640 1 -- 172.21.15.80:0/867146499 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0009de0 con 0x7ff2e00039b0 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 -- 172.21.15.80:0/867146499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 msgr2=0x7ff2e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 --2- 172.21.15.80:0/867146499 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2e0003dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e350 tx=0x7ff2e0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2f9c25640 1 -- 172.21.15.80:0/867146499 reap_dead start 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 -- 172.21.15.80:0/867146499 shutdown_connections 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 -- 172.21.15.80:0/867146499 >> 172.21.15.80:0/867146499 conn(0x7ff2f40b4060 msgr2=0x7ff2f40b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 -- 172.21.15.80:0/867146499 shutdown_connections 2024-04-16T15:36:47.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.750+0000 7ff2fb688640 1 -- 172.21.15.80:0/867146499 wait complete. 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.751+0000 7ff2fb688640 1 Processor -- start 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.751+0000 7ff2fb688640 1 -- start start 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 0x7ff2f40cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40c9d30 0x7ff2f40ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f409b3c0 con 0x7ff2e00039b0 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f409b240 con 0x7ff2f40c9d30 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2fb688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40cdf60 con 0x7ff2f41f3110 2024-04-16T15:36:47.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44918/0 (socket says 172.21.15.80:44918) 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 -- 172.21.15.80:0/2697195262 learned_addr learned my addr 172.21.15.80:0/2697195262 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9c25640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40c9d30 0x7ff2f40ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 0x7ff2f40cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 -- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 msgr2=0x7ff2f40cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 0x7ff2f40cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 -- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40c9d30 msgr2=0x7ff2f40ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40c9d30 0x7ff2f40ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f9424640 1 -- 172.21.15.80:0/2697195262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f415f0d0 con 0x7ff2e00039b0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.752+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 0x7ff2f40cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2f9424640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e2f0 tx=0x7ff2f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0043070 con 0x7ff2e00039b0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f003e460 con 0x7ff2e00039b0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0039040 con 0x7ff2e00039b0 2024-04-16T15:36:47.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f415f3b0 con 0x7ff2e00039b0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.753+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f4150ea0 con 0x7ff2e00039b0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.754+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4069150 con 0x7ff2e00039b0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.754+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2f0046070 con 0x7ff2e00039b0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.755+0000 7ff2e9ffb640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.755+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.755+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff2f00ae6b0 con 0x7ff2e00039b0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.755+0000 7ff2f8c23640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c00 tx=0x7ff2e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:47.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.759+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2f007c120 con 0x7ff2e00039b0 2024-04-16T15:36:47.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.933+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff2f40b3e40 con 0x7ff2e00039b0 2024-04-16T15:36:47.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.933+0000 7ff2e9ffb640 1 -- 172.21.15.80:0/2697195262 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff2f0080420 con 0x7ff2e00039b0 2024-04-16T15:36:47.932 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:47.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 msgr2=0x7ff2d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c00 tx=0x7ff2e4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 msgr2=0x7ff2f4150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000e2f0 tx=0x7ff2f0009750 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 shutdown_connections 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2f40c9d30 0x7ff2f40ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2f41f3110 0x7ff2f40cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 --2- 172.21.15.80:0/2697195262 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2e00039b0 0x7ff2f4150960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 >> 172.21.15.80:0/2697195262 conn(0x7ff2f40b4060 msgr2=0x7ff2f40ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 shutdown_connections 2024-04-16T15:36:47.935 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:47.935+0000 7ff2fb688640 1 -- 172.21.15.80:0/2697195262 wait complete. 2024-04-16T15:36:47.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T15:36:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.051+0000 7f4e1e540640 1 Processor -- start 2024-04-16T15:36:48.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.051+0000 7f4e1e540640 1 -- start start 2024-04-16T15:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.051+0000 7f4e1e540640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e1806b9a0 0x7f4e180b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.051+0000 7f4e1e540640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e1806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.050 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e1e540640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e180b4af0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e1e540640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4e181457f0 con 0x7f4e1806b9a0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e1e540640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e180d19a0 con 0x7f4e180d13e0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e17fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e1806b9a0 0x7f4e180b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e1cadd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e1806c2c0 0x7f4e18145c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50626/0 (socket says 172.21.15.80:50626) 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e1cadd640 1 -- 172.21.15.80:0/679997207 learned_addr learned my addr 172.21.15.80:0/679997207 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e0ffff640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e1806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e17fff640 1 -- 172.21.15.80:0/679997207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 msgr2=0x7f4e1806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e17fff640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e1806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e17fff640 1 -- 172.21.15.80:0/679997207 >> v1:172.21.15.80:6789/0 conn(0x7f4e1806c2c0 legacy=0x7f4e18145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e17fff640 1 -- 172.21.15.80:0/679997207 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e180d1c80 con 0x7f4e1806b9a0 2024-04-16T15:36:48.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.052+0000 7f4e177fe640 1 -- 172.21.15.80:0/679997207 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616779075 0 0) 0x7f4e180b4af0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e17fff640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806b9a0 0x7f4e180b45b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e080097a0 tx=0x7f4e0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397913cf12236516 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e177fe640 1 -- 172.21.15.80:0/679997207 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08035020 con 0x7f4e1806b9a0 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e177fe640 1 -- 172.21.15.80:0/679997207 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08031830 con 0x7f4e1806b9a0 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e177fe640 1 -- 172.21.15.80:0/679997207 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08031c00 con 0x7f4e1806b9a0 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e1e540640 1 -- 172.21.15.80:0/679997207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806b9a0 msgr2=0x7f4e180b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e1e540640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806b9a0 0x7f4e180b45b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e080097a0 tx=0x7f4e0802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e1e540640 1 -- 172.21.15.80:0/679997207 shutdown_connections 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e1e540640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e1806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.053+0000 7f4e1e540640 1 --2- 172.21.15.80:0/679997207 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806b9a0 0x7f4e180b45b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.053 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.054+0000 7f4e1e540640 1 -- 172.21.15.80:0/679997207 >> 172.21.15.80:0/679997207 conn(0x7f4e180b6ba0 msgr2=0x7f4e1809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.054+0000 7f4e1e540640 1 -- 172.21.15.80:0/679997207 shutdown_connections 2024-04-16T15:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.054+0000 7f4e1e540640 1 -- 172.21.15.80:0/679997207 wait complete. 2024-04-16T15:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 Processor -- start 2024-04-16T15:36:48.054 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 -- start start 2024-04-16T15:36:48.056 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1806b9a0 0x7f4e1815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e181423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1806c750 con 0x7f4e1806c2c0 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e180d2240 con 0x7f4e1806b9a0 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.055+0000 7f4e1e540640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e18146390 con 0x7f4e180d13e0 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44940/0 (socket says 172.21.15.80:44940) 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 -- 172.21.15.80:0/2067252930 learned_addr learned my addr 172.21.15.80:0/2067252930 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 -- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 msgr2=0x7f4e181423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e181423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 -- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1806b9a0 msgr2=0x7f4e1815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1806b9a0 0x7f4e1815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 -- 172.21.15.80:0/2067252930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e18141340 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e0ffff640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d5f0 tx=0x7f4e0000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000125f0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e00019070 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000129d0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e181415e0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.056+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e18141ba0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.057+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e18068a40 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.058+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e00012b70 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.058+0000 7f4e157fa640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 0x7f4df806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.058+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4e0008c310 con 0x7f4e1806c2c0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.058+0000 7f4e17fff640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 0x7f4df806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.058+0000 7f4e17fff640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 0x7f4df806edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e08036000 tx=0x7f4e08030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.061 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.062+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e0005a340 con 0x7f4e1806c2c0 2024-04-16T15:36:48.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.253+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e181485a0 con 0x7f4e1806c2c0 2024-04-16T15:36:48.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.254+0000 7f4e157fa640 1 -- 172.21.15.80:0/2067252930 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f4e00059c40 con 0x7f4e1806c2c0 2024-04-16T15:36:48.252 INFO:teuthology.orchestra.run.smithi080.stderr:listed 0 entries 2024-04-16T15:36:48.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 msgr2=0x7f4df806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 0x7f4df806edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e08036000 tx=0x7f4e08030000 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 msgr2=0x7f4e18154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000d5f0 tx=0x7f4e0000dab0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 shutdown_connections 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4df806c8f0 0x7f4df806edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e180d13e0 0x7f4e181423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e1806c2c0 0x7f4e18154f50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 --2- 172.21.15.80:0/2067252930 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e1806b9a0 0x7f4e1815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 >> 172.21.15.80:0/2067252930 conn(0x7f4e180b6ba0 msgr2=0x7f4e18140510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 shutdown_connections 2024-04-16T15:36:48.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.256+0000 7f4e1e540640 1 -- 172.21.15.80:0/2067252930 wait complete. 2024-04-16T15:36:48.265 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-04-16T15:36:48.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:48.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-16T15:36:48.300 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:48.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:36:48.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:36:48.301 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-16T15:36:48.359 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T15:36:48.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 Processor -- start 2024-04-16T15:36:48.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 -- start start 2024-04-16T15:36:48.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 0x7f89c80b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c8161270 con 0x7f89c80cea50 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f89c80a95e0 con 0x7f89c813f7c0 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.464+0000 7f89ce35f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f89c80b62c0 con 0x7f89c80b5e60 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:42590/0 (socket says 172.21.15.80:42590) 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 -- 172.21.15.80:0/3862370320 learned_addr learned my addr 172.21.15.80:0/3862370320 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 0x7f89c80b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 -- 172.21.15.80:0/3862370320 >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 msgr2=0x7f89c80b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 --2- 172.21.15.80:0/3862370320 >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 0x7f89c80b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 -- 172.21.15.80:0/3862370320 >> v1:172.21.15.87:6789/0 conn(0x7f89c80cea50 legacy=0x7f89c8071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c77fe640 1 -- 172.21.15.80:0/3862370320 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c815dce0 con 0x7f89c80b5e60 2024-04-16T15:36:48.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.465+0000 7f89c7fff640 1 --2- 172.21.15.80:0/3862370320 >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 0x7f89c80b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:48.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.466+0000 7f89c77fe640 1 --2- 172.21.15.80:0/3862370320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009870 tx=0x7f89b002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e885b636a2e84fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.466+0000 7f89c6ffd640 1 -- 172.21.15.80:0/3862370320 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b002f840 con 0x7f89c80b5e60 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.466+0000 7f89c6ffd640 1 -- 172.21.15.80:0/3862370320 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b002f9e0 con 0x7f89c80b5e60 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.466+0000 7f89c6ffd640 1 -- 172.21.15.80:0/3862370320 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b002fdb0 con 0x7f89c80b5e60 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 -- 172.21.15.80:0/3862370320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 msgr2=0x7f89c80ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3862370320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009870 tx=0x7f89b002ba20 comp rx=0 tx=0).stop 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 -- 172.21.15.80:0/3862370320 shutdown_connections 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3862370320 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80b5e60 0x7f89c80ce510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3862370320 >> v2:172.21.15.87:3300/0 conn(0x7f89c813f7c0 0x7f89c80b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 -- 172.21.15.80:0/3862370320 >> 172.21.15.80:0/3862370320 conn(0x7f89c80b2940 msgr2=0x7f89c806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 -- 172.21.15.80:0/3862370320 shutdown_connections 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.467+0000 7f89ce35f640 1 -- 172.21.15.80:0/3862370320 wait complete. 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.468+0000 7f89ce35f640 1 Processor -- start 2024-04-16T15:36:48.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.468+0000 7f89ce35f640 1 -- start start 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80cea50 0x7f89c81f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 0x7f89c81f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8142d20 con 0x7f89c80b5e60 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8160de0 con 0x7f89c813f7c0 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f89c81604b0 con 0x7f89c80cea50 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44956/0 (socket says 172.21.15.80:44956) 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 -- 172.21.15.80:0/3749621901 learned_addr learned my addr 172.21.15.80:0/3749621901 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c77fe640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80cea50 0x7f89c81f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89cc8fc640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 0x7f89c81f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.470 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 -- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80cea50 msgr2=0x7f89c81f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80cea50 0x7f89c81f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 -- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 msgr2=0x7f89c81f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 0x7f89c81f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 -- 172.21.15.80:0/3749621901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c81f5a80 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89cc8fc640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 0x7f89c81f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c7fff640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f89b800e960 tx=0x7f89b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8017070 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b800ca00 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c81f2de0 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.469+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b800cdd0 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.470+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c815df60 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.471+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c80cf710 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.471+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89b801a070 con 0x7f89c80b5e60 2024-04-16T15:36:48.471 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.471+0000 7f89c4ff9640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 0x7f89a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.471+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f89b808bdf0 con 0x7f89c80b5e60 2024-04-16T15:36:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.472+0000 7f89c77fe640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 0x7f89a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.472+0000 7f89c77fe640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 0x7f89a806ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b0036000 tx=0x7f89b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.474 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.476+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89c80cf710 con 0x7f89c80b5e60 2024-04-16T15:36:48.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.687+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c815e620 con 0x7f89c80b5e60 2024-04-16T15:36:48.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.688+0000 7f89c4ff9640 1 -- 172.21.15.80:0/3749621901 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f89c81f5a80 con 0x7f89c80b5e60 2024-04-16T15:36:48.686 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:48.686 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:48.687 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 msgr2=0x7f89a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 0x7f89a806ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b0036000 tx=0x7f89b0008030 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 msgr2=0x7f89c8157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f89b800e960 tx=0x7f89b800ee20 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 shutdown_connections 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f89c813f7c0 0x7f89c81f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f89a806c920 0x7f89a806ede0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f89c80cea50 0x7f89c81f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 --2- 172.21.15.80:0/3749621901 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f89c80b5e60 0x7f89c8157650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 >> 172.21.15.80:0/3749621901 conn(0x7f89c80b2940 msgr2=0x7f89c8141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 shutdown_connections 2024-04-16T15:36:48.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.690+0000 7f89ce35f640 1 -- 172.21.15.80:0/3749621901 wait complete. 2024-04-16T15:36:48.700 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:48.802 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.804+0000 7f202a8ba640 1 Processor -- start 2024-04-16T15:36:48.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.804+0000 7f202a8ba640 1 -- start start 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f202415e920 0x7f20240b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20240ccf80 0x7f20240b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f20240b4100 0x7f2024162460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f202406b9a0 con 0x7f20240ccf80 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f202415ed00 con 0x7f20240b4100 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f202a8ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f202406bbf0 con 0x7f202415e920 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20240ccf80 0x7f20240b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f20240ccf80 0x7f20240b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44962/0 (socket says 172.21.15.80:44962) 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 -- 172.21.15.80:0/1628888252 learned_addr learned my addr 172.21.15.80:0/1628888252 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f2028e57640 1 --2- 172.21.15.80:0/1628888252 >> v2:172.21.15.87:3300/0 conn(0x7f20240b4100 0x7f2024162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 -- 172.21.15.80:0/1628888252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f202415e920 msgr2=0x7f20240b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f2023fff640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f202415e920 0x7f20240b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f202415e920 0x7f20240b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 -- 172.21.15.80:0/1628888252 >> v2:172.21.15.87:3300/0 conn(0x7f20240b4100 msgr2=0x7f2024162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 --2- 172.21.15.80:0/1628888252 >> v2:172.21.15.87:3300/0 conn(0x7f20240b4100 0x7f2024162460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.805+0000 7f20237fe640 1 -- 172.21.15.80:0/1628888252 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202406c960 con 0x7f20240ccf80 2024-04-16T15:36:48.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.806+0000 7f20237fe640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20240ccf80 0x7f20240b3bc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2024067cb0 tx=0x7f201802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bece760cce1997ab server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.806+0000 7f2022ffd640 1 -- 172.21.15.80:0/1628888252 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201802e070 con 0x7f20240ccf80 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.806+0000 7f2022ffd640 1 -- 172.21.15.80:0/1628888252 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018037070 con 0x7f20240ccf80 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.806+0000 7f2022ffd640 1 -- 172.21.15.80:0/1628888252 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2018031a00 con 0x7f20240ccf80 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 -- 172.21.15.80:0/1628888252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20240ccf80 msgr2=0x7f20240b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20240ccf80 0x7f20240b3bc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2024067cb0 tx=0x7f201802b880 comp rx=0 tx=0).stop 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 -- 172.21.15.80:0/1628888252 shutdown_connections 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 --2- 172.21.15.80:0/1628888252 >> v2:172.21.15.87:3300/0 conn(0x7f20240b4100 0x7f2024162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f20240ccf80 0x7f20240b3bc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 --2- 172.21.15.80:0/1628888252 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f202415e920 0x7f20240b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 -- 172.21.15.80:0/1628888252 >> 172.21.15.80:0/1628888252 conn(0x7f20240cd610 msgr2=0x7f20240cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 -- 172.21.15.80:0/1628888252 shutdown_connections 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.807+0000 7f202a8ba640 1 -- 172.21.15.80:0/1628888252 wait complete. 2024-04-16T15:36:48.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.808+0000 7f202a8ba640 1 Processor -- start 2024-04-16T15:36:48.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.808+0000 7f202a8ba640 1 -- start start 2024-04-16T15:36:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20240b4100 0x7f20241e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20240ccf80 0x7f202415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f2024070eb0 con 0x7f202415e920 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f202406cf20 con 0x7f20240b4100 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f202a8ba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f20241629a0 con 0x7f20240ccf80 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44968/0 (socket says 172.21.15.80:44968) 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 -- 172.21.15.80:0/3162976304 learned_addr learned my addr 172.21.15.80:0/3162976304 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f20237fe640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20240ccf80 0x7f202415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2023fff640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20240b4100 0x7f20241e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 -- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20240ccf80 msgr2=0x7f202415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20240ccf80 0x7f202415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 -- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20240b4100 msgr2=0x7f20241e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20240b4100 0x7f20241e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.811 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.809+0000 7f2028e57640 1 -- 172.21.15.80:0/3162976304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202415cf10 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f2028e57640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ccf0 tx=0x7f201c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c003b90 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c003d30 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202415d1f0 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c004240 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.810+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202415d7b0 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.811+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2024068a40 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.811+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f201c0043e0 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.812+0000 7f2020ff9640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.812+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f201c08c900 con 0x7f202415e920 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.812+0000 7f2023fff640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:48.812 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.812+0000 7f2023fff640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 0x7f201006ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f201400aa20 tx=0x7f2014008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:48.814 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.816+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f201c05a250 con 0x7f202415e920 2024-04-16T15:36:48.991 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.993+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20240b4850 con 0x7f202415e920 2024-04-16T15:36:48.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.994+0000 7f2020ff9640 1 -- 172.21.15.80:0/3162976304 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f201c05e550 con 0x7f202415e920 2024-04-16T15:36:48.993 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:48.993 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 msgr2=0x7f201006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 0x7f201006ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f201400aa20 tx=0x7f2014008040 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 msgr2=0x7f2024147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ccf0 tx=0x7f201c00a660 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 shutdown_connections 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f202415e920 0x7f2024147720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f20240ccf80 0x7f202415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 --2- 172.21.15.80:0/3162976304 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20240b4100 0x7f20241e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 >> 172.21.15.80:0/3162976304 conn(0x7f20240cd610 msgr2=0x7f2024074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 shutdown_connections 2024-04-16T15:36:48.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:48.996+0000 7f202a8ba640 1 -- 172.21.15.80:0/3162976304 wait complete. 2024-04-16T15:36:49.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T15:35:45.264710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T15:35:46.204994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T15:35:49.917076+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T15:36:49.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:36:49.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.113+0000 7f7dbc382640 1 Processor -- start 2024-04-16T15:36:49.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.113+0000 7f7dbc382640 1 -- start start 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.114+0000 7f7dbc382640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7db406f650 0x7f7db40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.114+0000 7f7dbc382640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db415bd50 con 0x7f7db4145020 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.114+0000 7f7dbc382640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db415c030 con 0x7f7db40cd820 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.114+0000 7f7dbc382640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7db415c310 con 0x7f7db406f650 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7db4145020 0x7f7db406ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50628/0 (socket says 172.21.15.80:50628) 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 -- 172.21.15.80:0/478637828 learned_addr learned my addr 172.21.15.80:0/478637828 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:49.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932006575 0 0) 0x7f7db415bd50 con 0x7f7db4145020 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da0003520 con 0x7f7db4145020 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db991d640 1 --2- 172.21.15.80:0/478637828 >> v2:172.21.15.87:3300/0 conn(0x7f7db406f650 0x7f7db40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3819042582 0 0) 0x7f7da0003520 con 0x7f7db4145020 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 >> v2:172.21.15.87:3300/0 conn(0x7f7db406f650 msgr2=0x7f7db40cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 --2- 172.21.15.80:0/478637828 >> v2:172.21.15.87:3300/0 conn(0x7f7db406f650 0x7f7db40cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 >> v1:172.21.15.87:6789/0 conn(0x7f7db40cd820 legacy=0x7f7db415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db415c5f0 con 0x7f7db4145020 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f7db00019f0 con 0x7f7db4145020 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 >> v1:172.21.15.80:6789/0 conn(0x7f7db4145020 legacy=0x7f7db406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 0x7f7da0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da0004800 0x7f7da0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7da00051c0 0x7f7da000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7db415c310 con 0x7f7da00039b0 2024-04-16T15:36:49.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7da000c110 con 0x7f7da00051c0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7da000c310 con 0x7f7da0004800 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 0x7f7da0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7db991d640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da0004800 0x7f7da0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba91f640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7da00051c0 0x7f7da000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 -- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da0004800 msgr2=0x7f7da0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da0004800 0x7f7da0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 -- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7da00051c0 msgr2=0x7f7da000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7da00051c0 0x7f7da000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba91f640 1 -- 172.21.15.80:0/478637828 reap_dead start 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.115+0000 7f7dba11e640 1 -- 172.21.15.80:0/478637828 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da0003520 con 0x7f7da00039b0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.116+0000 7f7dba11e640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 0x7f7da0003dd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7db000a850 tx=0x7f7da0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686d6298a9143cf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.116+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000a4a0 con 0x7f7da00039b0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.116+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0034650 con 0x7f7da00039b0 2024-04-16T15:36:49.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.116+0000 7f7db911c640 1 -- 172.21.15.80:0/478637828 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0034a80 con 0x7f7da00039b0 2024-04-16T15:36:49.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 -- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 msgr2=0x7f7da0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 0x7f7da0003dd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7db000a850 tx=0x7f7da0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 -- 172.21.15.80:0/478637828 shutdown_connections 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 --2- 172.21.15.80:0/478637828 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7da00039b0 0x7f7da0003dd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 -- 172.21.15.80:0/478637828 >> 172.21.15.80:0/478637828 conn(0x7f7db4067d90 msgr2=0x7f7db406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 -- 172.21.15.80:0/478637828 shutdown_connections 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.117+0000 7f7dbc382640 1 -- 172.21.15.80:0/478637828 wait complete. 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.118+0000 7f7dbc382640 1 Processor -- start 2024-04-16T15:36:49.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.118+0000 7f7dbc382640 1 -- start start 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 0x7f7db413afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db40cfc70 0x7f7db4140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7db40b3f90 con 0x7f7db413a400 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7db40b3e10 con 0x7f7db40cfc70 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dbc382640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7db40cd2e0 con 0x7f7da00039b0 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44976/0 (socket says 172.21.15.80:44976) 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 -- 172.21.15.80:0/993521040 learned_addr learned my addr 172.21.15.80:0/993521040 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba11e640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 0x7f7db413afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 -- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 msgr2=0x7f7db413afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 0x7f7db413afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7db991d640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db40cfc70 0x7f7db4140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 -- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db40cfc70 msgr2=0x7f7db4140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db40cfc70 0x7f7db4140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 -- 172.21.15.80:0/993521040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db41429b0 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba11e640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 0x7f7db413afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.119+0000 7f7dba91f640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7db406fb00 tx=0x7f7dac00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.120+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac01a070 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.120+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dac005340 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.120+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db413ad90 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.120+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac007250 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.120+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db4142f30 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.121+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db4068a40 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.121+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dac01d070 con 0x7f7db413a400 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.122+0000 7f7daaffd640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 0x7f7d9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.122+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7dac08b160 con 0x7f7db413a400 2024-04-16T15:36:49.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.122+0000 7f7dba11e640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 0x7f7d9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.122+0000 7f7dba11e640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 0x7f7d9806ede0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7db0034000 tx=0x7f7db002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.127+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7dac059100 con 0x7f7db413a400 2024-04-16T15:36:49.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.302+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7db41413c0 con 0x7f7db413a400 2024-04-16T15:36:49.301 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.303+0000 7f7daaffd640 1 -- 172.21.15.80:0/993521040 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f7dac058a00 con 0x7f7db413a400 2024-04-16T15:36:49.301 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:36:49.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 msgr2=0x7f7d9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 0x7f7d9806ede0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7db0034000 tx=0x7f7db002f000 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 msgr2=0x7f7db413a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7db406fb00 tx=0x7f7dac00f890 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 shutdown_connections 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7db413a400 0x7f7db413a850 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7db40cfc70 0x7f7db4140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7d9806c920 0x7f7d9806ede0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 --2- 172.21.15.80:0/993521040 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7da00039b0 0x7f7db413afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 >> 172.21.15.80:0/993521040 conn(0x7f7db4067d90 msgr2=0x7f7db40b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 shutdown_connections 2024-04-16T15:36:49.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.305+0000 7f7dbc382640 1 -- 172.21.15.80:0/993521040 wait complete. 2024-04-16T15:36:49.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T15:36:49.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.421+0000 7fad222c8640 1 Processor -- start 2024-04-16T15:36:49.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.421+0000 7fad222c8640 1 -- start start 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad222c8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c160430 0x7fad1c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad222c8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 0x7fad1c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad222c8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c15fb80 con 0x7fad1c0d0df0 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad222c8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c15fe60 con 0x7fad1c160430 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad222c8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c06d6a0 con 0x7fad1c06e3e0 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c160430 0x7fad1c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fad1c160430 0x7fad1c06dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44984/0 (socket says 172.21.15.80:44984) 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 -- 172.21.15.80:0/2764324122 learned_addr learned my addr 172.21.15.80:0/2764324122 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:49.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad20865640 1 --2- 172.21.15.80:0/2764324122 >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 0x7fad1c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 -- 172.21.15.80:0/2764324122 >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 msgr2=0x7fad1c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/2764324122 >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 0x7fad1c15ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 -- 172.21.15.80:0/2764324122 >> v1:172.21.15.87:6789/0 conn(0x7fad1c0d0df0 legacy=0x7fad1c0d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad1b7fe640 1 -- 172.21.15.80:0/2764324122 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c06d980 con 0x7fad1c160430 2024-04-16T15:36:49.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.422+0000 7fad20865640 1 --2- 172.21.15.80:0/2764324122 >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 0x7fad1c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.423+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/2764324122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c160430 0x7fad1c06dea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fad1c06f780 tx=0x7fad1002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8b4e12533868ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.423+0000 7fad1affd640 1 -- 172.21.15.80:0/2764324122 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1002e070 con 0x7fad1c160430 2024-04-16T15:36:49.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.423+0000 7fad1affd640 1 -- 172.21.15.80:0/2764324122 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad10037070 con 0x7fad1c160430 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.423+0000 7fad1affd640 1 -- 172.21.15.80:0/2764324122 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10031a00 con 0x7fad1c160430 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 -- 172.21.15.80:0/2764324122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c160430 msgr2=0x7fad1c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 --2- 172.21.15.80:0/2764324122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c160430 0x7fad1c06dea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fad1c06f780 tx=0x7fad1002b880 comp rx=0 tx=0).stop 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 -- 172.21.15.80:0/2764324122 shutdown_connections 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 --2- 172.21.15.80:0/2764324122 >> v2:172.21.15.87:3300/0 conn(0x7fad1c06e3e0 0x7fad1c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 --2- 172.21.15.80:0/2764324122 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c160430 0x7fad1c06dea0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 -- 172.21.15.80:0/2764324122 >> 172.21.15.80:0/2764324122 conn(0x7fad1c0d24e0 msgr2=0x7fad1c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 -- 172.21.15.80:0/2764324122 shutdown_connections 2024-04-16T15:36:49.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.424+0000 7fad222c8640 1 -- 172.21.15.80:0/2764324122 wait complete. 2024-04-16T15:36:49.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.425+0000 7fad222c8640 1 Processor -- start 2024-04-16T15:36:49.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.425+0000 7fad222c8640 1 -- start start 2024-04-16T15:36:49.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 0x7fad1c149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 0x7fad1c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0d0930 con 0x7fad1c0d0df0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0d07b0 con 0x7fad1c06e3e0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad222c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c06e810 con 0x7fad1c160430 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:44990/0 (socket says 172.21.15.80:44990) 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 -- 172.21.15.80:0/3411269988 learned_addr learned my addr 172.21.15.80:0/3411269988 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad20865640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 0x7fad1c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1bfff640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 0x7fad1c149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 -- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 msgr2=0x7fad1c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 0x7fad1c0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 -- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 msgr2=0x7fad1c149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 0x7fad1c149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 -- 172.21.15.80:0/3411269988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b34e0 con 0x7fad1c0d0df0 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad20865640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 0x7fad1c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1bfff640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 0x7fad1c149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.426+0000 7fad1b7fe640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fad1002b8c0 tx=0x7fad100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.427+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10032880 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.427+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad10032a40 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.427+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c0b1f00 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.427+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10032e30 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.427+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c0b24c0 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.428+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c068a40 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.428+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad1004c060 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.429+0000 7fad18ff9640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.429+0000 7fad1bfff640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.429+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fad100ad7d0 con 0x7fad1c0d0df0 2024-04-16T15:36:49.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.429+0000 7fad1bfff640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 0x7fad0806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00a830 tx=0x7fad0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.433+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad10040070 con 0x7fad1c0d0df0 2024-04-16T15:36:49.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.607+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fad1c0d0bd0 con 0x7fad1c0d0df0 2024-04-16T15:36:49.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.608+0000 7fad18ff9640 1 -- 172.21.15.80:0/3411269988 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fad1007b800 con 0x7fad1c0d0df0 2024-04-16T15:36:49.606 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 msgr2=0x7fad0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 0x7fad0806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00a830 tx=0x7fad0c008040 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 msgr2=0x7fad1c0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fad1002b8c0 tx=0x7fad100046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 shutdown_connections 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fad1c160430 0x7fad1c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad1c0d0df0 0x7fad1c0b2fa0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 --2- 172.21.15.80:0/3411269988 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad1c06e3e0 0x7fad1c149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 >> 172.21.15.80:0/3411269988 conn(0x7fad1c0d24e0 msgr2=0x7fad1c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 shutdown_connections 2024-04-16T15:36:49.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.610+0000 7fad222c8640 1 -- 172.21.15.80:0/3411269988 wait complete. 2024-04-16T15:36:49.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T15:36:49.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.728+0000 7fc225f24640 1 Processor -- start 2024-04-16T15:36:49.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.728+0000 7fc225f24640 1 -- start start 2024-04-16T15:36:49.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc225f24640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc22006c3b0 0x7fc2201693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc225f24640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22006c7f0 con 0x7fc2200700a0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc225f24640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22006cab0 con 0x7fc22015f070 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc225f24640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc22006d350 con 0x7fc22006c3b0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc21effd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc2200700a0 0x7fc22015f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50634/0 (socket says 172.21.15.80:50634) 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc21effd640 1 -- 172.21.15.80:0/4245634084 learned_addr learned my addr 172.21.15.80:0/4245634084 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374045474 0 0) 0x7fc22006c7f0 con 0x7fc2200700a0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc21ffff640 1 --2- 172.21.15.80:0/4245634084 >> v2:172.21.15.87:3300/0 conn(0x7fc22006c3b0 0x7fc2201693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.729+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc208003520 con 0x7fc2200700a0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4024782509 0 0) 0x7fc208003520 con 0x7fc2200700a0 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 >> v2:172.21.15.87:3300/0 conn(0x7fc22006c3b0 msgr2=0x7fc2201693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 --2- 172.21.15.80:0/4245634084 >> v2:172.21.15.87:3300/0 conn(0x7fc22006c3b0 0x7fc2201693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 >> v1:172.21.15.87:6789/0 conn(0x7fc22015f070 legacy=0x7fc2200b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22006cd90 con 0x7fc2200700a0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fc214001670 con 0x7fc2200700a0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 >> v1:172.21.15.80:6789/0 conn(0x7fc2200700a0 legacy=0x7fc22015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 0x7fc208003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc22006d350 con 0x7fc2080039b0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc20800c160 con 0x7fc2080051c0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc20800c360 con 0x7fc208004800 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 0x7fc208003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21effd640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21ffff640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 -- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc208004800 msgr2=0x7fc208004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 -- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080051c0 msgr2=0x7fc20800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:49.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21f7fe640 1 -- 172.21.15.80:0/4245634084 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc208003520 con 0x7fc2080039b0 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21ffff640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21effd640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.730+0000 7fc21ffff640 1 -- 172.21.15.80:0/4245634084 reap_dead start 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.731+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 0x7fc208003dd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc210001e50 tx=0x7fc208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb538643e412c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.731+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210001a70 con 0x7fc2080039b0 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.731+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc210003b70 con 0x7fc2080039b0 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.731+0000 7fc21e7fc640 1 -- 172.21.15.80:0/4245634084 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2100050d0 con 0x7fc2080039b0 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 -- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 msgr2=0x7fc208003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 0x7fc208003dd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc210001e50 tx=0x7fc208005830 comp rx=0 tx=0).stop 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 -- 172.21.15.80:0/4245634084 shutdown_connections 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 --2- 172.21.15.80:0/4245634084 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2080039b0 0x7fc208003dd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 -- 172.21.15.80:0/4245634084 >> 172.21.15.80:0/4245634084 conn(0x7fc2200d0c30 msgr2=0x7fc2200d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 -- 172.21.15.80:0/4245634084 shutdown_connections 2024-04-16T15:36:49.734 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.732+0000 7fc225f24640 1 -- 172.21.15.80:0/4245634084 wait complete. 2024-04-16T15:36:49.736 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.733+0000 7fc225f24640 1 Processor -- start 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.733+0000 7fc225f24640 1 -- start start 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 0x7fc220142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2201e8e40 0x7fc2201e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc22006eb70 con 0x7fc220155f20 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc220159290 con 0x7fc2080039b0 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200b47d0 con 0x7fc2201e8e40 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.737 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45020/0 (socket says 172.21.15.80:45020) 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 -- 172.21.15.80:0/1398819784 learned_addr learned my addr 172.21.15.80:0/1398819784 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21ffff640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2201e8e40 0x7fc2201e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 0x7fc220142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 -- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2201e8e40 msgr2=0x7fc2201e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2201e8e40 0x7fc2201e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 -- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 msgr2=0x7fc220142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 0x7fc220142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 -- 172.21.15.80:0/1398819784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2201547e0 con 0x7fc220155f20 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 0x7fc220142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:49.738 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc21effd640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc21400e7b0 tx=0x7fc21400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21400c870 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214018070 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc220154ac0 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21400cc50 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.734+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc220155080 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.735+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220068a40 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.736+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc21401d460 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.736+0000 7fc207fff640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 0x7fc20c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.736+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc21408bd10 con 0x7fc220155f20 2024-04-16T15:36:49.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.736+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 0x7fc20c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:49.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.737+0000 7fc21f7fe640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 0x7fc20c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc210034000 tx=0x7fc210009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:49.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.741+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc214059dd0 con 0x7fc220155f20 2024-04-16T15:36:49.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.915+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2200b4fe0 con 0x7fc220155f20 2024-04-16T15:36:49.914 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.916+0000 7fc207fff640 1 -- 172.21.15.80:0/1398819784 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc2140596d0 con 0x7fc220155f20 2024-04-16T15:36:49.914 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 64 2024-04-16T15:36:49.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 msgr2=0x7fc20c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 0x7fc20c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc210034000 tx=0x7fc210009030 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 msgr2=0x7fc2201563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc21400e7b0 tx=0x7fc21400ec70 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 shutdown_connections 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc20c06c8f0 0x7fc20c06edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc2201e8e40 0x7fc2201e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc220155f20 0x7fc2201563a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 --2- 172.21.15.80:0/1398819784 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2080039b0 0x7fc220142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 >> 172.21.15.80:0/1398819784 conn(0x7fc2200d0c30 msgr2=0x7fc2200b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 shutdown_connections 2024-04-16T15:36:49.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:49.918+0000 7fc225f24640 1 -- 172.21.15.80:0/1398819784 wait complete. 2024-04-16T15:36:49.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T15:36:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.035+0000 7f3108950640 1 Processor -- start 2024-04-16T15:36:50.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.035+0000 7f3108950640 1 -- start start 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3108950640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3104146c90 0x7f310406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3108950640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f310406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3108950640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31040d19a0 con 0x7f310406b9a0 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3108950640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f31041457f0 con 0x7f3104146c90 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3108950640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f310406c800 con 0x7f31040d13e0 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f310259c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f310406b9a0 0x7f31040b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50650/0 (socket says 172.21.15.80:50650) 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f310259c640 1 -- 172.21.15.80:0/2609329648 learned_addr learned my addr 172.21.15.80:0/2609329648 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3102d9d640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f310406c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f30f9d9b640 1 --2- 172.21.15.80:0/2609329648 >> v2:172.21.15.87:3300/0 conn(0x7f3104146c90 0x7f310406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22041197 0 0) 0x7f31040d19a0 con 0x7f310406b9a0 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30f0003520 con 0x7f310406b9a0 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4151074120 0 0) 0x7f30f0003520 con 0x7f310406b9a0 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 msgr2=0x7f310406c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f310406c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 >> v2:172.21.15.87:3300/0 conn(0x7f3104146c90 msgr2=0x7f310406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 --2- 172.21.15.80:0/2609329648 >> v2:172.21.15.87:3300/0 conn(0x7f3104146c90 0x7f310406bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31040d1c80 con 0x7f310406b9a0 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f30f4001670 con 0x7f310406b9a0 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3102d9d640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f310406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:50.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 >> v1:172.21.15.80:6789/0 conn(0x7f310406b9a0 legacy=0x7f31040b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f00039b0 0x7f30f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f30f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f0004d40 0x7f30f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f31041457f0 con 0x7f30f00039b0 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f310406c800 con 0x7f30f0004d40 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f30f000b9c0 con 0x7f31040d13e0 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f310259c640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f00039b0 0x7f30f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.036+0000 7f30f9d9b640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f30f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f3102d9d640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f0004d40 0x7f30f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 -- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 msgr2=0x7f30f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31040d13e0 0x7f30f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 -- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f0004d40 msgr2=0x7f30f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f0004d40 0x7f30f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 -- 172.21.15.80:0/2609329648 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f0003520 con 0x7f30f00039b0 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f3102d9d640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30f0004d40 0x7f30f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f310259c640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f00039b0 0x7f30f0003dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c210 tx=0x7f30f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d50c7f72feacbb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.037+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4007d50 con 0x7f30f00039b0 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4030070 con 0x7f30f00039b0 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3101d9b640 1 -- 172.21.15.80:0/2609329648 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f402cda0 con 0x7f30f00039b0 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 -- 172.21.15.80:0/2609329648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f00039b0 msgr2=0x7f30f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 --2- 172.21.15.80:0/2609329648 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f30f00039b0 0x7f30f0003dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c210 tx=0x7f30f0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:50.046 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3102d9d640 1 -- 172.21.15.80:0/2609329648 reap_dead start 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 -- 172.21.15.80:0/2609329648 shutdown_connections 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 -- 172.21.15.80:0/2609329648 >> 172.21.15.80:0/2609329648 conn(0x7f31040b6ba0 msgr2=0x7f310409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 -- 172.21.15.80:0/2609329648 shutdown_connections 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.038+0000 7f3108950640 1 -- 172.21.15.80:0/2609329648 wait complete. 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 Processor -- start 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 -- start start 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f00039b0 0x7f310413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3104138100 0x7f3104138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f310406c2c0 con 0x7f310415d8c0 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31040d2240 con 0x7f3104138100 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f3108950640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f310406c440 con 0x7f30f00039b0 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f30f9d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.047 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f30f9d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45038/0 (socket says 172.21.15.80:45038) 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.040+0000 7f30f9d9b640 1 -- 172.21.15.80:0/3986719020 learned_addr learned my addr 172.21.15.80:0/3986719020 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 -- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f00039b0 msgr2=0x7f310413a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f00039b0 0x7f310413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 -- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3104138100 msgr2=0x7f3104138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3104138100 0x7f3104138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 -- 172.21.15.80:0/3986719020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310413a710 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30f9d9b640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30ec011aa0 tx=0x7f30ec011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00fb00 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec00fca0 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310413b140 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec014660 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.041+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310413b700 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.042+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3104068a40 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.043+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30ec012040 con 0x7f310415d8c0 2024-04-16T15:36:50.048 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.043+0000 7f30fb7fe640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 0x7f30e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.043+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f30ec08c510 con 0x7f310415d8c0 2024-04-16T15:36:50.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.043+0000 7f310259c640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 0x7f30e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.043+0000 7f310259c640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 0x7f30e406ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30f4034000 tx=0x7f30f4039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.049 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.047+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30ec019030 con 0x7f310415d8c0 2024-04-16T15:36:50.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.224+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f31040b3590 con 0x7f310415d8c0 2024-04-16T15:36:50.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.224+0000 7f30fb7fe640 1 -- 172.21.15.80:0/3986719020 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f30ec05a540 con 0x7f310415d8c0 2024-04-16T15:36:50.223 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 msgr2=0x7f30e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 0x7f30e406ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30f4034000 tx=0x7f30f4039040 comp rx=0 tx=0).stop 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 msgr2=0x7f3104137bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f30ec011aa0 tx=0x7f30ec011f60 comp rx=0 tx=0).stop 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 shutdown_connections 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3104138100 0x7f3104138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.225 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f310415d8c0 0x7f3104137bc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f30e406c920 0x7f30e406ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 --2- 172.21.15.80:0/3986719020 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30f00039b0 0x7f310413a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 >> 172.21.15.80:0/3986719020 conn(0x7f31040b6ba0 msgr2=0x7f31040b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 shutdown_connections 2024-04-16T15:36:50.226 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.226+0000 7f3108950640 1 -- 172.21.15.80:0/3986719020 wait complete. 2024-04-16T15:36:50.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.340+0000 7fa50091c640 1 Processor -- start 2024-04-16T15:36:50.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.340+0000 7fa50091c640 1 -- start start 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa50091c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 0x7fa4fc070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa50091c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa50091c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4fc06e410 con 0x7fa4fc15d710 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa50091c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa4fc15dc80 con 0x7fa4fc15a400 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa50091c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc06ba30 con 0x7fa4fc06ced0 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fa59c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 0x7fa4fc070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4f9d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa4fc15d710 0x7fa4fc160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:44328/0 (socket says 172.21.15.80:44328) 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:42696/0 (socket says 172.21.15.80:42696) 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4f9d9b640 1 -- 172.21.15.80:0/3664819014 learned_addr learned my addr 172.21.15.80:0/3664819014 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4f959a640 1 -- 172.21.15.80:0/3664819014 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856984747 0 0) 0x7fa4fc06e410 con 0x7fa4fc15d710 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4f959a640 1 -- 172.21.15.80:0/3664819014 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4e4003520 con 0x7fa4fc15d710 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 -- 172.21.15.80:0/3664819014 >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 msgr2=0x7fa4fc070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 --2- 172.21.15.80:0/3664819014 >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 0x7fa4fc070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 -- 172.21.15.80:0/3664819014 >> v1:172.21.15.87:6789/0 conn(0x7fa4fc15d710 legacy=0x7fa4fc160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fad9d640 1 -- 172.21.15.80:0/3664819014 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc06e6f0 con 0x7fa4fc06ced0 2024-04-16T15:36:50.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.341+0000 7fa4fa59c640 1 --2- 172.21.15.80:0/3664819014 >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 0x7fa4fc070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.342+0000 7fa4fad9d640 1 --2- 172.21.15.80:0/3664819014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009d90 tx=0x7fa4f402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=102508141dd6e3fe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.342+0000 7fa4f959a640 1 -- 172.21.15.80:0/3664819014 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4039070 con 0x7fa4fc06ced0 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.342+0000 7fa4f959a640 1 -- 172.21.15.80:0/3664819014 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f402cbc0 con 0x7fa4fc06ced0 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.342+0000 7fa4f959a640 1 -- 172.21.15.80:0/3664819014 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4034440 con 0x7fa4fc06ced0 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 -- 172.21.15.80:0/3664819014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 msgr2=0x7fa4fc070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 --2- 172.21.15.80:0/3664819014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009d90 tx=0x7fa4f402be10 comp rx=0 tx=0).stop 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 -- 172.21.15.80:0/3664819014 shutdown_connections 2024-04-16T15:36:50.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 --2- 172.21.15.80:0/3664819014 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc06ced0 0x7fa4fc070540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.345 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 --2- 172.21.15.80:0/3664819014 >> v2:172.21.15.87:3300/0 conn(0x7fa4fc15a400 0x7fa4fc070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 -- 172.21.15.80:0/3664819014 >> 172.21.15.80:0/3664819014 conn(0x7fa4fc0cd610 msgr2=0x7fa4fc0cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 -- 172.21.15.80:0/3664819014 shutdown_connections 2024-04-16T15:36:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.343+0000 7fa50091c640 1 -- 172.21.15.80:0/3664819014 wait complete. 2024-04-16T15:36:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.344+0000 7fa50091c640 1 Processor -- start 2024-04-16T15:36:50.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.344+0000 7fa50091c640 1 -- start start 2024-04-16T15:36:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc15a400 0x7fa4fc0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4fc15d710 0x7fa4fc14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc070df0 con 0x7fa4fc06ced0 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc070a80 con 0x7fa4fc15d710 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa50091c640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc070f70 con 0x7fa4fc15a400 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45052/0 (socket says 172.21.15.80:45052) 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 -- 172.21.15.80:0/1798587789 learned_addr learned my addr 172.21.15.80:0/1798587789 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4f9d9b640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc15a400 0x7fa4fc0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fad9d640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4fc15d710 0x7fa4fc14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 -- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc15a400 msgr2=0x7fa4fc0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc15a400 0x7fa4fc0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 -- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4fc15d710 msgr2=0x7fa4fc14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4fc15d710 0x7fa4fc14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.345+0000 7fa4fa59c640 1 -- 172.21.15.80:0/1798587789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc14bb80 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa4fa59c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00ec10 tx=0x7fa4ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00cc30 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc0af200 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec013470 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.346+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc0aec40 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.347+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc068a40 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.347+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4ec01a070 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.348+0000 7fa4eaffd640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.348+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa4ec08bdc0 con 0x7fa4fc06ced0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.348+0000 7fa4f9d9b640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.348+0000 7fa4f9d9b640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc15c7e0 tx=0x7fa4f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.352+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4ec059830 con 0x7fa4fc06ced0 2024-04-16T15:36:50.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.565+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4fc15bbb0 con 0x7fa4fc06ced0 2024-04-16T15:36:50.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.566+0000 7fa4eaffd640 1 -- 172.21.15.80:0/1798587789 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fa4ec05db30 con 0x7fa4fc06ced0 2024-04-16T15:36:50.564 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:50.564 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:50.565 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:50.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 msgr2=0x7fa4dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc15c7e0 tx=0x7fa4f0009040 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 msgr2=0x7fa4fc0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00ec10 tx=0x7fa4ec00c520 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 shutdown_connections 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4fc15d710 0x7fa4fc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa4fc15a400 0x7fa4fc0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 --2- 172.21.15.80:0/1798587789 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa4fc06ced0 0x7fa4fc0ae2c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 >> 172.21.15.80:0/1798587789 conn(0x7fa4fc0cd610 msgr2=0x7fa4fc15de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 shutdown_connections 2024-04-16T15:36:50.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.568+0000 7fa50091c640 1 -- 172.21.15.80:0/1798587789 wait complete. 2024-04-16T15:36:50.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:50.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.682+0000 7f6e6169a640 1 Processor -- start 2024-04-16T15:36:50.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.682+0000 7f6e6169a640 1 -- start start 2024-04-16T15:36:50.682 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c15ece0 0x7f6e5c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 0x7f6e5c0d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0d1200 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c06d800 con 0x7f6e5c0d03f0 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e6169a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c06dae0 con 0x7f6e5c15ece0 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45058/0 (socket says 172.21.15.80:45058) 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 -- 172.21.15.80:0/1320449722 learned_addr learned my addr 172.21.15.80:0/1320449722 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e527fc640 1 --2- 172.21.15.80:0/1320449722 >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 0x7f6e5c0d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5affd640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c15ece0 0x7f6e5c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 -- 172.21.15.80:0/1320449722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c15ece0 msgr2=0x7f6e5c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c15ece0 0x7f6e5c06d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.683 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 -- 172.21.15.80:0/1320449722 >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 msgr2=0x7f6e5c0d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.683+0000 7f6e5b7fe640 1 --2- 172.21.15.80:0/1320449722 >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 0x7f6e5c0d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e5b7fe640 1 -- 172.21.15.80:0/1320449722 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c06ddc0 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e527fc640 1 --2- 172.21.15.80:0/1320449722 >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 0x7f6e5c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e5b7fe640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c074af0 tx=0x7f6e5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665ebc7f11d92af6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e5a7fc640 1 -- 172.21.15.80:0/1320449722 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5402ca70 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e5a7fc640 1 -- 172.21.15.80:0/1320449722 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5402cc10 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.684+0000 7f6e5a7fc640 1 -- 172.21.15.80:0/1320449722 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e540343f0 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 -- 172.21.15.80:0/1320449722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 msgr2=0x7f6e5c09aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c074af0 tx=0x7f6e5402bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 -- 172.21.15.80:0/1320449722 shutdown_connections 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c09aa70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 --2- 172.21.15.80:0/1320449722 >> v2:172.21.15.87:3300/0 conn(0x7f6e5c0d03f0 0x7f6e5c0d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 --2- 172.21.15.80:0/1320449722 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c15ece0 0x7f6e5c06d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 -- 172.21.15.80:0/1320449722 >> 172.21.15.80:0/1320449722 conn(0x7f6e5c0d24f0 msgr2=0x7f6e5c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 -- 172.21.15.80:0/1320449722 shutdown_connections 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.685+0000 7f6e6169a640 1 -- 172.21.15.80:0/1320449722 wait complete. 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.686+0000 7f6e6169a640 1 Processor -- start 2024-04-16T15:36:50.687 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.686+0000 7f6e6169a640 1 -- start start 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c0d03f0 0x7f6e5c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 0x7f6e5c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c15f0c0 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c06e380 con 0x7f6e5c15ece0 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e6169a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c15f240 con 0x7f6e5c0d03f0 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e527fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45072/0 (socket says 172.21.15.80:45072) 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e527fc640 1 -- 172.21.15.80:0/119566621 learned_addr learned my addr 172.21.15.80:0/119566621 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.687+0000 7f6e5affd640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c0d03f0 0x7f6e5c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e5b7fe640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 0x7f6e5c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 -- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c0d03f0 msgr2=0x7f6e5c0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c0d03f0 0x7f6e5c0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 -- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 msgr2=0x7f6e5c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 0x7f6e5c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 -- 172.21.15.80:0/119566621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0c6d10 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e5b7fe640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 0x7f6e5c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e527fc640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e810 tx=0x7f6e4400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400f040 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e44004030 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44004400 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c0c6ff0 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.689 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.688+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0c6a00 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.689+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c068a40 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.689+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e4400c6d0 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.690+0000 7f6e53fff640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.690+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e4408bd60 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.690+0000 7f6e5affd640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.690 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.690+0000 7f6e5affd640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.692 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.694+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e44017020 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.870+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e5c162420 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.871+0000 7f6e53fff640 1 -- 172.21.15.80:0/119566621 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f6e44059d90 con 0x7f6e5c0d0d70 2024-04-16T15:36:50.870 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:50.870 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 msgr2=0x7f6e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 msgr2=0x7f6e5c0c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e810 tx=0x7f6e4400ecd0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 shutdown_connections 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e5c15ece0 0x7f6e5c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6e5c0d0d70 0x7f6e5c0c8a60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 --2- 172.21.15.80:0/119566621 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6e5c0d03f0 0x7f6e5c0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 >> 172.21.15.80:0/119566621 conn(0x7f6e5c0d24f0 msgr2=0x7f6e5c15be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 shutdown_connections 2024-04-16T15:36:50.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.873+0000 7f6e6169a640 1 -- 172.21.15.80:0/119566621 wait complete. 2024-04-16T15:36:50.883 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T15:36:50.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:50.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 Processor -- start 2024-04-16T15:36:50.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 -- start start 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc8bc0b2900 0x7fc8bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8bc06c5b0 con 0x7fc8bc0d0710 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc8bc1626e0 con 0x7fc8bc0b2900 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.989+0000 7fc8c220d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc162930 con 0x7fc8bc163410 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8bb7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc8bc0b2900 0x7fc8bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:50.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:42742/0 (socket says 172.21.15.80:42742) 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1288699467 learned_addr learned my addr 172.21.15.80:0/1288699467 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8baffd640 1 -- 172.21.15.80:0/1288699467 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069527592 0 0) 0x7fc8bc06c5b0 con 0x7fc8bc0d0710 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1288699467 >> v2:172.21.15.87:3300/0 conn(0x7fc8bc0b2900 msgr2=0x7fc8bc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 --2- 172.21.15.80:0/1288699467 >> v2:172.21.15.87:3300/0 conn(0x7fc8bc0b2900 0x7fc8bc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1288699467 >> v1:172.21.15.87:6789/0 conn(0x7fc8bc0d0710 legacy=0x7fc8bc0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.990 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.990+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1288699467 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc162c10 con 0x7fc8bc163410 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.991+0000 7fc8b2ffd640 1 --2- 172.21.15.80:0/1288699467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad816961605819d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.991+0000 7fc8baffd640 1 -- 172.21.15.80:0/1288699467 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4035020 con 0x7fc8bc163410 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.991+0000 7fc8baffd640 1 -- 172.21.15.80:0/1288699467 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4031640 con 0x7fc8bc163410 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.991+0000 7fc8baffd640 1 -- 172.21.15.80:0/1288699467 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a402d040 con 0x7fc8bc163410 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 -- 172.21.15.80:0/1288699467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 msgr2=0x7fc8bc06bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:50.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1288699467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a402b8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 -- 172.21.15.80:0/1288699467 shutdown_connections 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1288699467 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc06bee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1288699467 >> v2:172.21.15.87:3300/0 conn(0x7fc8bc0b2900 0x7fc8bc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 -- 172.21.15.80:0/1288699467 >> 172.21.15.80:0/1288699467 conn(0x7fc8bc09aa70 msgr2=0x7fc8bc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 -- 172.21.15.80:0/1288699467 shutdown_connections 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.992+0000 7fc8c220d640 1 -- 172.21.15.80:0/1288699467 wait complete. 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.993+0000 7fc8c220d640 1 Processor -- start 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.993+0000 7fc8c220d640 1 -- start start 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8bc0b2900 0x7fc8bc151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:50.999 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0b0c00 con 0x7fc8bc0d0710 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0b2ce0 con 0x7fc8bc0b2900 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8c220d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc8bc0b0d80 con 0x7fc8bc163410 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8b2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8b2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45088/0 (socket says 172.21.15.80:45088) 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1376585898 learned_addr learned my addr 172.21.15.80:0/1376585898 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.994+0000 7fc8bb7fe640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8bc0b2900 0x7fc8bc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 msgr2=0x7fc8bc0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8bc0b2900 msgr2=0x7fc8bc151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8bc0b2900 0x7fc8bc151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 -- 172.21.15.80:0/1376585898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc0b4b30 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b2ffd640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40090b0 tx=0x7fc8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4040070 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a40399f0 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc0b4e10 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4035040 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.995+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc0b53d0 con 0x7fc8bc0d0710 2024-04-16T15:36:51.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.996+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc069150 con 0x7fc8bc0d0710 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.997+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8a4038020 con 0x7fc8bc0d0710 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.997+0000 7fc8b8ff9640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.997+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc8a40ad800 con 0x7fc8bc0d0710 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.997+0000 7fc8bb7fe640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:50.997+0000 7fc8bb7fe640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 0x7fc89c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009b40 tx=0x7fc8ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.001+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc8a407b150 con 0x7fc8bc0d0710 2024-04-16T15:36:51.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.216+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8bc162250 con 0x7fc8bc0d0710 2024-04-16T15:36:51.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.216+0000 7fc8b8ff9640 1 -- 172.21.15.80:0/1376585898 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fc8a407f450 con 0x7fc8bc0d0710 2024-04-16T15:36:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:51.215 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:51.215 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 msgr2=0x7fc89c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 0x7fc89c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009b40 tx=0x7fc8ac009190 comp rx=0 tx=0).stop 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 msgr2=0x7fc8bc0b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40090b0 tx=0x7fc8a40046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 shutdown_connections 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc89c06c8f0 0x7fc89c06edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc8bc163410 0x7fc8bc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc8bc0d0710 0x7fc8bc0b4050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 --2- 172.21.15.80:0/1376585898 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8bc0b2900 0x7fc8bc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 >> 172.21.15.80:0/1376585898 conn(0x7fc8bc09aa70 msgr2=0x7fc8bc06ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 shutdown_connections 2024-04-16T15:36:51.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.218+0000 7fc8c220d640 1 -- 172.21.15.80:0/1376585898 wait complete. 2024-04-16T15:36:51.228 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:36:51.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.332+0000 7f6dd2fba640 1 Processor -- start 2024-04-16T15:36:51.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.332+0000 7f6dd2fba640 1 -- start start 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd2fba640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dcc0b6110 0x7f6dcc0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd2fba640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dcc0ceab0 con 0x7f6dcc0b3840 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd2fba640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dcc0b42e0 con 0x7f6dcc144f00 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd2fba640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6dcc0cf0e0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd1557640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6dcc0b6110 0x7f6dcc0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dcbfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6dcc0b3840 0x7f6dcc0b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50666/0 (socket says 172.21.15.80:50666) 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dcbfff640 1 -- 172.21.15.80:0/1314170235 learned_addr learned my addr 172.21.15.80:0/1314170235 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd1557640 1 -- 172.21.15.80:0/1314170235 >> v1:172.21.15.87:6789/0 conn(0x7f6dcc144f00 legacy=0x7f6dcc0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd1557640 1 -- 172.21.15.80:0/1314170235 >> v1:172.21.15.80:6789/0 conn(0x7f6dcc0b3840 legacy=0x7f6dcc0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.332 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dd1557640 1 -- 172.21.15.80:0/1314170235 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc0ced70 con 0x7f6dcc0b6110 2024-04-16T15:36:51.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.333+0000 7f6dcb7fe640 1 -- 172.21.15.80:0/1314170235 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633763837 0 0) 0x7f6dcc0ceab0 con 0x7f6dcc0b3840 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.334+0000 7f6dd1557640 1 --2- 172.21.15.80:0/1314170235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b3cb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0cf260 tx=0x7f6dc402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38e5b6e7ff362ef server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.334+0000 7f6dcb7fe640 1 -- 172.21.15.80:0/1314170235 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4039070 con 0x7f6dcc0b6110 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.334+0000 7f6dcb7fe640 1 -- 172.21.15.80:0/1314170235 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc402cbc0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.334+0000 7f6dcb7fe640 1 -- 172.21.15.80:0/1314170235 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4034440 con 0x7f6dcc0b6110 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 -- 172.21.15.80:0/1314170235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 msgr2=0x7f6dcc0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/1314170235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b3cb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0cf260 tx=0x7f6dc402be10 comp rx=0 tx=0).stop 2024-04-16T15:36:51.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 -- 172.21.15.80:0/1314170235 shutdown_connections 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/1314170235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b3cb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 -- 172.21.15.80:0/1314170235 >> 172.21.15.80:0/1314170235 conn(0x7f6dcc0b2940 msgr2=0x7f6dcc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 -- 172.21.15.80:0/1314170235 shutdown_connections 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.335+0000 7f6dd2fba640 1 -- 172.21.15.80:0/1314170235 wait complete. 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.336+0000 7f6dd2fba640 1 Processor -- start 2024-04-16T15:36:51.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.336+0000 7f6dd2fba640 1 -- start start 2024-04-16T15:36:51.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 0x7f6dcc1323f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 0x7f6dcc1f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1452e0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.337 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0b45c0 con 0x7f6dcc144f00 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd2fba640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc145460 con 0x7f6dcc0b3840 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45106/0 (socket says 172.21.15.80:45106) 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 -- 172.21.15.80:0/2701154379 learned_addr learned my addr 172.21.15.80:0/2701154379 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd1557640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 0x7f6dcc1f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd0d56640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 0x7f6dcc1323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 -- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 msgr2=0x7f6dcc1323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 0x7f6dcc1323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 -- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 msgr2=0x7f6dcc1f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 0x7f6dcc1f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 -- 172.21.15.80:0/2701154379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc132c80 con 0x7f6dcc0b6110 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd0d56640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 0x7f6dcc1323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dd1557640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 0x7f6dcc1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:51.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.337+0000 7f6dcbfff640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c4d0 tx=0x7f6dc000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.338+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0018070 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.338+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0007500 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.338+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc132f60 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.338+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0004a20 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.338+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc133520 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.339+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc068a40 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.339+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dc001b070 con 0x7f6dcc0b6110 2024-04-16T15:36:51.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.340+0000 7f6dc97fa640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 0x7f6db806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.340+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6dc008b220 con 0x7f6dcc0b6110 2024-04-16T15:36:51.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.340+0000 7f6dd0d56640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 0x7f6db806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.340+0000 7f6dd0d56640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 0x7f6db806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a830 tx=0x7f6dbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.342 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.344+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6dc00592e0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.559+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dcc1336f0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.559+0000 7f6dc97fa640 1 -- 172.21.15.80:0/2701154379 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f6dc0058be0 con 0x7f6dcc0b6110 2024-04-16T15:36:51.558 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:51.558 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/4171067456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":4171067456},{"type":"v1","addr":"172.21.15.87:6834","nonce":4171067456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/3303725094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":3303725094},{"type":"v1","addr":"172.21.15.80:6836","nonce":3303725094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6837/2181342928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":2181342928},{"type":"v1","addr":"172.21.15.80:6837","nonce":2181342928}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:35:47.236177+0000","modified":"2024-04-16T15:36:03.311946+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2875259766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":2875259766},{"type":"v1","addr":"172.21.15.87:6835","nonce":2875259766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-16T15:36:51.558 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 9 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 msgr2=0x7f6db806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 0x7f6db806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a830 tx=0x7f6dbc008040 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 msgr2=0x7f6dcc0b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c4d0 tx=0x7f6dc000c990 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 shutdown_connections 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6dcc144f00 0x7f6dcc1f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6dcc0b6110 0x7f6dcc0b0ee0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6db806c8f0 0x7f6db806edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 --2- 172.21.15.80:0/2701154379 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6dcc0b3840 0x7f6dcc1323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 >> 172.21.15.80:0/2701154379 conn(0x7f6dcc0b2940 msgr2=0x7f6dcc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 shutdown_connections 2024-04-16T15:36:51.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.561+0000 7f6dd2fba640 1 -- 172.21.15.80:0/2701154379 wait complete. 2024-04-16T15:36:51.571 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:51.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.678+0000 7f35e0e06640 1 Processor -- start 2024-04-16T15:36:51.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.678+0000 7f35e0e06640 1 -- start start 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.678+0000 7f35e0e06640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 0x7f35dc06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35e0e06640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35dc0d0f70 0x7f35dc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35e0e06640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc06d800 con 0x7f35dc0d03f0 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35e0e06640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc09ba80 con 0x7f35dc0d0f70 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35e0e06640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc06dae0 con 0x7f35dc15ece0 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35dad9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f35dc0d0f70 0x7f35dc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35d1d9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f35dc0d03f0 0x7f35dc0d0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50680/0 (socket says 172.21.15.80:50680) 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35d1d9b640 1 -- 172.21.15.80:0/4112415495 learned_addr learned my addr 172.21.15.80:0/4112415495 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35da59c640 1 --2- 172.21.15.80:0/4112415495 >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 0x7f35dc06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35dad9d640 1 -- 172.21.15.80:0/4112415495 >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 msgr2=0x7f35dc06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35dad9d640 1 --2- 172.21.15.80:0/4112415495 >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 0x7f35dc06d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35dad9d640 1 -- 172.21.15.80:0/4112415495 >> v1:172.21.15.80:6789/0 conn(0x7f35dc0d03f0 legacy=0x7f35dc0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35dad9d640 1 -- 172.21.15.80:0/4112415495 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc06ddc0 con 0x7f35dc0d0f70 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35d9d9b640 1 -- 172.21.15.80:0/4112415495 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682254869 0 0) 0x7f35dc06d800 con 0x7f35dc0d03f0 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.679+0000 7f35da59c640 1 --2- 172.21.15.80:0/4112415495 >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 0x7f35dc06d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35dad9d640 1 --2- 172.21.15.80:0/4112415495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc0d0f70 0x7f35dc0cccf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f35dc073540 tx=0x7f35d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917c1dff913ccb21 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35d9d9b640 1 -- 172.21.15.80:0/4112415495 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4039070 con 0x7f35dc0d0f70 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35d9d9b640 1 -- 172.21.15.80:0/4112415495 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d402cc80 con 0x7f35dc0d0f70 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35d9d9b640 1 -- 172.21.15.80:0/4112415495 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4034660 con 0x7f35dc0d0f70 2024-04-16T15:36:51.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 -- 172.21.15.80:0/4112415495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc0d0f70 msgr2=0x7f35dc0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 --2- 172.21.15.80:0/4112415495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc0d0f70 0x7f35dc0cccf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f35dc073540 tx=0x7f35d402bed0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 -- 172.21.15.80:0/4112415495 shutdown_connections 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 --2- 172.21.15.80:0/4112415495 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc0d0f70 0x7f35dc0cccf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 --2- 172.21.15.80:0/4112415495 >> v2:172.21.15.87:3300/0 conn(0x7f35dc15ece0 0x7f35dc06d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 -- 172.21.15.80:0/4112415495 >> 172.21.15.80:0/4112415495 conn(0x7f35dc0d24f0 msgr2=0x7f35dc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 -- 172.21.15.80:0/4112415495 shutdown_connections 2024-04-16T15:36:51.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.680+0000 7f35e0e06640 1 -- 172.21.15.80:0/4112415495 wait complete. 2024-04-16T15:36:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.682+0000 7f35e0e06640 1 Processor -- start 2024-04-16T15:36:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.682+0000 7f35e0e06640 1 -- start start 2024-04-16T15:36:51.684 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35dc0d03f0 0x7f35dc070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 0x7f35dc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc15f0c0 con 0x7f35dc15ece0 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc06e380 con 0x7f35dc0d0f70 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc15f240 con 0x7f35dc0d03f0 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45120/0 (socket says 172.21.15.80:45120) 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 -- 172.21.15.80:0/3935276874 learned_addr learned my addr 172.21.15.80:0/3935276874 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35d1d9b640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 0x7f35dc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35da59c640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35dc0d03f0 0x7f35dc070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 -- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35dc0d03f0 msgr2=0x7f35dc070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35dc0d03f0 0x7f35dc070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 -- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 msgr2=0x7f35dc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 0x7f35dc158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.685 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 -- 172.21.15.80:0/3935276874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc0719a0 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35d1d9b640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 0x7f35dc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35dad9d640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f35d4037040 tx=0x7f35d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4044020 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d403a040 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc0716c0 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.683+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4039050 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.684+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc15f9d0 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.685+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc068a40 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.685+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35d4003b90 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.685+0000 7f35d37fe640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 0x7f35bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.686+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f35d40ae790 con 0x7f35dc15ece0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.686+0000 7f35da59c640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 0x7f35bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.686 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.686+0000 7f35da59c640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 0x7f35bc06ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35dc15d930 tx=0x7f35cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.688 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.690+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35d404e020 con 0x7f35dc15ece0 2024-04-16T15:36:51.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.867+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35dc0ccd80 con 0x7f35dc15ece0 2024-04-16T15:36:51.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.868+0000 7f35d37fe640 1 -- 172.21.15.80:0/3935276874 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18844 (secure 0 0 0) 0x7f35d407c850 con 0x7f35dc15ece0 2024-04-16T15:36:51.867 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:51.868 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":27,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:29.043818+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:35:45.264710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T15:35:46.204994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T15:35:49.917076+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:36:51.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 msgr2=0x7f35bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 0x7f35bc06ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35dc15d930 tx=0x7f35cc008040 comp rx=0 tx=0).stop 2024-04-16T15:36:51.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 msgr2=0x7f35dc161b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f35d4037040 tx=0x7f35d4004a40 comp rx=0 tx=0).stop 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 shutdown_connections 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.870+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f35dc15ece0 0x7f35dc161b70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35dc0d0f70 0x7f35dc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f35bc06c920 0x7f35bc06ede0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 --2- 172.21.15.80:0/3935276874 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f35dc0d03f0 0x7f35dc070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 >> 172.21.15.80:0/3935276874 conn(0x7f35dc0d24f0 msgr2=0x7f35dc0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 shutdown_connections 2024-04-16T15:36:51.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.871+0000 7f35e0e06640 1 -- 172.21.15.80:0/3935276874 wait complete. 2024-04-16T15:36:51.881 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T15:36:51.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.987+0000 7fb34867b640 1 Processor -- start 2024-04-16T15:36:51.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.987+0000 7fb34867b640 1 -- start start 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb34867b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb34006e5b0 0x7fb34015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb34867b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34015fb80 con 0x7fb340160430 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb34867b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34015fe60 con 0x7fb3400d0df0 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb34867b640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb34006d6a0 con 0x7fb34006e5b0 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb346c18640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb34006e5b0 0x7fb34015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb345c16640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fb340160430 0x7fb34006dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50696/0 (socket says 172.21.15.80:50696) 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb345c16640 1 -- 172.21.15.80:0/2798155266 learned_addr learned my addr 172.21.15.80:0/2798155266 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.988+0000 7fb346c18640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb34006e5b0 0x7fb34015ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45128/0 (socket says 172.21.15.80:45128) 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.989+0000 7fb346c18640 1 -- 172.21.15.80:0/2798155266 >> v1:172.21.15.87:6789/0 conn(0x7fb3400d0df0 legacy=0x7fb3400d11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:51.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.989+0000 7fb346c18640 1 -- 172.21.15.80:0/2798155266 >> v1:172.21.15.80:6789/0 conn(0x7fb340160430 legacy=0x7fb34006dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.989+0000 7fb346c18640 1 -- 172.21.15.80:0/2798155266 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34006d980 con 0x7fb34006e5b0 2024-04-16T15:36:51.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.989+0000 7fb345415640 1 -- 172.21.15.80:0/2798155266 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334310879 0 0) 0x7fb34015fb80 con 0x7fb340160430 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.989+0000 7fb346c18640 1 --2- 172.21.15.80:0/2798155266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34006e5b0 0x7fb34015ed60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097a0 tx=0x7fb33802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077c72d8d8d34ca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb345415640 1 -- 172.21.15.80:0/2798155266 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3380315a0 con 0x7fb34006e5b0 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb345415640 1 -- 172.21.15.80:0/2798155266 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338037070 con 0x7fb34006e5b0 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb345415640 1 -- 172.21.15.80:0/2798155266 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338031960 con 0x7fb34006e5b0 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 -- 172.21.15.80:0/2798155266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34006e5b0 msgr2=0x7fb34015ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 --2- 172.21.15.80:0/2798155266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34006e5b0 0x7fb34015ed60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097a0 tx=0x7fb33802b840 comp rx=0 tx=0).stop 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 -- 172.21.15.80:0/2798155266 shutdown_connections 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 --2- 172.21.15.80:0/2798155266 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb34006e5b0 0x7fb34015ed60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 -- 172.21.15.80:0/2798155266 >> 172.21.15.80:0/2798155266 conn(0x7fb3400d24e0 msgr2=0x7fb3400d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 -- 172.21.15.80:0/2798155266 shutdown_connections 2024-04-16T15:36:51.992 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.990+0000 7fb34867b640 1 -- 172.21.15.80:0/2798155266 wait complete. 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.991+0000 7fb34867b640 1 Processor -- start 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.991+0000 7fb34867b640 1 -- start start 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb34006e5b0 0x7fb3400b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb340160430 0x7fb3400b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb3400d0930 con 0x7fb3400d0df0 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb3400d07b0 con 0x7fb340160430 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb34867b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb3401608c0 con 0x7fb34006e5b0 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45140/0 (socket says 172.21.15.80:45140) 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 -- 172.21.15.80:0/1731834464 learned_addr learned my addr 172.21.15.80:0/1731834464 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 -- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb34006e5b0 msgr2=0x7fb3400b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb346417640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb34006e5b0 0x7fb3400b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb346c18640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb340160430 0x7fb3400b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.993 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb34006e5b0 0x7fb3400b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 -- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb340160430 msgr2=0x7fb3400b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb340160430 0x7fb3400b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.992+0000 7fb345c16640 1 -- 172.21.15.80:0/1731834464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34015c460 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb345c16640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c430 tx=0x7fb33000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300074e0 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300047e0 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34015c740 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330004bd0 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.993+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3400b6060 con 0x7fb3400d0df0 2024-04-16T15:36:51.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.994+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb340068a40 con 0x7fb3400d0df0 2024-04-16T15:36:51.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.994+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb330011070 con 0x7fb3400d0df0 2024-04-16T15:36:51.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.995+0000 7fb336ffd640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 0x7fb32406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:51.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.995+0000 7fb346417640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 0x7fb32406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:51.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.995+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb33008bb10 con 0x7fb3400d0df0 2024-04-16T15:36:51.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.995+0000 7fb346417640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 0x7fb32406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:51.997 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:51.999+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb330059bd0 con 0x7fb3400d0df0 2024-04-16T15:36:52.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.212+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb340161cf0 con 0x7fb3400d0df0 2024-04-16T15:36:52.211 INFO:tasks.ceph.mon.a.smithi080.stderr:2024-04-16T15:36:52.213+0000 7fec99367640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T15:36:52.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.214+0000 7fb336ffd640 1 -- 172.21.15.80:0/1731834464 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fb3300594d0 con 0x7fb3400d0df0 2024-04-16T15:36:52.213 INFO:teuthology.orchestra.run.smithi080.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T15:36:52.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 msgr2=0x7fb32406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 0x7fb32406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fd0 tx=0x7fb33c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 msgr2=0x7fb340159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c430 tx=0x7fb33000c8f0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 shutdown_connections 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb340160430 0x7fb3400b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3400d0df0 0x7fb340159af0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb32406c8f0 0x7fb32406edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 --2- 172.21.15.80:0/1731834464 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb34006e5b0 0x7fb3400b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 >> 172.21.15.80:0/1731834464 conn(0x7fb3400d24e0 msgr2=0x7fb340070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 shutdown_connections 2024-04-16T15:36:52.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.217+0000 7fb34867b640 1 -- 172.21.15.80:0/1731834464 wait complete. 2024-04-16T15:36:52.219 INFO:tasks.ceph.mds.b.smithi087.stderr: -4437> 2024-04-16T15:35:52.819+0000 7ff7be99e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:36:52.227 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T15:36:52.252 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-04-16T15:36:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.333+0000 7fe86558d640 1 Processor -- start 2024-04-16T15:36:52.331 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.333+0000 7fe86558d640 1 -- start start 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe86558d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe86015fe70 0x7fe8600ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe86558d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe8600cd430 0x7fe86009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe86558d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8601610b0 con 0x7fe8600b39a0 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe86558d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe8600b2010 con 0x7fe8600cd430 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe86558d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe8600b22f0 con 0x7fe86015fe70 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85f7fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe8600b39a0 0x7fe8600b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50702/0 (socket says 172.21.15.80:50702) 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85f7fe640 1 -- 172.21.15.80:0/38922901 learned_addr learned my addr 172.21.15.80:0/38922901 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85e7fc640 1 --2- 172.21.15.80:0/38922901 >> v2:172.21.15.87:3300/0 conn(0x7fe8600cd430 0x7fe86009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85effd640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe86015fe70 0x7fe8600ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520112757 0 0) 0x7fe8601610b0 con 0x7fe8600b39a0 2024-04-16T15:36:52.333 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.334+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe848003520 con 0x7fe8600b39a0 2024-04-16T15:36:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85e7fc640 1 -- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe86015fe70 msgr2=0x7fe8600ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85e7fc640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe86015fe70 0x7fe8600ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2639662656 0 0) 0x7fe848003520 con 0x7fe8600b39a0 2024-04-16T15:36:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85e7fc640 1 -- 172.21.15.80:0/38922901 >> v1:172.21.15.80:6789/0 conn(0x7fe8600b39a0 legacy=0x7fe8600b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.334 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85e7fc640 1 -- 172.21.15.80:0/38922901 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860160d80 con 0x7fe8600cd430 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85e7fc640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86009aa70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8540097a0 tx=0x7fe85402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd69cf2725ce9a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854037070 con 0x7fe8600cd430 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.335+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854030510 con 0x7fe8600cd430 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe85dffb640 1 -- 172.21.15.80:0/38922901 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580019f0 con 0x7fe8600cd430 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 -- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 msgr2=0x7fe86009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86009aa70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe8540097a0 tx=0x7fe85402b790 comp rx=0 tx=0).stop 2024-04-16T15:36:52.335 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 -- 172.21.15.80:0/38922901 shutdown_connections 2024-04-16T15:36:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86009aa70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 --2- 172.21.15.80:0/38922901 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe86015fe70 0x7fe8600ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 -- 172.21.15.80:0/38922901 >> 172.21.15.80:0/38922901 conn(0x7fe8600d2550 msgr2=0x7fe8600d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 -- 172.21.15.80:0/38922901 shutdown_connections 2024-04-16T15:36:52.336 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.336+0000 7fe86558d640 1 -- 172.21.15.80:0/38922901 wait complete. 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.337+0000 7fe86558d640 1 Processor -- start 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.337+0000 7fe86558d640 1 -- start start 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8600b39a0 0x7fe86014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.338 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b30a0 con 0x7fe86015fe70 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b2f20 con 0x7fe8600cd430 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe86558d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe8600b3220 con 0x7fe8600b39a0 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe85f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe85f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45142/0 (socket says 172.21.15.80:45142) 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe85e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe85f7fe640 1 -- 172.21.15.80:0/518045940 learned_addr learned my addr 172.21.15.80:0/518045940 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.338+0000 7fe85effd640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8600b39a0 0x7fe86014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 -- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8600b39a0 msgr2=0x7fe86014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8600b39a0 0x7fe86014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 -- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 msgr2=0x7fe86015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 -- 172.21.15.80:0/518045940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8601f2420 con 0x7fe86015fe70 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85e7fc640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:52.339 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe85f7fe640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe8580018c0 tx=0x7fe85800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858012400 con 0x7fe86015fe70 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580125c0 con 0x7fe86015fe70 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580129b0 con 0x7fe86015fe70 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8600c61b0 con 0x7fe86015fe70 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.339+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8600c6770 con 0x7fe86015fe70 2024-04-16T15:36:52.340 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.340+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860068a40 con 0x7fe86015fe70 2024-04-16T15:36:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.340+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe858012b50 con 0x7fe86015fe70 2024-04-16T15:36:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.341+0000 7fe8477fe640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.341+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fe85808c690 con 0x7fe86015fe70 2024-04-16T15:36:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.341+0000 7fe85effd640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:52.341 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.341+0000 7fe85effd640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 0x7fe84c06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe850009aa0 tx=0x7fe850009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:52.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.345+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe85805a160 con 0x7fe86015fe70 2024-04-16T15:36:52.555 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:52.557+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe8600b84d0 con 0x7fe86015fe70 2024-04-16T15:36:53.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.216+0000 7fe8477fe640 1 -- 172.21.15.80:0/518045940 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fe85805e460 con 0x7fe86015fe70 2024-04-16T15:36:53.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 msgr2=0x7fe84c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 0x7fe84c06edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe850009aa0 tx=0x7fe850009190 comp rx=0 tx=0).stop 2024-04-16T15:36:53.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 msgr2=0x7fe86015e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe8580018c0 tx=0x7fe85800a430 comp rx=0 tx=0).stop 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 shutdown_connections 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe86015fe70 0x7fe86015e9f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe8600cd430 0x7fe86015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 --2- 172.21.15.80:0/518045940 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe8600b39a0 0x7fe86014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 >> 172.21.15.80:0/518045940 conn(0x7fe8600d2550 msgr2=0x7fe8600713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 shutdown_connections 2024-04-16T15:36:53.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.219+0000 7fe86558d640 1 -- 172.21.15.80:0/518045940 wait complete. 2024-04-16T15:36:53.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T15:36:53.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 Processor -- start 2024-04-16T15:36:53.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 -- start start 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbed406e220 0x7fbed406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed40d2f30 con 0x7fbed4162a50 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed40d3210 con 0x7fbed415e740 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.345+0000 7fbed967e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbed41636f0 con 0x7fbed406e220 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed2ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fbed4162a50 0x7fbed4162e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:50716/0 (socket says 172.21.15.80:50716) 2024-04-16T15:36:53.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed2ffd640 1 -- 172.21.15.80:0/159602571 learned_addr learned my addr 172.21.15.80:0/159602571 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed27fc640 1 --2- 172.21.15.80:0/159602571 >> v2:172.21.15.87:3300/0 conn(0x7fbed406e220 0x7fbed406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433561721 0 0) 0x7fbed40d2f30 con 0x7fbed4162a50 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec0003520 con 0x7fbed4162a50 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372121910 0 0) 0x7fbec0003520 con 0x7fbed4162a50 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 >> v2:172.21.15.87:3300/0 conn(0x7fbed406e220 msgr2=0x7fbed406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 --2- 172.21.15.80:0/159602571 >> v2:172.21.15.87:3300/0 conn(0x7fbed406e220 0x7fbed406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 >> v1:172.21.15.87:6789/0 conn(0x7fbed415e740 legacy=0x7fbed40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40d34f0 con 0x7fbed4162a50 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fbec40019f0 con 0x7fbed4162a50 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 >> v1:172.21.15.80:6789/0 conn(0x7fbed4162a50 legacy=0x7fbed4162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbec00039b0 0x7fbec0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbec0004800 0x7fbec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbec000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbed41636f0 con 0x7fbec00052e0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbec000c1b0 con 0x7fbec0004800 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbec000c3b0 con 0x7fbec00039b0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed37fe640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbec000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed27fc640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbec0004800 0x7fbec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.346+0000 7fbed2ffd640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbec00039b0 0x7fbec0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 -- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbec00039b0 msgr2=0x7fbec0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbec00039b0 0x7fbec0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 -- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbec0004800 msgr2=0x7fbec0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbec0004800 0x7fbec0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 -- 172.21.15.80:0/159602571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec0003520 con 0x7fbec00052e0 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 -- 172.21.15.80:0/159602571 reap_dead start 2024-04-16T15:36:53.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed37fe640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbec000b9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001720 tx=0x7fbec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23028b3a6c368f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc001370 con 0x7fbec00052e0 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc0052d0 con 0x7fbec00052e0 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.347+0000 7fbed1ffb640 1 -- 172.21.15.80:0/159602571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc003830 con 0x7fbec00052e0 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 -- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 msgr2=0x7fbec000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbec000b9c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001720 tx=0x7fbec0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 -- 172.21.15.80:0/159602571 shutdown_connections 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 --2- 172.21.15.80:0/159602571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbec000b9c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 -- 172.21.15.80:0/159602571 >> 172.21.15.80:0/159602571 conn(0x7fbed408c000 msgr2=0x7fbed40d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 -- 172.21.15.80:0/159602571 shutdown_connections 2024-04-16T15:36:53.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.348+0000 7fbed967e640 1 -- 172.21.15.80:0/159602571 wait complete. 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.349+0000 7fbed967e640 1 Processor -- start 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.349+0000 7fbed967e640 1 -- start start 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 0x7fbed40b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 0x7fbed414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbed406dda0 con 0x7fbec00052e0 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbed406dc20 con 0x7fbed40b9070 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed967e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbed406df20 con 0x7fbed414e660 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed2ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45168/0 (socket says 172.21.15.80:45168) 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed2ffd640 1 -- 172.21.15.80:0/3280404646 learned_addr learned my addr 172.21.15.80:0/3280404646 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed37fe640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 0x7fbed414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.350+0000 7fbed27fc640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 0x7fbed40b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 -- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 msgr2=0x7fbed414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 0x7fbed414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 -- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 msgr2=0x7fbed40b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 0x7fbed40b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 -- 172.21.15.80:0/3280404646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed414d8a0 con 0x7fbec00052e0 2024-04-16T15:36:53.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed37fe640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 0x7fbed414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed27fc640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 0x7fbed40b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed2ffd640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007740 tx=0x7fbec4007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4017020 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec400acd0 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4013610 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed414db80 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.351+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed40b9a30 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.352+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed4068a40 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.352+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbec401a020 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.353+0000 7fbecb7fe640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.353+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fbec408c8c0 con 0x7fbec00052e0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.353+0000 7fbed27fc640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:53.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.353+0000 7fbed27fc640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 0x7fbeb406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbed415ed30 tx=0x7fbebc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:53.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.357+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbec4021020 con 0x7fbec00052e0 2024-04-16T15:36:53.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:53.533+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbed40cea40 con 0x7fbec00052e0 2024-04-16T15:36:54.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.217+0000 7fbecb7fe640 1 -- 172.21.15.80:0/3280404646 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fbec405a920 con 0x7fbec00052e0 2024-04-16T15:36:54.216 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' removed 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 msgr2=0x7fbeb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 0x7fbeb406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbed415ed30 tx=0x7fbebc008040 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 msgr2=0x7fbed415fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007740 tx=0x7fbec4007c00 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 shutdown_connections 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbed414e660 0x7fbed414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbed40b9070 0x7fbed40b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 --2- 172.21.15.80:0/3280404646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbec00052e0 0x7fbed415fde0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 >> 172.21.15.80:0/3280404646 conn(0x7fbed408c000 msgr2=0x7fbed40cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 shutdown_connections 2024-04-16T15:36:54.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.221+0000 7fbed967e640 1 -- 172.21.15.80:0/3280404646 wait complete. 2024-04-16T15:36:54.234 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T15:36:54.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.347+0000 7f7182fd4640 1 Processor -- start 2024-04-16T15:36:54.346 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.347+0000 7f7182fd4640 1 -- start start 2024-04-16T15:36:54.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.348+0000 7f7182fd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.348+0000 7f7182fd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f717c0ba460 0x7f717c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.347 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.348+0000 7f7182fd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717c0b9280 con 0x7f717c0d2ce0 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.348+0000 7f7182fd4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f717c0b9560 con 0x7f717c0ba460 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.348+0000 7f7182fd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0b9840 con 0x7f717c15e700 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f7180d70640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f717bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f717c0ba460 0x7f717c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f7180d70640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:42828/0 (socket says 172.21.15.80:42828) 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f7180d70640 1 -- 172.21.15.80:0/1805349670 learned_addr learned my addr 172.21.15.80:0/1805349670 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f717bfff640 1 -- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 msgr2=0x7f717c0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f717bfff640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f717bfff640 1 -- 172.21.15.80:0/1805349670 >> v1:172.21.15.87:6789/0 conn(0x7f717c0d2ce0 legacy=0x7f717c0d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f717bfff640 1 -- 172.21.15.80:0/1805349670 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0b9b20 con 0x7f717c0ba460 2024-04-16T15:36:54.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.349+0000 7f7180d70640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:54.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.350+0000 7f717bfff640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0cf950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7164009790 tx=0x7f716402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd092605f31d728a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.350+0000 7f717b7fe640 1 -- 172.21.15.80:0/1805349670 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164035020 con 0x7f717c0ba460 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.350+0000 7f717b7fe640 1 -- 172.21.15.80:0/1805349670 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164031800 con 0x7f717c0ba460 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.350+0000 7f717b7fe640 1 -- 172.21.15.80:0/1805349670 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164031bd0 con 0x7f717c0ba460 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 -- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 msgr2=0x7f717c0cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0cf950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7164009790 tx=0x7f716402b8a0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 -- 172.21.15.80:0/1805349670 shutdown_connections 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0cf950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 --2- 172.21.15.80:0/1805349670 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c15e700 0x7f717c0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 -- 172.21.15.80:0/1805349670 >> 172.21.15.80:0/1805349670 conn(0x7f717c0734c0 msgr2=0x7f717c0738d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 -- 172.21.15.80:0/1805349670 shutdown_connections 2024-04-16T15:36:54.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.351+0000 7f7182fd4640 1 -- 172.21.15.80:0/1805349670 wait complete. 2024-04-16T15:36:54.352 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.352+0000 7f7182fd4640 1 Processor -- start 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.352+0000 7f7182fd4640 1 -- start start 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c0d2ce0 0x7f717c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f717c15ec60 con 0x7f717c15e700 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f717c15eae0 con 0x7f717c0ba460 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f717c0d3860 con 0x7f717c0d2ce0 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45184/0 (socket says 172.21.15.80:45184) 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 -- 172.21.15.80:0/3262014113 learned_addr learned my addr 172.21.15.80:0/3262014113 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f717bfff640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c0d2ce0 0x7f717c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7180d70640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 -- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c0d2ce0 msgr2=0x7f717c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c0d2ce0 0x7f717c14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 -- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 msgr2=0x7f717c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 -- 172.21.15.80:0/3262014113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0c9ff0 con 0x7f717c15e700 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7181571640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f717400c400 tx=0x7f717400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174017070 con 0x7f717c15e700 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71740052d0 con 0x7f717c15e700 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174003810 con 0x7f717c15e700 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.353+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c0ca2d0 con 0x7f717c15e700 2024-04-16T15:36:54.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.354+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c0ca890 con 0x7f717c15e700 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.355+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c069560 con 0x7f717c15e700 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.355+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f717401a070 con 0x7f717c15e700 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.355+0000 7f71797fa640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 0x7f715c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.356+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f717408b0f0 con 0x7f717c15e700 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.356+0000 7f7180d70640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 0x7f715c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:54.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.356+0000 7f7180d70640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 0x7f715c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716c009ce0 tx=0x7f716c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:54.358 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.360+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f717c069560 con 0x7f717c15e700 2024-04-16T15:36:54.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:54.534+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f717c068a40 con 0x7f717c15e700 2024-04-16T15:36:55.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.219+0000 7f71797fa640 1 -- 172.21.15.80:0/3262014113 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f7174059310 con 0x7f717c15e700 2024-04-16T15:36:55.217 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' removed 2024-04-16T15:36:55.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 msgr2=0x7f715c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 0x7f715c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f716c009ce0 tx=0x7f716c00b040 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 msgr2=0x7f717c0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f717400c400 tx=0x7f717400c8c0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 shutdown_connections 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f717c15e700 0x7f717c0c90b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f715c06c8f0 0x7f715c06edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f717c0d2ce0 0x7f717c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 --2- 172.21.15.80:0/3262014113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f717c0ba460 0x7f717c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 >> 172.21.15.80:0/3262014113 conn(0x7f717c0734c0 msgr2=0x7f717c0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 shutdown_connections 2024-04-16T15:36:55.220 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.221+0000 7f7182fd4640 1 -- 172.21.15.80:0/3262014113 wait complete. 2024-04-16T15:36:55.235 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-16T15:36:55.343 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.345+0000 7f8d400d3640 1 Processor -- start 2024-04-16T15:36:55.344 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.345+0000 7f8d400d3640 1 -- start start 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d400d3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8d3815cca0 0x7f8d3815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d400d3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3815dcd0 con 0x7f8d3806ede0 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d400d3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3815d9f0 con 0x7f8d380d0690 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d400d3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3806e300 con 0x7f8d3815cca0 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3e670640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f8d3806ede0 0x7f8d3806f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60934/0 (socket says 172.21.15.80:60934) 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3e670640 1 -- 172.21.15.80:0/1873020419 learned_addr learned my addr 172.21.15.80:0/1873020419 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339185329 0 0) 0x7f8d3815dcd0 con 0x7f8d3806ede0 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d24003520 con 0x7f8d3806ede0 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3d66e640 1 --2- 172.21.15.80:0/1873020419 >> v2:172.21.15.87:3300/0 conn(0x7f8d3815cca0 0x7f8d3815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.348 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.346+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1024759411 0 0) 0x7f8d24003520 con 0x7f8d3806ede0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 >> v2:172.21.15.87:3300/0 conn(0x7f8d3815cca0 msgr2=0x7f8d3815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 --2- 172.21.15.80:0/1873020419 >> v2:172.21.15.87:3300/0 conn(0x7f8d3815cca0 0x7f8d3815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 >> v1:172.21.15.87:6789/0 conn(0x7f8d380d0690 legacy=0x7f8d380d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3806e5e0 con 0x7f8d3806ede0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f8d300019f0 con 0x7f8d3806ede0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 >> v1:172.21.15.80:6789/0 conn(0x7f8d3806ede0 legacy=0x7f8d3806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240039b0 0x7f8d24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d24004800 0x7f8d24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 0x7f8d2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3806e300 con 0x7f8d240051c0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2400c110 con 0x7f8d240039b0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2400c310 con 0x7f8d24004800 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 0x7f8d2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3de6f640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240039b0 0x7f8d24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.349 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3d66e640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d24004800 0x7f8d24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 -- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d24004800 msgr2=0x7f8d24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d24004800 0x7f8d24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 -- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240039b0 msgr2=0x7f8d24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240039b0 0x7f8d24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.347+0000 7f8d3e670640 1 -- 172.21.15.80:0/1873020419 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d24003520 con 0x7f8d240051c0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d3e670640 1 -- 172.21.15.80:0/1873020419 reap_dead start 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 0x7f8d2400b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a830 tx=0x7f8d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7361b1da59a772 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000a480 con 0x7f8d240051c0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d30034650 con 0x7f8d240051c0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d3ce6d640 1 -- 172.21.15.80:0/1873020419 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30034a40 con 0x7f8d240051c0 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 -- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 msgr2=0x7f8d2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 0x7f8d2400b9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a830 tx=0x7f8d24005830 comp rx=0 tx=0).stop 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 -- 172.21.15.80:0/1873020419 shutdown_connections 2024-04-16T15:36:55.350 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1873020419 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d240051c0 0x7f8d2400b9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 -- 172.21.15.80:0/1873020419 >> 172.21.15.80:0/1873020419 conn(0x7f8d380b2490 msgr2=0x7f8d380b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 -- 172.21.15.80:0/1873020419 shutdown_connections 2024-04-16T15:36:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.348+0000 7f8d400d3640 1 -- 172.21.15.80:0/1873020419 wait complete. 2024-04-16T15:36:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 Processor -- start 2024-04-16T15:36:55.351 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 -- start start 2024-04-16T15:36:55.353 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 0x7f8d38143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3814f7e0 0x7f8d381f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38157190 con 0x7f8d381f2420 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38157010 con 0x7f8d240051c0 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d400d3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f8d380d0a70 con 0x7f8d3814f7e0 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d3e670640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.350+0000 7f8d3e670640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46462/0 (socket says 172.21.15.80:46462) 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 -- 172.21.15.80:0/1808806808 learned_addr learned my addr 172.21.15.80:0/1808806808 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3de6f640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 0x7f8d38143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 -- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3814f7e0 msgr2=0x7f8d381f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.354 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3d66e640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3814f7e0 0x7f8d381f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3814f7e0 0x7f8d381f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 -- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 msgr2=0x7f8d38143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 0x7f8d38143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 -- 172.21.15.80:0/1808806808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d381436d0 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3de6f640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 0x7f8d38143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d3e670640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a830 tx=0x7f8d3806db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30039040 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d30004b60 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d381f63b0 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30034800 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.351+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d381502f0 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.352+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38068a40 con 0x7f8d381f2420 2024-04-16T15:36:55.355 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.352+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d300349a0 con 0x7f8d381f2420 2024-04-16T15:36:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.353+0000 7f8d2e7fc640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.353+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f8d300ad5f0 con 0x7f8d381f2420 2024-04-16T15:36:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.353+0000 7f8d3de6f640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.353+0000 7f8d3de6f640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:55.356 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.357+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d381436d0 con 0x7f8d381f2420 2024-04-16T15:36:55.532 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:55.533+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d38156730 con 0x7f8d381f2420 2024-04-16T15:36:56.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.240+0000 7f8d2e7fc640 1 -- 172.21.15.80:0/1808806808 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f8d3007ba20 con 0x7f8d381f2420 2024-04-16T15:36:56.238 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data_ec' removed 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 msgr2=0x7f8d1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d34009040 comp rx=0 tx=0).stop 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 msgr2=0x7f8d380b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000a830 tx=0x7f8d3806db20 comp rx=0 tx=0).stop 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 shutdown_connections 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d381f2420 0x7f8d380b4d00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f8d1c06c8f0 0x7f8d1c06edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.242 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8d3814f7e0 0x7f8d381f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 --2- 172.21.15.80:0/1808806808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d240051c0 0x7f8d38143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 >> 172.21.15.80:0/1808806808 conn(0x7f8d380b2490 msgr2=0x7f8d380b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:56.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.243+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 shutdown_connections 2024-04-16T15:36:56.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.244+0000 7f8d400d3640 1 -- 172.21.15.80:0/1808806808 wait complete. 2024-04-16T15:36:56.257 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T15:36:56.257 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T15:36:56.257 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T15:36:56.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:56.258 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T15:36:56.258 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T15:36:56.258 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T15:36:56.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:56.258 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T15:36:56.258 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T15:36:56.259 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T15:36:56.259 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:56.259 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T15:36:56.259 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T15:36:56.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T15:36:56.259 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:36:56.269 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T15:36:56.269 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T15:36:56.269 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T15:36:56.270 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T15:36:56.271 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T15:36:56.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T15:36:56.272 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T15:36:56.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T15:36:56.312 INFO:tasks.ceph.mds.a:Started 2024-04-16T15:36:56.312 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:56.313 INFO:tasks.ceph.mds.c:Started 2024-04-16T15:36:56.313 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:56.314 INFO:tasks.ceph.mds.b:Started 2024-04-16T15:36:56.315 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:56.315 INFO:tasks.ceph.mds.d:Started 2024-04-16T15:36:56.315 DEBUG:teuthology.parallel:result is None 2024-04-16T15:36:56.316 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T15:36:56.393 INFO:tasks.ceph.mds.c.smithi080.stdout:starting mds.c at 2024-04-16T15:36:56.393 INFO:tasks.ceph.mds.a.smithi080.stdout:starting mds.a at 2024-04-16T15:36:56.398 INFO:tasks.ceph.mds.b.smithi087.stdout:starting mds.b at 2024-04-16T15:36:56.398 INFO:tasks.ceph.mds.d.smithi087.stdout:starting mds.d at 2024-04-16T15:36:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.426+0000 7efe1ab00640 1 Processor -- start 2024-04-16T15:36:56.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.426+0000 7efe1ab00640 1 -- start start 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1ab00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe1409b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1ab00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efe140b3150 0x7efe140ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1ab00640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1406ccc0 con 0x7efe1415eb20 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1ab00640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7efe1406d260 con 0x7efe140b3150 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1ab00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efe140d1ab0 con 0x7efe140d2170 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1889c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7efe1415eb20 0x7efe1409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60954/0 (socket says 172.21.15.80:60954) 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1889c640 1 -- 172.21.15.80:0/536197136 learned_addr learned my addr 172.21.15.80:0/536197136 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1909d640 1 --2- 172.21.15.80:0/536197136 >> v2:172.21.15.87:3300/0 conn(0x7efe140b3150 0x7efe140ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe13fff640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe1409b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034913168 0 0) 0x7efe1406ccc0 con 0x7efe1415eb20 2024-04-16T15:36:56.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe04003520 con 0x7efe1415eb20 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3962334280 0 0) 0x7efe04003520 con 0x7efe1415eb20 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 msgr2=0x7efe1409b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe1409b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 >> v2:172.21.15.87:3300/0 conn(0x7efe140b3150 msgr2=0x7efe140ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 --2- 172.21.15.80:0/536197136 >> v2:172.21.15.87:3300/0 conn(0x7efe140b3150 0x7efe140ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1406cf80 con 0x7efe1415eb20 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7efe08001670 con 0x7efe1415eb20 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe1909d640 1 --2- 172.21.15.80:0/536197136 >> v2:172.21.15.87:3300/0 conn(0x7efe140b3150 0x7efe140ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 >> v1:172.21.15.80:6789/0 conn(0x7efe1415eb20 legacy=0x7efe1409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe040039b0 0x7efe04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe04004d40 0x7efe040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efe1406d260 con 0x7efe040039b0 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe140d1ab0 con 0x7efe04004d40 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.427+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efe0400b9c0 con 0x7efe140d2170 2024-04-16T15:36:56.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe040039b0 0x7efe04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1909d640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe04004d40 0x7efe040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe13fff640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 -- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 msgr2=0x7efe04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe140d2170 0x7efe04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 -- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe04004d40 msgr2=0x7efe040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe04004d40 0x7efe040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.428+0000 7efe1889c640 1 -- 172.21.15.80:0/536197136 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe04003520 con 0x7efe040039b0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1889c640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe040039b0 0x7efe04003dd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c210 tx=0x7efe04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf122ada2731d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08007d70 con 0x7efe040039b0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe08030070 con 0x7efe040039b0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe137fe640 1 -- 172.21.15.80:0/536197136 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0802cd60 con 0x7efe040039b0 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 -- 172.21.15.80:0/536197136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe040039b0 msgr2=0x7efe04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 --2- 172.21.15.80:0/536197136 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe040039b0 0x7efe04003dd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c210 tx=0x7efe04005830 comp rx=0 tx=0).stop 2024-04-16T15:36:56.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1909d640 1 -- 172.21.15.80:0/536197136 reap_dead start 2024-04-16T15:36:56.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 -- 172.21.15.80:0/536197136 shutdown_connections 2024-04-16T15:36:56.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 -- 172.21.15.80:0/536197136 >> 172.21.15.80:0/536197136 conn(0x7efe140b4040 msgr2=0x7efe140b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:56.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 -- 172.21.15.80:0/536197136 shutdown_connections 2024-04-16T15:36:56.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.429+0000 7efe1ab00640 1 -- 172.21.15.80:0/536197136 wait complete. 2024-04-16T15:36:56.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.430+0000 7efe1ab00640 1 Processor -- start 2024-04-16T15:36:56.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.430+0000 7efe1ab00640 1 -- start start 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe040039b0 0x7efe141f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1415a080 0x7efe141f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7efe140d1850 con 0x7efe141f7ac0 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efe140d16d0 con 0x7efe1415a080 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1ab00640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7efe1409b180 con 0x7efe040039b0 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.431+0000 7efe1909d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1889c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe040039b0 0x7efe141f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46502/0 (socket says 172.21.15.80:46502) 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe13fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1415a080 0x7efe141f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 -- 172.21.15.80:0/3093489039 learned_addr learned my addr 172.21.15.80:0/3093489039 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 -- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe040039b0 msgr2=0x7efe141f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe040039b0 0x7efe141f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 -- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1415a080 msgr2=0x7efe141f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1415a080 0x7efe141f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 -- 172.21.15.80:0/3093489039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe141f4f50 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1909d640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efe140b3580 tx=0x7efe0c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c015430 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c01d070 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1415a5d0 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c015830 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.432+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1415ab90 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.433+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1414b290 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.434+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe0c0159d0 con 0x7efe141f7ac0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.434+0000 7efe117fa640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 0x7efdf806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.434+0000 7efe1889c640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 0x7efdf806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:56.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.434+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7efe0c08c370 con 0x7efe141f7ac0 2024-04-16T15:36:56.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.435+0000 7efe1889c640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 0x7efdf806ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efe08034000 tx=0x7efe08007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:56.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.439+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe1414b290 con 0x7efe141f7ac0 2024-04-16T15:36:56.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:56.634+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efe14069150 con 0x7efe141f7ac0 2024-04-16T15:36:57.246 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.248+0000 7efe117fa640 1 -- 172.21.15.80:0/3093489039 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7efe141f4f50 con 0x7efe141f7ac0 2024-04-16T15:36:57.247 INFO:teuthology.orchestra.run.smithi080.stderr: removed all blocklist entries 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 msgr2=0x7efdf806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 0x7efdf806ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efe08034000 tx=0x7efe08007000 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 msgr2=0x7efe14150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efe140b3580 tx=0x7efe0c00f580 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 shutdown_connections 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efe141f7ac0 0x7efe14150a80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1415a080 0x7efe141f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efdf806c920 0x7efdf806ede0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 --2- 172.21.15.80:0/3093489039 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7efe040039b0 0x7efe141f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 >> 172.21.15.80:0/3093489039 conn(0x7efe140b4040 msgr2=0x7efe140c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:57.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.251+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 shutdown_connections 2024-04-16T15:36:57.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.252+0000 7efe1ab00640 1 -- 172.21.15.80:0/3093489039 wait complete. 2024-04-16T15:36:57.264 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T15:36:57.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.372+0000 7f76a441b640 1 Processor -- start 2024-04-16T15:36:57.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.372+0000 7f76a441b640 1 -- start start 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a441b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f769c0d1010 0x7f769c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a441b640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c0b4010 con 0x7f769c0ca770 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a441b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c0cf100 con 0x7f769c15eaa0 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a441b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f769c0b3800 con 0x7f769c0d1010 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a21b7640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f769c0ca770 0x7f769c0cab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60960/0 (socket says 172.21.15.80:60960) 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a21b7640 1 -- 172.21.15.80:0/770781518 learned_addr learned my addr 172.21.15.80:0/770781518 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600465987 0 0) 0x7f769c0b4010 con 0x7f769c0ca770 2024-04-16T15:36:57.374 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7688003520 con 0x7f769c0ca770 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a19b6640 1 --2- 172.21.15.80:0/770781518 >> v2:172.21.15.87:3300/0 conn(0x7f769c0d1010 0x7f769c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2481984044 0 0) 0x7f7688003520 con 0x7f769c0ca770 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 >> v2:172.21.15.87:3300/0 conn(0x7f769c0d1010 msgr2=0x7f769c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 --2- 172.21.15.80:0/770781518 >> v2:172.21.15.87:3300/0 conn(0x7f769c0d1010 0x7f769c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 >> v1:172.21.15.87:6789/0 conn(0x7f769c15eaa0 legacy=0x7f769c0ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0b3a50 con 0x7f769c0ca770 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f7698001670 con 0x7f769c0ca770 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 >> v1:172.21.15.80:6789/0 conn(0x7f769c0ca770 legacy=0x7f769c0cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76880039b0 0x7f7688003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7688004800 0x7f7688004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.375 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 0x7f768800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0b3800 con 0x7f7688005210 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f768800c140 con 0x7f76880039b0 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f768800c340 con 0x7f7688004800 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.373+0000 7f76a29b8640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 0x7f768800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a21b7640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76880039b0 0x7f7688003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a19b6640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7688004800 0x7f7688004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 -- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7688004800 msgr2=0x7f7688004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7688004800 0x7f7688004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 -- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76880039b0 msgr2=0x7f7688003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76880039b0 0x7f7688003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 -- 172.21.15.80:0/770781518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7688003520 con 0x7f7688005210 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 -- 172.21.15.80:0/770781518 reap_dead start 2024-04-16T15:36:57.376 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.374+0000 7f76a29b8640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 0x7f768800b9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f769c073c70 tx=0x7f7688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103c65b41980d456 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694001a70 con 0x7f7688005210 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694003b70 con 0x7f7688005210 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a11b5640 1 -- 172.21.15.80:0/770781518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940050d0 con 0x7f7688005210 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 -- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 msgr2=0x7f768800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 0x7f768800b9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f769c073c70 tx=0x7f7688005830 comp rx=0 tx=0).stop 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 -- 172.21.15.80:0/770781518 shutdown_connections 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 --2- 172.21.15.80:0/770781518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7688005210 0x7f768800b9c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 -- 172.21.15.80:0/770781518 >> 172.21.15.80:0/770781518 conn(0x7f769c09aa70 msgr2=0x7f769c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 -- 172.21.15.80:0/770781518 shutdown_connections 2024-04-16T15:36:57.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.375+0000 7f76a441b640 1 -- 172.21.15.80:0/770781518 wait complete. 2024-04-16T15:36:57.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.376+0000 7f76a441b640 1 Processor -- start 2024-04-16T15:36:57.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.376+0000 7f76a441b640 1 -- start start 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7688005210 0x7f769c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f769c157530 0x7f769c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f769c06c3b0 con 0x7f769c153450 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0cf3a0 con 0x7f7688005210 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a441b640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f769c06c530 con 0x7f769c157530 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a29b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a29b8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46524/0 (socket says 172.21.15.80:46524) 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a29b8640 1 -- 172.21.15.80:0/1147780331 learned_addr learned my addr 172.21.15.80:0/1147780331 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a19b6640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f769c157530 0x7f769c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.377+0000 7f76a21b7640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7688005210 0x7f769c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.381 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 -- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f769c157530 msgr2=0x7f769c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f769c157530 0x7f769c15f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 -- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7688005210 msgr2=0x7f769c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7688005210 0x7f769c0b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 -- 172.21.15.80:0/1147780331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0b5650 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a29b8640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7694001b50 tx=0x7f76940014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694039660 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769403d070 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c0b5930 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694039a00 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.378+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c0b5ef0 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.379+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c068a40 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.379+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7694039ba0 con 0x7f769c153450 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.380+0000 7f768effd640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 0x7f768006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.382 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.380+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f76940ad980 con 0x7f769c153450 2024-04-16T15:36:57.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.380+0000 7f76a21b7640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 0x7f768006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.380+0000 7f76a21b7640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 0x7f768006edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76980017d0 tx=0x7f7698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.384+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7694033030 con 0x7f769c153450 2024-04-16T15:36:57.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.629+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f769c15df20 con 0x7f769c153450 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.630+0000 7f768effd640 1 -- 172.21.15.80:0/1147780331 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f769407bf70 con 0x7f769c153450 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stdout: "auth_dump": [ 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.628 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.a", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5m2tQRDBAArV0sgbz3N1U1X87ohfAdMA==", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.b", 2024-04-16T15:36:57.629 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mk10BGRAAg88e02g+XsmZn+cL7/FR1w==", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.c", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5m0o3CExAAblaDEonQz0iBjnui/dXy+w==", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-16T15:36:57.630 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mds.d", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mlm6gIBAA0J/5wQjWvD4nyhuK+29fRA==", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.0", 2024-04-16T15:36:57.631 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCdmh5mIDaHAhAAdXWmoruVSsqTzdxvVdO0NA==", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.1", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCgmh5mn6LeABAAEHMqv3vl5auYrC2DSLm4Gw==", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.2", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCimh5mJEdyOxAAFn/7mKIT7VhifPui/1vRFw==", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.3", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQClmh5mGjtcOhAAleOff0sp2jKFMOnd51uilw==", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.633 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.4", 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCsmh5mzJ0QBxAA5Jhmy+AKlHfBpMowBlo8HQ==", 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.634 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.5", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCvmh5mjSnlBRAAdoDKuQ/4nqOrrN4KJNWj1A==", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.6", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCymh5maOXqAxAAxaddYNHtN09Vh3fF2VjV/Q==", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "osd.7", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC1mh5my2NgAhAAfstKIRQhvRMHC29MxkBemQ==", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow profile osd", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile osd", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.0", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5maTEdJRAAjycncCgzkzPFmaorV1Xi0w==", 2024-04-16T15:36:57.636 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.1", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mD7FELBAASP0YMguYjIgHgdCAv87Pew==", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.2", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mQROkKBAA/S6AkkUdOq83wpQeunO8cQ==", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.3", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mMp3dLxAAvM5PWJbfkrnrztPOK8I9Og==", 2024-04-16T15:36:57.638 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow r", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow rw", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow rwx" 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.admin", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCYmh5myYRHKhAAB2n4FXPjaaJWVCaxwV9ILA==", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mgr": "allow *", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow *", 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mds", 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5mFTxmABAA7aG4CcEMelLrkW1CLlKFlQ==", 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5mx0NmABAA8xWZJzIgEItwhjfhILan6A==", 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-osd", 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5mP0pmABAAwq2XY7NKyz7xWU59IJn+lA==", 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5msVBmABAAOg9GbhPebeWobgIwHwmEXQ==", 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5mpFdmABAAIAmw1fi3rNgJfee5Gt6u2Q==", 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQC7mh5mhF5mABAA3A4vPybdUJXXWzf4/AEF1g==", 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.642 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.x", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5m4i5/CBAA6P6GwpT6mJlH02kruUJOSw==", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "entity": "mgr.y", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "key": "AQCZmh5mKG+mBBAAAQJ0LqreWmB7hebYxRtTjQ==", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "caps": { 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "mds": "allow *", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "mon": "allow profile mgr", 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: "osd": "allow *" 2024-04-16T15:36:57.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:36:57.644 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-04-16T15:36:57.644 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:36:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 msgr2=0x7f768006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 0x7f768006edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f76980017d0 tx=0x7f7698009040 comp rx=0 tx=0).stop 2024-04-16T15:36:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 msgr2=0x7f769c1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7694001b50 tx=0x7f76940014a0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.645 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 shutdown_connections 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f769c153450 0x7f769c1538d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f768006c8f0 0x7f768006edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f769c157530 0x7f769c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 --2- 172.21.15.80:0/1147780331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7688005210 0x7f769c0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.631+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 >> 172.21.15.80:0/1147780331 conn(0x7f769c09aa70 msgr2=0x7f769c074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.632+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 shutdown_connections 2024-04-16T15:36:57.646 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.632+0000 7f76a441b640 1 -- 172.21.15.80:0/1147780331 wait complete. 2024-04-16T15:36:57.647 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T15:36:57.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.752+0000 7fc68d9d4640 1 Processor -- start 2024-04-16T15:36:57.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.752+0000 7fc68d9d4640 1 -- start start 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc68d9d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc68806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc68d9d4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68815bd50 con 0x7fc6880cd9f0 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc68d9d4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68815c030 con 0x7fc68806f480 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc68d9d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc68815c310 con 0x7fc688145020 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc6877fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fc6880cd9f0 0x7fc68815f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60974/0 (socket says 172.21.15.80:60974) 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc6877fe640 1 -- 172.21.15.80:0/3585944024 learned_addr learned my addr 172.21.15.80:0/3585944024 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:57.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc686ffd640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc68806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949810603 0 0) 0x7fc68815bd50 con 0x7fc6880cd9f0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.753+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc670003520 con 0x7fc6880cd9f0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507738712 0 0) 0x7fc68815c030 con 0x7fc68806f480 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc68815bd50 con 0x7fc68806f480 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3205466653 0 0) 0x7fc670003520 con 0x7fc6880cd9f0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 msgr2=0x7fc68806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc68806ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 >> v1:172.21.15.87:6789/0 conn(0x7fc68806f480 legacy=0x7fc6880cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68815c5f0 con 0x7fc6880cd9f0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fc6800019f0 con 0x7fc6880cd9f0 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc686ffd640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc68806ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 >> v1:172.21.15.80:6789/0 conn(0x7fc6880cd9f0 legacy=0x7fc68815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003b70 0x7fc670003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc670004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc6700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc68815c310 con 0x7fc670004d40 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc67000ba70 con 0x7fc670003b70 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc67000bc70 con 0x7fc688145020 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc6700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc686ffd640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003b70 0x7fc670003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6867fc640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc670004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 -- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 msgr2=0x7fc670004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc688145020 0x7fc670004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 -- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003b70 msgr2=0x7fc670003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003b70 0x7fc670003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.754+0000 7fc6877fe640 1 -- 172.21.15.80:0/3585944024 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc670003520 con 0x7fc670004d40 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.755+0000 7fc6877fe640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc6700051c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a760 tx=0x7fc670005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d5762a972fa39f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.755+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000a3b0 con 0x7fc670004d40 2024-04-16T15:36:57.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.755+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680034630 con 0x7fc670004d40 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.755+0000 7fc685ffb640 1 -- 172.21.15.80:0/3585944024 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680034a60 con 0x7fc670004d40 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 -- 172.21.15.80:0/3585944024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 msgr2=0x7fc6700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/3585944024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc6700051c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a760 tx=0x7fc670005830 comp rx=0 tx=0).stop 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc6877fe640 1 -- 172.21.15.80:0/3585944024 reap_dead start 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 -- 172.21.15.80:0/3585944024 shutdown_connections 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 -- 172.21.15.80:0/3585944024 >> 172.21.15.80:0/3585944024 conn(0x7fc688067d90 msgr2=0x7fc68806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 -- 172.21.15.80:0/3585944024 shutdown_connections 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.756+0000 7fc68d9d4640 1 -- 172.21.15.80:0/3585944024 wait complete. 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.757+0000 7fc68d9d4640 1 Processor -- start 2024-04-16T15:36:57.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.757+0000 7fc68d9d4640 1 -- start start 2024-04-16T15:36:57.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6880ce040 0x7fc6880ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc68813c160 0x7fc68813c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fc68806f0c0 con 0x7fc670004d40 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc68806ef40 con 0x7fc6880ce040 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fc68806f240 con 0x7fc68813c160 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46538/0 (socket says 172.21.15.80:46538) 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 -- 172.21.15.80:0/2874700450 learned_addr learned my addr 172.21.15.80:0/2874700450 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 -- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc68813c160 msgr2=0x7fc68813c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc68813c160 0x7fc68813c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 -- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6880ce040 msgr2=0x7fc6880ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6880ce040 0x7fc6880ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 -- 172.21.15.80:0/2874700450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6881443c0 con 0x7fc670004d40 2024-04-16T15:36:57.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc686ffd640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc678011a00 tx=0x7fc678011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67800fa70 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67800fc10 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68813cf00 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678004030 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.758+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68813d4c0 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.759+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688068a40 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.760+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc678012040 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.760+0000 7fc66ffff640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 0x7fc67406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.760+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fc67808bc80 con 0x7fc670004d40 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.760+0000 7fc6867fc640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 0x7fc67406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:57.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.761+0000 7fc6867fc640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 0x7fc67406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6881f5c60 tx=0x7fc67c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:57.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:57.765+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc678019070 con 0x7fc670004d40 2024-04-16T15:36:58.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.006+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc6880b36e0 con 0x7fc670004d40 2024-04-16T15:36:58.006 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.008+0000 7fc66ffff640 1 -- 172.21.15.80:0/2874700450 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fc67805a300 con 0x7fc670004d40 2024-04-16T15:36:58.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 msgr2=0x7fc67406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 0x7fc67406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc6881f5c60 tx=0x7fc67c009040 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 msgr2=0x7fc688143e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc678011a00 tx=0x7fc678011ec0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 shutdown_connections 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fc67406c8f0 0x7fc67406edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fc68813c160 0x7fc68813c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6880ce040 0x7fc6880ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 --2- 172.21.15.80:0/2874700450 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc670004d40 0x7fc688143e80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 >> 172.21.15.80:0/2874700450 conn(0x7fc688067d90 msgr2=0x7fc6880cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 shutdown_connections 2024-04-16T15:36:58.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.010+0000 7fc68d9d4640 1 -- 172.21.15.80:0/2874700450 wait complete. 2024-04-16T15:36:58.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T15:36:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 Processor -- start 2024-04-16T15:36:58.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 -- start start 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c4161f20 0x7f34c40cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34c40b74e0 0x7f34c40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 0x7f34c40d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.126+0000 7f34ca8e4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f34c40cfd90 con 0x7f34c40b74e0 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34ca8e4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f34c40d0050 con 0x7f34c40d0ff0 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34ca8e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34c40d0330 con 0x7f34c4161f20 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34c40b74e0 0x7f34c40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34c40b74e0 0x7f34c40cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46544/0 (socket says 172.21.15.80:46544) 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 -- 172.21.15.80:0/1892731476 learned_addr learned my addr 172.21.15.80:0/1892731476 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 -- 172.21.15.80:0/1892731476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c4161f20 msgr2=0x7f34c40cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:58.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1892731476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c4161f20 0x7f34c40cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 -- 172.21.15.80:0/1892731476 >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 msgr2=0x7f34c40d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c8e81640 1 --2- 172.21.15.80:0/1892731476 >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 0x7f34c40d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1892731476 >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 0x7f34c40d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c37fe640 1 -- 172.21.15.80:0/1892731476 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c40d0610 con 0x7f34c40b74e0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.127+0000 7f34c8e81640 1 --2- 172.21.15.80:0/1892731476 >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 0x7f34c40d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1892731476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c40cf770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f34c40d4520 tx=0x7f34b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8974826f5a6f1b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34c2ffd640 1 -- 172.21.15.80:0/1892731476 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8035020 con 0x7f34c40b74e0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34c2ffd640 1 -- 172.21.15.80:0/1892731476 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8031870 con 0x7f34c40b74e0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34c2ffd640 1 -- 172.21.15.80:0/1892731476 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8031c40 con 0x7f34c40b74e0 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1892731476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 msgr2=0x7f34c40cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1892731476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c40cf770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f34c40d4520 tx=0x7f34b802b910 comp rx=0 tx=0).stop 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1892731476 shutdown_connections 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1892731476 >> v2:172.21.15.87:3300/0 conn(0x7f34c40d0ff0 0x7f34c40d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1892731476 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c40cf770 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1892731476 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c4161f20 0x7f34c40cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1892731476 >> 172.21.15.80:0/1892731476 conn(0x7f34c408c000 msgr2=0x7f34c40d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1892731476 shutdown_connections 2024-04-16T15:36:58.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.128+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1892731476 wait complete. 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 Processor -- start 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 -- start start 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c40d0ff0 0x7f34c415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 0x7f34c4160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34c40d27e0 con 0x7f34c40b74e0 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34c40b5730 con 0x7f34c4161f20 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.130+0000 7f34ca8e4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34c40d2960 con 0x7f34c40d0ff0 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46548/0 (socket says 172.21.15.80:46548) 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 -- 172.21.15.80:0/1041196353 learned_addr learned my addr 172.21.15.80:0/1041196353 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c8e81640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 0x7f34c4160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c40d0ff0 0x7f34c415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 -- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c40d0ff0 msgr2=0x7f34c415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c40d0ff0 0x7f34c415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 -- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 msgr2=0x7f34c4160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 0x7f34c4160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 -- 172.21.15.80:0/1041196353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4161670 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c8e81640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 0x7f34c4160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c3fff640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b440 tx=0x7f34b400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4015020 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4011890 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011c80 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c41613f0 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.131+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c41f8090 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.132+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c4068a40 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.133+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34b4018020 con 0x7f34c40b74e0 2024-04-16T15:36:58.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.133+0000 7f34c0ff9640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 0x7f34b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.133+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f34b408b9f0 con 0x7f34c40b74e0 2024-04-16T15:36:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.133+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 0x7f34b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.134 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.134+0000 7f34c37fe640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 0x7f34b006edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f34b8036000 tx=0x7f34b803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.136 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.138+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34b401f020 con 0x7f34c40b74e0 2024-04-16T15:36:58.383 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.384+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f34c40d1d10 con 0x7f34c40b74e0 2024-04-16T15:36:58.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.387+0000 7f34c0ff9640 1 -- 172.21.15.80:0/1041196353 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f34c41613f0 con 0x7f34c40b74e0 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 msgr2=0x7f34b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 0x7f34b006edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f34b8036000 tx=0x7f34b803c040 comp rx=0 tx=0).stop 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 msgr2=0x7f34c41f85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b440 tx=0x7f34b400b900 comp rx=0 tx=0).stop 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 shutdown_connections 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34c4161f20 0x7f34c4160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f34b006c8f0 0x7f34b006edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34c40d0ff0 0x7f34c415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 --2- 172.21.15.80:0/1041196353 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34c40b74e0 0x7f34c41f85b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 >> 172.21.15.80:0/1041196353 conn(0x7f34c408c000 msgr2=0x7f34c40b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 shutdown_connections 2024-04-16T15:36:58.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.389+0000 7f34ca8e4640 1 -- 172.21.15.80:0/1041196353 wait complete. 2024-04-16T15:36:58.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T15:36:58.501 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.503+0000 7f923d6a5640 1 Processor -- start 2024-04-16T15:36:58.502 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.503+0000 7f923d6a5640 1 -- start start 2024-04-16T15:36:58.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f923d6a5640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92380b74e0 0x7f92380d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f923d6a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92380d1530 0x7f92380d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f923d6a5640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92380cfd90 con 0x7f9238161f20 2024-04-16T15:36:58.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f923d6a5640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f92380d0050 con 0x7f92380b74e0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f923d6a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f92380d0330 con 0x7f92380d1530 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f922e7fc640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f92380b74e0 0x7f92380d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f9236ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9238161f20 0x7f92380cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60988/0 (socket says 172.21.15.80:60988) 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f9236ffd640 1 -- 172.21.15.80:0/3709108698 learned_addr learned my addr 172.21.15.80:0/3709108698 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f922e7fc640 1 -- 172.21.15.80:0/3709108698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92380d1530 msgr2=0x7f92380d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f922e7fc640 1 --2- 172.21.15.80:0/3709108698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92380d1530 0x7f92380d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f922e7fc640 1 -- 172.21.15.80:0/3709108698 >> v1:172.21.15.80:6789/0 conn(0x7f9238161f20 legacy=0x7f92380cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f92367fc640 1 -- 172.21.15.80:0/3709108698 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564479124 0 0) 0x7f92380cfd90 con 0x7f9238161f20 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.504+0000 7f922e7fc640 1 -- 172.21.15.80:0/3709108698 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92380d0610 con 0x7f92380b74e0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.505+0000 7f922e7fc640 1 --2- 172.21.15.80:0/3709108698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380b74e0 0x7f92380d0ff0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92200097a0 tx=0x7f922002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9cd9bb1cc55789 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.505+0000 7f92367fc640 1 -- 172.21.15.80:0/3709108698 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220035020 con 0x7f92380b74e0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.505+0000 7f92367fc640 1 -- 172.21.15.80:0/3709108698 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9220031830 con 0x7f92380b74e0 2024-04-16T15:36:58.504 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.505+0000 7f92367fc640 1 -- 172.21.15.80:0/3709108698 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220031c00 con 0x7f92380b74e0 2024-04-16T15:36:58.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 -- 172.21.15.80:0/3709108698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380b74e0 msgr2=0x7f92380d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 --2- 172.21.15.80:0/3709108698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380b74e0 0x7f92380d0ff0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f92200097a0 tx=0x7f922002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 -- 172.21.15.80:0/3709108698 shutdown_connections 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 --2- 172.21.15.80:0/3709108698 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f92380d1530 0x7f92380d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 --2- 172.21.15.80:0/3709108698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380b74e0 0x7f92380d0ff0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 -- 172.21.15.80:0/3709108698 >> 172.21.15.80:0/3709108698 conn(0x7f923808c000 msgr2=0x7f92380d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 -- 172.21.15.80:0/3709108698 shutdown_connections 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.506+0000 7f923d6a5640 1 -- 172.21.15.80:0/3709108698 wait complete. 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.507+0000 7f923d6a5640 1 Processor -- start 2024-04-16T15:36:58.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.507+0000 7f923d6a5640 1 -- start start 2024-04-16T15:36:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 0x7f92381f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 0x7f92380ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f92380cf940 con 0x7f92380d1530 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f92380b5730 con 0x7f92380b74e0 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f92380cfac0 con 0x7f9238161f20 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46572/0 (socket says 172.21.15.80:46572) 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 -- 172.21.15.80:0/1640350275 learned_addr learned my addr 172.21.15.80:0/1640350275 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f92377fe640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 0x7f92380ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f9236ffd640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 0x7f92381f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 -- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 msgr2=0x7f92380ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 0x7f92380ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 -- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 msgr2=0x7f92381f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 0x7f92381f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 -- 172.21.15.80:0/1640350275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92380c92b0 con 0x7f92380d1530 2024-04-16T15:36:58.510 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f92377fe640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 0x7f92380ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f9236ffd640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 0x7f92381f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922e7fc640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92200097a0 tx=0x7f92200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220004230 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92200043f0 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92381f8d30 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.508+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220003850 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.509+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92380c9800 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.509+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9238068a40 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.510+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f922004c060 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.510+0000 7f922ffff640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.510+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f92200ad4c0 con 0x7f92380d1530 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.510+0000 7f9236ffd640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.511+0000 7f9236ffd640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 0x7f921806edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9228000f60 tx=0x7f9228009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.513 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.515+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9220040070 con 0x7f92380d1530 2024-04-16T15:36:58.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.756+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f92380b6fd0 con 0x7f92380d1530 2024-04-16T15:36:58.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.758+0000 7f922ffff640 1 -- 172.21.15.80:0/1640350275 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f922007bab0 con 0x7f92380d1530 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 msgr2=0x7f921806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 0x7f921806edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9228000f60 tx=0x7f9228009040 comp rx=0 tx=0).stop 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 msgr2=0x7f923814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92200097a0 tx=0x7f92200046c0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 shutdown_connections 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9238161f20 0x7f92380ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f92380d1530 0x7f923814a8d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 --2- 172.21.15.80:0/1640350275 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f92380b74e0 0x7f92381f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 >> 172.21.15.80:0/1640350275 conn(0x7f923808c000 msgr2=0x7f92380d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 shutdown_connections 2024-04-16T15:36:58.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.760+0000 7f923d6a5640 1 -- 172.21.15.80:0/1640350275 wait complete. 2024-04-16T15:36:58.770 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T15:36:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.874+0000 7fa333031640 1 Processor -- start 2024-04-16T15:36:58.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.874+0000 7fa333031640 1 -- start start 2024-04-16T15:36:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa333031640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c15b4c0 0x7fa32c0d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa333031640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15ccb0 0x7fa32c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa333031640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32c0b5780 con 0x7fa32c0d2060 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa333031640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c0d1690 con 0x7fa32c15b4c0 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa333031640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0b5a60 con 0x7fa32c15ccb0 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa330dcd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c15b4c0 0x7fa32c0d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa330dcd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fa32c15b4c0 0x7fa32c0d1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46588/0 (socket says 172.21.15.80:46588) 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa330dcd640 1 -- 172.21.15.80:0/3442213639 learned_addr learned my addr 172.21.15.80:0/3442213639 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.875+0000 7fa3315ce640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15ccb0 0x7fa32c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.876+0000 7fa330dcd640 1 -- 172.21.15.80:0/3442213639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15ccb0 msgr2=0x7fa32c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.876+0000 7fa330dcd640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15ccb0 0x7fa32c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.876+0000 7fa330dcd640 1 -- 172.21.15.80:0/3442213639 >> v1:172.21.15.87:6789/0 conn(0x7fa32c0d2060 legacy=0x7fa32c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.876+0000 7fa330dcd640 1 -- 172.21.15.80:0/3442213639 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0d1320 con 0x7fa32c15b4c0 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa330dcd640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15b4c0 0x7fa32c0d1b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009870 tx=0x7fa31c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5597c67b6a2d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa32b7fe640 1 -- 172.21.15.80:0/3442213639 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c034070 con 0x7fa32c15b4c0 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa32b7fe640 1 -- 172.21.15.80:0/3442213639 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31c030840 con 0x7fa32c15b4c0 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa32b7fe640 1 -- 172.21.15.80:0/3442213639 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c030c10 con 0x7fa32c15b4c0 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 -- 172.21.15.80:0/3442213639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15b4c0 msgr2=0x7fa32c0d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15b4c0 0x7fa32c0d1b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009870 tx=0x7fa31c02b980 comp rx=0 tx=0).stop 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 -- 172.21.15.80:0/3442213639 shutdown_connections 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15ccb0 0x7fa32c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 --2- 172.21.15.80:0/3442213639 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15b4c0 0x7fa32c0d1b20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 -- 172.21.15.80:0/3442213639 >> 172.21.15.80:0/3442213639 conn(0x7fa32c0b6ba0 msgr2=0x7fa32c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 -- 172.21.15.80:0/3442213639 shutdown_connections 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.877+0000 7fa333031640 1 -- 172.21.15.80:0/3442213639 wait complete. 2024-04-16T15:36:58.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 Processor -- start 2024-04-16T15:36:58.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 -- start start 2024-04-16T15:36:58.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15b4c0 0x7fa32c15e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 0x7fa32c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.879+0000 7fa333031640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c0b53d0 con 0x7fa32c15ccb0 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa333031640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c15c8b0 con 0x7fa32c0b0430 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa333031640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0af540 con 0x7fa32c15b4c0 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46592/0 (socket says 172.21.15.80:46592) 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 -- 172.21.15.80:0/3588547478 learned_addr learned my addr 172.21.15.80:0/3588547478 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa3315ce640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 0x7fa32c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa330dcd640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15b4c0 0x7fa32c15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 -- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15b4c0 msgr2=0x7fa32c15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15b4c0 0x7fa32c15e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 -- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 msgr2=0x7fa32c155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:58.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 0x7fa32c155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 -- 172.21.15.80:0/3588547478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0ae950 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa3315ce640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 0x7fa32c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa32bfff640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c400 tx=0x7fa32000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3200052d0 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa320005490 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c0aec10 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320007260 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.880+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c0af1d0 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.881+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c068a40 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.882+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa320007400 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.882+0000 7fa3297fa640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 0x7fa31806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.882+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa32008af20 con 0x7fa32c15ccb0 2024-04-16T15:36:58.882 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.882+0000 7fa330dcd640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 0x7fa31806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:58.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.883+0000 7fa330dcd640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 0x7fa31806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa31c036000 tx=0x7fa31c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:58.885 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:58.887+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa320059510 con 0x7fa32c15ccb0 2024-04-16T15:36:59.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.129+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa32c0af6c0 con 0x7fa32c15ccb0 2024-04-16T15:36:59.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.131+0000 7fa3297fa640 1 -- 172.21.15.80:0/3588547478 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa320058e10 con 0x7fa32c15ccb0 2024-04-16T15:36:59.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 msgr2=0x7fa31806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 0x7fa31806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa31c036000 tx=0x7fa31c03b040 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 msgr2=0x7fa32c0afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c400 tx=0x7fa32000c8c0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 shutdown_connections 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa32c0b0430 0x7fa32c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa32c15ccb0 0x7fa32c0afef0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa31806c8f0 0x7fa31806edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 --2- 172.21.15.80:0/3588547478 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa32c15b4c0 0x7fa32c15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 >> 172.21.15.80:0/3588547478 conn(0x7fa32c0b6ba0 msgr2=0x7fa32c0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 shutdown_connections 2024-04-16T15:36:59.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.134+0000 7fa333031640 1 -- 172.21.15.80:0/3588547478 wait complete. 2024-04-16T15:36:59.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T15:36:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.249+0000 7f912f2eb640 1 Processor -- start 2024-04-16T15:36:59.247 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.249+0000 7f912f2eb640 1 -- start start 2024-04-16T15:36:59.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912f2eb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91280cf8e0 0x7f91280cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.248 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912f2eb640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912806bad0 con 0x7f91280ccdb0 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912f2eb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f912806bdb0 con 0x7f91280d03d0 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912f2eb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f912806c090 con 0x7f91280cf8e0 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912d087640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f91280cf8e0 0x7f91280cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912c886640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f91280ccdb0 0x7f91280cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60994/0 (socket says 172.21.15.80:60994) 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912c886640 1 -- 172.21.15.80:0/1773361328 learned_addr learned my addr 172.21.15.80:0/1773361328 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912d087640 1 -- 172.21.15.80:0/1773361328 >> v1:172.21.15.87:6789/0 conn(0x7f91280d03d0 legacy=0x7f912806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912d087640 1 -- 172.21.15.80:0/1773361328 >> v1:172.21.15.80:6789/0 conn(0x7f91280ccdb0 legacy=0x7f91280cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.250+0000 7f912d087640 1 -- 172.21.15.80:0/1773361328 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912806c370 con 0x7f91280cf8e0 2024-04-16T15:36:59.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.251+0000 7f912d087640 1 --2- 172.21.15.80:0/1773361328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280cf8e0 0x7f91280cdca0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f91240097a0 tx=0x7f912402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1e140682f1d102 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f911ffff640 1 -- 172.21.15.80:0/1773361328 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240315a0 con 0x7f91280cf8e0 2024-04-16T15:36:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f911ffff640 1 -- 172.21.15.80:0/1773361328 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9124037070 con 0x7f91280cf8e0 2024-04-16T15:36:59.251 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f911ffff640 1 -- 172.21.15.80:0/1773361328 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124031960 con 0x7f91280cf8e0 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f912f2eb640 1 -- 172.21.15.80:0/1773361328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280cf8e0 msgr2=0x7f91280cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f912f2eb640 1 --2- 172.21.15.80:0/1773361328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280cf8e0 0x7f91280cdca0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f91240097a0 tx=0x7f912402b840 comp rx=0 tx=0).stop 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f912f2eb640 1 -- 172.21.15.80:0/1773361328 shutdown_connections 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.253+0000 7f912f2eb640 1 --2- 172.21.15.80:0/1773361328 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280cf8e0 0x7f91280cdca0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.254+0000 7f912f2eb640 1 -- 172.21.15.80:0/1773361328 >> 172.21.15.80:0/1773361328 conn(0x7f91280d0c30 msgr2=0x7f91280d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.254+0000 7f912f2eb640 1 -- 172.21.15.80:0/1773361328 shutdown_connections 2024-04-16T15:36:59.252 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.254+0000 7f912f2eb640 1 -- 172.21.15.80:0/1773361328 wait complete. 2024-04-16T15:36:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 Processor -- start 2024-04-16T15:36:59.253 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 -- start start 2024-04-16T15:36:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280ccdb0 0x7f91281f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280cf8e0 0x7f9128154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f91280b00f0 con 0x7f91280d03d0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f91280ce2b0 con 0x7f91280ccdb0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.255+0000 7f912f2eb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f91281586d0 con 0x7f91280cf8e0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46608/0 (socket says 172.21.15.80:46608) 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 -- 172.21.15.80:0/644231047 learned_addr learned my addr 172.21.15.80:0/644231047 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d087640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280ccdb0 0x7f91281f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912c886640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280cf8e0 0x7f9128154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 -- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280cf8e0 msgr2=0x7f9128154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280cf8e0 0x7f9128154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 -- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280ccdb0 msgr2=0x7f91281f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280ccdb0 0x7f91281f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 -- 172.21.15.80:0/644231047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281f36e0 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912d888640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f912000c7d0 tx=0x7f912000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120003b70 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120003d30 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9128157ac0 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912000aa90 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.256+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9128158360 con 0x7f91280d03d0 2024-04-16T15:36:59.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.257+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128068a40 con 0x7f91280d03d0 2024-04-16T15:36:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.258+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f912000ac30 con 0x7f91280d03d0 2024-04-16T15:36:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.258+0000 7f911dffb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 0x7f910c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.258+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f912008b7d0 con 0x7f91280d03d0 2024-04-16T15:36:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.258+0000 7f912d087640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 0x7f910c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.259+0000 7f912d087640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 0x7f910c06edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9124036000 tx=0x7f912403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.263+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91281f36e0 con 0x7f91280d03d0 2024-04-16T15:36:59.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.505+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f91280afed0 con 0x7f91280d03d0 2024-04-16T15:36:59.505 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.507+0000 7f911dffb640 1 -- 172.21.15.80:0/644231047 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f91200596f0 con 0x7f91280d03d0 2024-04-16T15:36:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 msgr2=0x7f910c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 0x7f910c06edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9124036000 tx=0x7f912403d040 comp rx=0 tx=0).stop 2024-04-16T15:36:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 msgr2=0x7f91281555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f912000c7d0 tx=0x7f912000cc90 comp rx=0 tx=0).stop 2024-04-16T15:36:59.508 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 shutdown_connections 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91280d03d0 0x7f91281555f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f910c06c8f0 0x7f910c06edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91280cf8e0 0x7f9128154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 --2- 172.21.15.80:0/644231047 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91280ccdb0 0x7f91281f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 >> 172.21.15.80:0/644231047 conn(0x7f91280d0c30 msgr2=0x7f91280b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 shutdown_connections 2024-04-16T15:36:59.509 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.510+0000 7f912f2eb640 1 -- 172.21.15.80:0/644231047 wait complete. 2024-04-16T15:36:59.519 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T15:36:59.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.625+0000 7f9ae913d640 1 Processor -- start 2024-04-16T15:36:59.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.625+0000 7f9ae913d640 1 -- start start 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae913d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ae406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae913d640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae406cab0 con 0x7f9ae415f070 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae913d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae406cd90 con 0x7f9ae415f450 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae913d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae406d350 con 0x7f9ae40700a0 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae2d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f9ae415f070 0x7f9ae40b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:60998/0 (socket says 172.21.15.80:60998) 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae2d9d640 1 -- 172.21.15.80:0/1813611140 learned_addr learned my addr 172.21.15.80:0/1813611140 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9adbfff640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ae406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743037759 0 0) 0x7f9ae406cab0 con 0x7f9ae415f070 2024-04-16T15:36:59.627 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad0003520 con 0x7f9ae415f070 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457005226 0 0) 0x7f9ae406cd90 con 0x7f9ae415f450 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae406cab0 con 0x7f9ae415f450 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 440400421 0 0) 0x7f9ad0003520 con 0x7f9ae415f070 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 msgr2=0x7f9ae406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ae406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 >> v1:172.21.15.87:6789/0 conn(0x7f9ae415f450 legacy=0x7f9ae41683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae406d070 con 0x7f9ae415f070 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f9ad4001690 con 0x7f9ae415f070 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 >> v1:172.21.15.80:6789/0 conn(0x7f9ae415f070 legacy=0x7f9ae40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ad0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004120 0x7f9ad0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.628 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae406d350 con 0x7f9ad0004d40 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad000bb80 con 0x7f9ad0004120 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.626+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad000bd80 con 0x7f9ae40700a0 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae2d9d640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ad0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9adbfff640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004120 0x7f9ad0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 -- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 msgr2=0x7f9ad0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae40700a0 0x7f9ad0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 -- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004120 msgr2=0x7f9ad0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004120 0x7f9ad0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.627+0000 7f9ae359e640 1 -- 172.21.15.80:0/1813611140 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0003520 con 0x7f9ad0004d40 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae359e640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9adc001fd0 tx=0x7f9ad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821b9a35bbe644f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.629 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc001bf0 con 0x7f9ad0004d40 2024-04-16T15:36:59.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc003b70 con 0x7f9ad0004d40 2024-04-16T15:36:59.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae259c640 1 -- 172.21.15.80:0/1813611140 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0050d0 con 0x7f9ad0004d40 2024-04-16T15:36:59.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 -- 172.21.15.80:0/1813611140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ad0004d40 msgr2=0x7f9ad00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 --2- 172.21.15.80:0/1813611140 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ad0004d40 0x7f9ad00051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9adc001fd0 tx=0x7f9ad0005830 comp rx=0 tx=0).stop 2024-04-16T15:36:59.630 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae359e640 1 -- 172.21.15.80:0/1813611140 reap_dead start 2024-04-16T15:36:59.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 -- 172.21.15.80:0/1813611140 shutdown_connections 2024-04-16T15:36:59.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 -- 172.21.15.80:0/1813611140 >> 172.21.15.80:0/1813611140 conn(0x7f9ae40d0c30 msgr2=0x7f9ae40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:59.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 -- 172.21.15.80:0/1813611140 shutdown_connections 2024-04-16T15:36:59.631 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.628+0000 7f9ae913d640 1 -- 172.21.15.80:0/1813611140 wait complete. 2024-04-16T15:36:59.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 Processor -- start 2024-04-16T15:36:59.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 -- start start 2024-04-16T15:36:59.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004d40 0x7f9ae414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.633 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae4153440 0x7f9ae40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415f8c0 con 0x7f9ae4152ac0 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae4159290 con 0x7f9ad0004d40 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9ae913d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae415fa40 con 0x7f9ae4153440 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9adbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9adbfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46622/0 (socket says 172.21.15.80:46622) 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.630+0000 7f9adbfff640 1 -- 172.21.15.80:0/569063571 learned_addr learned my addr 172.21.15.80:0/569063571 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 -- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae4153440 msgr2=0x7f9ae40b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9ae2d9d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004d40 0x7f9ae414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae4153440 0x7f9ae40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 -- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004d40 msgr2=0x7f9ae414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004d40 0x7f9ae414f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.634 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 -- 172.21.15.80:0/569063571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae4153d40 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adbfff640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9acc011950 tx=0x7f9acc011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00fa90 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc00fc30 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae41432b0 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc014440 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.631+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae4143870 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.632+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae4068a40 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.632+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9acc012040 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.633+0000 7f9adb7fe640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 0x7f9ac406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.633+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9acc08beb0 con 0x7f9ae4152ac0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.633+0000 7f9ae2d9d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 0x7f9ac406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:36:59.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.633+0000 7f9ae2d9d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 0x7f9ac406ede0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4001eb0 tx=0x7f9ad4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:36:59.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.637+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9acc019030 con 0x7f9ae4152ac0 2024-04-16T15:36:59.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.881+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f9ae406c580 con 0x7f9ae4152ac0 2024-04-16T15:36:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.883+0000 7f9adb7fe640 1 -- 172.21.15.80:0/569063571 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f9acc05a530 con 0x7f9ae4152ac0 2024-04-16T15:36:59.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 msgr2=0x7f9ac406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 0x7f9ac406ede0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4001eb0 tx=0x7f9ad4009040 comp rx=0 tx=0).stop 2024-04-16T15:36:59.883 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 msgr2=0x7f9ae41417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9acc011950 tx=0x7f9acc011e10 comp rx=0 tx=0).stop 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 shutdown_connections 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9ac406c920 0x7f9ac406ede0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9ae4153440 0x7f9ae40b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9ae4152ac0 0x7f9ae41417e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 --2- 172.21.15.80:0/569063571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ad0004d40 0x7f9ae414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 >> 172.21.15.80:0/569063571 conn(0x7f9ae40d0c30 msgr2=0x7f9ae415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 shutdown_connections 2024-04-16T15:36:59.884 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.885+0000 7f9ae913d640 1 -- 172.21.15.80:0/569063571 wait complete. 2024-04-16T15:36:59.894 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:36:59.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.999+0000 7f2744d50640 1 Processor -- start 2024-04-16T15:36:59.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:36:59.999+0000 7f2744d50640 1 -- start start 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f2744d50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f274013f7c0 0x7f27400b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f2744d50640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f27400cec20 0x7f274015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f2744d50640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2740161270 con 0x7f27400b5e60 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f2744d50640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f27400a95e0 con 0x7f27400cec20 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f2744d50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f27400b62c0 con 0x7f274013f7c0 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f273dd9b640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f27400b5e60 0x7f27400ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32776/0 (socket says 172.21.15.80:32776) 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f273dd9b640 1 -- 172.21.15.80:0/714157235 learned_addr learned my addr 172.21.15.80:0/714157235 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f273ed9d640 1 --2- 172.21.15.80:0/714157235 >> v2:172.21.15.87:3300/0 conn(0x7f27400cec20 0x7f274015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.000+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f274013f7c0 0x7f27400b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987476863 0 0) 0x7f2740161270 con 0x7f27400b5e60 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2728003520 con 0x7f27400b5e60 2024-04-16T15:37:00.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 651111366 0 0) 0x7f2728003520 con 0x7f27400b5e60 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f274013f7c0 msgr2=0x7f27400b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f274013f7c0 0x7f27400b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 >> v2:172.21.15.87:3300/0 conn(0x7f27400cec20 msgr2=0x7f274015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 --2- 172.21.15.80:0/714157235 >> v2:172.21.15.87:3300/0 conn(0x7f27400cec20 0x7f274015ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274013fe10 con 0x7f27400b5e60 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f2734001670 con 0x7f27400b5e60 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 >> v1:172.21.15.80:6789/0 conn(0x7f27400b5e60 legacy=0x7f27400ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27280039b0 0x7f2728003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2728004800 0x7f2728004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280051c0 0x7f272800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f272800bf00 con 0x7f27280039b0 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f272800c080 con 0x7f27280051c0 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f272800c200 con 0x7f2728004800 2024-04-16T15:37:00.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f274013f7c0 0x7f27400b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273ed9d640 1 --2- 172.21.15.80:0/714157235 >> v2:172.21.15.87:3300/0 conn(0x7f27400cec20 0x7f274015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27280039b0 0x7f2728003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273dd9b640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2728004800 0x7f2728004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273ed9d640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280051c0 0x7f272800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 -- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2728004800 msgr2=0x7f2728004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2728004800 0x7f2728004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 -- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280051c0 msgr2=0x7f272800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280051c0 0x7f272800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273e59c640 1 -- 172.21.15.80:0/714157235 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2728003520 con 0x7f27280039b0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.001+0000 7f273ed9d640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280051c0 0x7f272800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.002+0000 7f273e59c640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27280039b0 0x7f2728003dd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f27400b30d0 tx=0x7f2728005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b33c2dc99af3181 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.002+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27300097d0 con 0x7f27280039b0 2024-04-16T15:37:00.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.002+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2730004030 con 0x7f27280039b0 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.002+0000 7f273d59a640 1 -- 172.21.15.80:0/714157235 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730004400 con 0x7f27280039b0 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 -- 172.21.15.80:0/714157235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27280039b0 msgr2=0x7f2728003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 --2- 172.21.15.80:0/714157235 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27280039b0 0x7f2728003dd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f27400b30d0 tx=0x7f2728005830 comp rx=0 tx=0).stop 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f273ed9d640 1 -- 172.21.15.80:0/714157235 reap_dead start 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 -- 172.21.15.80:0/714157235 shutdown_connections 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 -- 172.21.15.80:0/714157235 >> 172.21.15.80:0/714157235 conn(0x7f27400b2940 msgr2=0x7f274006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 -- 172.21.15.80:0/714157235 shutdown_connections 2024-04-16T15:37:00.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.003+0000 7f2744d50640 1 -- 172.21.15.80:0/714157235 wait complete. 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.004+0000 7f2744d50640 1 Processor -- start 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.004+0000 7f2744d50640 1 -- start start 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280039b0 0x7f274013ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 0x7f2740158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f27401604b0 con 0x7f27401f2570 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2740160de0 con 0x7f27280039b0 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f2744d50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f2740160790 con 0x7f2740157df0 2024-04-16T15:37:00.008 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46632/0 (socket says 172.21.15.80:46632) 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 -- 172.21.15.80:0/3923924797 learned_addr learned my addr 172.21.15.80:0/3923924797 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273e59c640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280039b0 0x7f274013ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273dd9b640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 0x7f2740158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 -- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 msgr2=0x7f2740158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 0x7f2740158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 -- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280039b0 msgr2=0x7f274013ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280039b0 0x7f274013ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273ed9d640 1 -- 172.21.15.80:0/3923924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740158ab0 con 0x7f27401f2570 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.005+0000 7f273dd9b640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 0x7f2740158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f273ed9d640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2740073160 tx=0x7f27380115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738003990 con 0x7f27401f2570 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f273801b070 con 0x7f27401f2570 2024-04-16T15:37:00.009 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2740158d90 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738003bb0 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.006+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2740159350 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.007+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27400b59d0 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.007+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2738005d10 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.008+0000 7f272effd640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 0x7f272006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.008+0000 7f273e59c640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 0x7f272006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.008+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f273808c0d0 con 0x7f27401f2570 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.008+0000 7f273e59c640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 0x7f272006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2730035000 tx=0x7f2730030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.010 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.012+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2738025020 con 0x7f27401f2570 2024-04-16T15:37:00.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.191+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2740072a80 con 0x7f27401f2570 2024-04-16T15:37:00.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.191+0000 7f272effd640 1 -- 172.21.15.80:0/3923924797 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13104 (secure 0 0 0) 0x7f273805a6c0 con 0x7f27401f2570 2024-04-16T15:37:00.190 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:00.190 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":35,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:36:57.255285+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:37:00.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.193+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 msgr2=0x7f272006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.193+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 0x7f272006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2730035000 tx=0x7f2730030000 comp rx=0 tx=0).stop 2024-04-16T15:37:00.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.193+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 msgr2=0x7f27401f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.193+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2740073160 tx=0x7f27380115a0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 shutdown_connections 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f27401f2570 0x7f27401f29f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f272006c920 0x7f272006ede0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f2740157df0 0x7f2740158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 --2- 172.21.15.80:0/3923924797 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27280039b0 0x7f274013ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 >> 172.21.15.80:0/3923924797 conn(0x7f27400b2940 msgr2=0x7f2740142580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 shutdown_connections 2024-04-16T15:37:00.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.194+0000 7f2744d50640 1 -- 172.21.15.80:0/3923924797 wait complete. 2024-04-16T15:37:00.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T15:35:35.178881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T15:37:00.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T15:37:00.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.311+0000 7fce389e8640 1 Processor -- start 2024-04-16T15:37:00.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 -- start start 2024-04-16T15:37:00.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f070 0x7fce3406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 0x7fce3415f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce3415f990 0x7fce3406f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fce3406d350 con 0x7fce3415f990 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fce34159290 con 0x7fce340b47d0 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.312+0000 7fce389e8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fce3406cab0 con 0x7fce3415f070 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce3415f990 0x7fce3406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fce3415f990 0x7fce3406f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46634/0 (socket says 172.21.15.80:46634) 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 -- 172.21.15.80:0/383396497 learned_addr learned my addr 172.21.15.80:0/383396497 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce2bfff640 1 --2- 172.21.15.80:0/383396497 >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 0x7fce3415f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 -- 172.21.15.80:0/383396497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f070 msgr2=0x7fce3406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 --2- 172.21.15.80:0/383396497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f070 0x7fce3406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 -- 172.21.15.80:0/383396497 >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 msgr2=0x7fce3415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 --2- 172.21.15.80:0/383396497 >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 0x7fce3415f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce32d9d640 1 -- 172.21.15.80:0/383396497 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3406cd90 con 0x7fce3415f990 2024-04-16T15:37:00.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.313+0000 7fce2bfff640 1 --2- 172.21.15.80:0/383396497 >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 0x7fce3415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce32d9d640 1 --2- 172.21.15.80:0/383396497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f990 0x7fce3406f090 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce34067fc0 tx=0x7fce2c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f1c5d8662161a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce31d9b640 1 -- 172.21.15.80:0/383396497 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c02c9e0 con 0x7fce3415f990 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce31d9b640 1 -- 172.21.15.80:0/383396497 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c02cb80 con 0x7fce3415f990 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce31d9b640 1 -- 172.21.15.80:0/383396497 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0343f0 con 0x7fce3415f990 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 -- 172.21.15.80:0/383396497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f990 msgr2=0x7fce3406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 --2- 172.21.15.80:0/383396497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f990 0x7fce3406f090 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce34067fc0 tx=0x7fce2c02be40 comp rx=0 tx=0).stop 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 -- 172.21.15.80:0/383396497 shutdown_connections 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 --2- 172.21.15.80:0/383396497 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f990 0x7fce3406f090 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 --2- 172.21.15.80:0/383396497 >> v2:172.21.15.87:3300/0 conn(0x7fce340b47d0 0x7fce3415f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 --2- 172.21.15.80:0/383396497 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f070 0x7fce3406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 -- 172.21.15.80:0/383396497 >> 172.21.15.80:0/383396497 conn(0x7fce340d0c30 msgr2=0x7fce340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 -- 172.21.15.80:0/383396497 shutdown_connections 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.314+0000 7fce389e8640 1 -- 172.21.15.80:0/383396497 wait complete. 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 Processor -- start 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 -- start start 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce340b47d0 0x7fce3415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f990 0x7fce341598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fce340b4c30 con 0x7fce3415f070 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce3406eb70 con 0x7fce340b47d0 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce389e8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fce3415eba0 con 0x7fce3415f990 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46648/0 (socket says 172.21.15.80:46648) 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.316+0000 7fce2bfff640 1 -- 172.21.15.80:0/2885336701 learned_addr learned my addr 172.21.15.80:0/2885336701 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 -- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f990 msgr2=0x7fce341598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f990 0x7fce341598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 -- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce340b47d0 msgr2=0x7fce3415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce340b47d0 0x7fce3415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 -- 172.21.15.80:0/2885336701 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce34157750 con 0x7fce3415f070 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2bfff640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c820 tx=0x7fce1c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c015070 con 0x7fce3415f070 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c007a30 con 0x7fce3415f070 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3415e8c0 con 0x7fce3415f070 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007e00 con 0x7fce3415f070 2024-04-16T15:37:00.318 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.317+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce341e8410 con 0x7fce3415f070 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.318+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce341e8840 con 0x7fce3415f070 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.318+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce1c018070 con 0x7fce3415f070 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.319+0000 7fce2affd640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 0x7fce1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.319+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fce1c08b8d0 con 0x7fce3415f070 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.319+0000 7fce3259c640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 0x7fce1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.319 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.319+0000 7fce3259c640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 0x7fce1406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce340cee30 tx=0x7fce24006c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.323+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce1c059f50 con 0x7fce3415f070 2024-04-16T15:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.497+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce34068a40 con 0x7fce3415f070 2024-04-16T15:37:00.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.497+0000 7fce2affd640 1 -- 172.21.15.80:0/2885336701 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fce1c059850 con 0x7fce3415f070 2024-04-16T15:37:00.496 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-04-16T15:37:00.497 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 msgr2=0x7fce1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 0x7fce1406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce340cee30 tx=0x7fce24006c90 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 msgr2=0x7fce341579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c820 tx=0x7fce1c00cc20 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 shutdown_connections 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1406c8f0 0x7fce1406edb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce3415f990 0x7fce341598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce3415f070 0x7fce341579a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 --2- 172.21.15.80:0/2885336701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce340b47d0 0x7fce3415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 >> 172.21.15.80:0/2885336701 conn(0x7fce340d0c30 msgr2=0x7fce34158940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 shutdown_connections 2024-04-16T15:37:00.498 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.499+0000 7fce389e8640 1 -- 172.21.15.80:0/2885336701 wait complete. 2024-04-16T15:37:00.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T15:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.614+0000 7f653300d640 1 Processor -- start 2024-04-16T15:37:00.612 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.614+0000 7f653300d640 1 -- start start 2024-04-16T15:37:00.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f653300d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c15ecc0 0x7f652c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f653300d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f652c0b4d80 0x7f652c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f653300d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0b29f0 con 0x7f652c0b2580 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f653300d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f652c09be20 con 0x7f652c0b4d80 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f653300d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f652c0b3960 con 0x7f652c15ecc0 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f652c0b4d80 0x7f652c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f652c0b4d80 0x7f652c0b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46650/0 (socket says 172.21.15.80:46650) 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 -- 172.21.15.80:0/449942198 learned_addr learned my addr 172.21.15.80:0/449942198 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 -- 172.21.15.80:0/449942198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c15ecc0 msgr2=0x7f652c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 --2- 172.21.15.80:0/449942198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c15ecc0 0x7f652c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 -- 172.21.15.80:0/449942198 >> v1:172.21.15.87:6789/0 conn(0x7f652c0b2580 legacy=0x7f652c0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.614 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.615+0000 7f652bfff640 1 -- 172.21.15.80:0/449942198 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0b3c00 con 0x7f652c0b4d80 2024-04-16T15:37:00.615 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.616+0000 7f652bfff640 1 --2- 172.21.15.80:0/449942198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c0b2040 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ea734a44c84065 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.616+0000 7f652b7fe640 1 -- 172.21.15.80:0/449942198 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518034070 con 0x7f652c0b4d80 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.616+0000 7f652b7fe640 1 -- 172.21.15.80:0/449942198 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518030840 con 0x7f652c0b4d80 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.616+0000 7f652b7fe640 1 -- 172.21.15.80:0/449942198 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518030c10 con 0x7f652c0b4d80 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 -- 172.21.15.80:0/449942198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 msgr2=0x7f652c0b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 --2- 172.21.15.80:0/449942198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c0b2040 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f651802b980 comp rx=0 tx=0).stop 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 -- 172.21.15.80:0/449942198 shutdown_connections 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 --2- 172.21.15.80:0/449942198 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c0b2040 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 --2- 172.21.15.80:0/449942198 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c15ecc0 0x7f652c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 -- 172.21.15.80:0/449942198 >> 172.21.15.80:0/449942198 conn(0x7f652c0b4030 msgr2=0x7f652c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 -- 172.21.15.80:0/449942198 shutdown_connections 2024-04-16T15:37:00.616 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.617+0000 7f653300d640 1 -- 172.21.15.80:0/449942198 wait complete. 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.618+0000 7f653300d640 1 Processor -- start 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.618+0000 7f653300d640 1 -- start start 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 0x7f652c09ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 0x7f652c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f652c15f0a0 con 0x7f652c0b4d80 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f652c09b900 con 0x7f652c15ecc0 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f653300d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f652c06e080 con 0x7f652c0b2580 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46664/0 (socket says 172.21.15.80:46664) 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 -- 172.21.15.80:0/783805119 learned_addr learned my addr 172.21.15.80:0/783805119 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f65315aa640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 0x7f652c152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.619 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 -- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 msgr2=0x7f652c09ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f6530da9640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 0x7f652c09ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 0x7f652c09ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 -- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 msgr2=0x7f652c152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 0x7f652c152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 -- 172.21.15.80:0/783805119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c1f5550 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f65315aa640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 0x7f652c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f6530da9640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 0x7f652c09ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.619+0000 7f652bfff640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f6518004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.620+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518048070 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.620+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518030640 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.620+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518034040 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.620+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c09f480 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.620+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c09fa40 con 0x7f652c0b4d80 2024-04-16T15:37:00.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.621+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c068a40 con 0x7f652c0b4d80 2024-04-16T15:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.621+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f651804b070 con 0x7f652c0b4d80 2024-04-16T15:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.621+0000 7f65297fa640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 0x7f651006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.622+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f65180ada60 con 0x7f652c0b4d80 2024-04-16T15:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.622+0000 7f6530da9640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 0x7f651006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.621 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.622+0000 7f6530da9640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 0x7f651006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6520006fd0 tx=0x7f6520008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.624 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.626+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f652c1f5550 con 0x7f652c0b4d80 2024-04-16T15:37:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.802+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f652c152fb0 con 0x7f652c0b4d80 2024-04-16T15:37:00.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.803+0000 7f65297fa640 1 -- 172.21.15.80:0/783805119 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f651807c110 con 0x7f652c0b4d80 2024-04-16T15:37:00.801 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:00.801 INFO:teuthology.orchestra.run.smithi080.stdout:[ 2024-04-16T15:37:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-04-16T15:37:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "poolnum": 1, 2024-04-16T15:37:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: "poolname": ".mgr" 2024-04-16T15:37:00.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-04-16T15:37:00.802 INFO:teuthology.orchestra.run.smithi080.stdout:] 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 msgr2=0x7f651006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 0x7f651006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6520006fd0 tx=0x7f6520008040 comp rx=0 tx=0).stop 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 msgr2=0x7f652c1f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6518009870 tx=0x7f6518004730 comp rx=0 tx=0).stop 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 shutdown_connections 2024-04-16T15:37:00.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f652c15ecc0 0x7f652c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f652c0b4d80 0x7f652c1f5010 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f651006c8f0 0x7f651006edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 --2- 172.21.15.80:0/783805119 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f652c0b2580 0x7f652c09ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 >> 172.21.15.80:0/783805119 conn(0x7f652c0b4030 msgr2=0x7f652c0d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 shutdown_connections 2024-04-16T15:37:00.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.805+0000 7f653300d640 1 -- 172.21.15.80:0/783805119 wait complete. 2024-04-16T15:37:00.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T15:37:00.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T15:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.923+0000 7f087ee47640 1 Processor -- start 2024-04-16T15:37:00.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.923+0000 7f087ee47640 1 -- start start 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087ee47640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f087809b1a0 0x7f08780d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087ee47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f087809b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087ee47640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08780d0bc0 con 0x7f087809b580 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087ee47640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f08780d0ea0 con 0x7f087809b1a0 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087ee47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f08780d1180 con 0x7f0878162c10 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f086ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f087809b580 0x7f0878162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32790/0 (socket says 172.21.15.80:32790) 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f086ffff640 1 -- 172.21.15.80:0/4265060471 learned_addr learned my addr 172.21.15.80:0/4265060471 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.924+0000 7f087cbe3640 1 --2- 172.21.15.80:0/4265060471 >> v2:172.21.15.87:3300/0 conn(0x7f087809b1a0 0x7f08780d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f087809b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259360808 0 0) 0x7f08780d0bc0 con 0x7f087809b580 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0860003520 con 0x7f087809b580 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909784987 0 0) 0x7f0860003520 con 0x7f087809b580 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 msgr2=0x7f087809b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f087809b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 >> v2:172.21.15.87:3300/0 conn(0x7f087809b1a0 msgr2=0x7f08780d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 --2- 172.21.15.80:0/4265060471 >> v2:172.21.15.87:3300/0 conn(0x7f087809b1a0 0x7f08780d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08780d1460 con 0x7f087809b580 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f0868001670 con 0x7f087809b580 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 >> v1:172.21.15.80:6789/0 conn(0x7f087809b580 legacy=0x7f0878162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08600039b0 0x7f0860003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f0860004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f08780d0ea0 con 0x7f0860004d40 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f08780d1180 con 0x7f08600039b0 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f086000b9c0 con 0x7f0878162c10 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087cbe3640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08600039b0 0x7f0860003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f086ffff640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f0860004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 -- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 msgr2=0x7f0860004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0878162c10 0x7f0860004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 -- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08600039b0 msgr2=0x7f0860003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08600039b0 0x7f0860003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.925+0000 7f087d3e4640 1 -- 172.21.15.80:0/4265060471 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0860003520 con 0x7f0860004d40 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.926+0000 7f087d3e4640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08600051c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fc0 tx=0x7f0860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb49e80f954a30b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.926+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870039070 con 0x7f0860004d40 2024-04-16T15:37:00.928 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.926+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087002cc00 con 0x7f0860004d40 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.926+0000 7f086f7fe640 1 -- 172.21.15.80:0/4265060471 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870009c10 con 0x7f0860004d40 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 -- 172.21.15.80:0/4265060471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 msgr2=0x7f08600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 --2- 172.21.15.80:0/4265060471 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08600051c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0870009fc0 tx=0x7f0860005830 comp rx=0 tx=0).stop 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087d3e4640 1 -- 172.21.15.80:0/4265060471 reap_dead start 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 -- 172.21.15.80:0/4265060471 shutdown_connections 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 -- 172.21.15.80:0/4265060471 >> 172.21.15.80:0/4265060471 conn(0x7f08780b3fa0 msgr2=0x7f08780b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 -- 172.21.15.80:0/4265060471 shutdown_connections 2024-04-16T15:37:00.929 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.927+0000 7f087ee47640 1 -- 172.21.15.80:0/4265060471 wait complete. 2024-04-16T15:37:00.931 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.928+0000 7f087ee47640 1 Processor -- start 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.928+0000 7f087ee47640 1 -- start start 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f087815eb40 0x7f087815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f087815a030 0x7f087815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f087809bd80 con 0x7f0860004d40 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f087809bc00 con 0x7f087815a030 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087ee47640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f087815e120 con 0x7f087815eb40 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46684/0 (socket says 172.21.15.80:46684) 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 -- 172.21.15.80:0/176132133 learned_addr learned my addr 172.21.15.80:0/176132133 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 -- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f087815eb40 msgr2=0x7f087815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f087815eb40 0x7f087815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 -- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f087815a030 msgr2=0x7f087815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f087815a030 0x7f087815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 -- 172.21.15.80:0/176132133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087815ad40 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f087cbe3640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0874011990 tx=0x7f0874011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.929+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087400fa50 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.930+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087400fbf0 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.930+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874014440 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.930+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08780af990 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.930+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08780aff50 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.931+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0878068a40 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.931+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0874012040 con 0x7f0860004d40 2024-04-16T15:37:00.933 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.932+0000 7f086d7fa640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 0x7f086406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.932+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f087408c020 con 0x7f0860004d40 2024-04-16T15:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.932+0000 7f086ffff640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 0x7f086406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.932+0000 7f086ffff640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 0x7f086406ede0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0868000f60 tx=0x7f0868000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:00.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:00.936+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0874019030 con 0x7f0860004d40 2024-04-16T15:37:01.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.112+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f08780b4e00 con 0x7f0860004d40 2024-04-16T15:37:01.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.256+0000 7f086d7fa640 1 -- 172.21.15.80:0/176132133 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f087405a610 con 0x7f0860004d40 2024-04-16T15:37:01.255 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_metadata' created 2024-04-16T15:37:01.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.259+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 msgr2=0x7f086406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.259+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 0x7f086406ede0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0868000f60 tx=0x7f0868000ed0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.259+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 msgr2=0x7f08780c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.259+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0874011990 tx=0x7f0874011e50 comp rx=0 tx=0).stop 2024-04-16T15:37:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 shutdown_connections 2024-04-16T15:37:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f087815a030 0x7f087815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f086406c920 0x7f086406ede0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f087815eb40 0x7f087815efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 --2- 172.21.15.80:0/176132133 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0860004d40 0x7f08780c8880 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.261+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 >> 172.21.15.80:0/176132133 conn(0x7f08780b3fa0 msgr2=0x7f087806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:01.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.262+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 shutdown_connections 2024-04-16T15:37:01.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.262+0000 7f087ee47640 1 -- 172.21.15.80:0/176132133 wait complete. 2024-04-16T15:37:01.273 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T15:37:01.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.385+0000 7ff111241640 1 Processor -- start 2024-04-16T15:37:01.384 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.385+0000 7ff111241640 1 -- start start 2024-04-16T15:37:01.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff111241640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff10c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff111241640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c1610b0 con 0x7ff10c0cd430 2024-04-16T15:37:01.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff111241640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c0b2010 con 0x7ff10c09b180 2024-04-16T15:37:01.387 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff111241640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c0b22f0 con 0x7ff10c15fe70 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff10a59c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff10c0cd430 0x7ff10c09aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32792/0 (socket says 172.21.15.80:32792) 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff10a59c640 1 -- 172.21.15.80:0/2359453528 learned_addr learned my addr 172.21.15.80:0/2359453528 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff10ad9d640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff10c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208047496 0 0) 0x7ff10c1610b0 con 0x7ff10c0cd430 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.386+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f4003520 con 0x7ff10c0cd430 2024-04-16T15:37:01.388 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3230796445 0 0) 0x7ff0f4003520 con 0x7ff10c0cd430 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 msgr2=0x7ff10c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff10c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 >> v1:172.21.15.87:6789/0 conn(0x7ff10c09b180 legacy=0x7ff10c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c160d80 con 0x7ff10c0cd430 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7ff100001670 con 0x7ff10c0cd430 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 >> v1:172.21.15.80:6789/0 conn(0x7ff10c0cd430 legacy=0x7ff10c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff0f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff0f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f4004d40 0x7ff0f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0b22f0 con 0x7ff0f4003f20 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f400ba20 con 0x7ff0f4004d40 2024-04-16T15:37:01.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f400bc20 con 0x7ff10c15fe70 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff0f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10b59e640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f4004d40 0x7ff0f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10ad9d640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff0f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 -- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 msgr2=0x7ff0f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c15fe70 0x7ff0f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 -- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f4004d40 msgr2=0x7ff0f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f4004d40 0x7ff0f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10a59c640 1 -- 172.21.15.80:0/2359453528 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f4003520 con 0x7ff0f4003f20 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.387+0000 7ff10b59e640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0f4004d40 0x7ff0f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff10a59c640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff0f4004800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c190 tx=0x7ff0f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdf01c61462ef7a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100007cc0 con 0x7ff0f4003f20 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff100030070 con 0x7ff0f4003f20 2024-04-16T15:37:01.390 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff109d9b640 1 -- 172.21.15.80:0/2359453528 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100005d50 con 0x7ff0f4003f20 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff111241640 1 -- 172.21.15.80:0/2359453528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 msgr2=0x7ff0f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff111241640 1 --2- 172.21.15.80:0/2359453528 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff0f4004800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c190 tx=0x7ff0f4005830 comp rx=0 tx=0).stop 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff10b59e640 1 -- 172.21.15.80:0/2359453528 reap_dead start 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff111241640 1 -- 172.21.15.80:0/2359453528 shutdown_connections 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.388+0000 7ff111241640 1 -- 172.21.15.80:0/2359453528 >> 172.21.15.80:0/2359453528 conn(0x7ff10c0d2550 msgr2=0x7ff10c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.389+0000 7ff111241640 1 -- 172.21.15.80:0/2359453528 shutdown_connections 2024-04-16T15:37:01.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.389+0000 7ff111241640 1 -- 172.21.15.80:0/2359453528 wait complete. 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.390+0000 7ff111241640 1 Processor -- start 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.390+0000 7ff111241640 1 -- start start 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0ca030 0x7ff10c0ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c158a10 0x7ff10c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0b3b20 con 0x7ff0f4003f20 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0b39a0 con 0x7ff10c158a10 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c0b3ca0 con 0x7ff10c0ca030 2024-04-16T15:37:01.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46696/0 (socket says 172.21.15.80:46696) 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 -- 172.21.15.80:0/4116703205 learned_addr learned my addr 172.21.15.80:0/4116703205 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10b59e640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c158a10 0x7ff10c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10a59c640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0ca030 0x7ff10c0ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 -- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0ca030 msgr2=0x7ff10c0ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0ca030 0x7ff10c0ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 -- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c158a10 msgr2=0x7ff10c158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c158a10 0x7ff10c158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 -- 172.21.15.80:0/4116703205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c0caab0 con 0x7ff0f4003f20 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff10ad9d640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007f30 tx=0x7ff0fc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc01a020 con 0x7ff0f4003f20 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc016470 con 0x7ff0f4003f20 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c0cad90 con 0x7ff0f4003f20 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.391+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc016860 con 0x7ff0f4003f20 2024-04-16T15:37:01.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.392+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c0cb350 con 0x7ff0f4003f20 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.392+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10c068a40 con 0x7ff0f4003f20 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.393+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0fc005d10 con 0x7ff0f4003f20 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.394+0000 7ff0f37fe640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 0x7ff0f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.394+0000 7ff10a59c640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 0x7ff0f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.394+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7ff0fc08ca40 con 0x7ff0f4003f20 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.394+0000 7ff10a59c640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 0x7ff0f806ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff100034000 tx=0x7ff100009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:01.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.398+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0fc024030 con 0x7ff0f4003f20 2024-04-16T15:37:01.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:01.575+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff10c0b84d0 con 0x7ff0f4003f20 2024-04-16T15:37:02.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.258+0000 7ff0f37fe640 1 -- 172.21.15.80:0/4116703205 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7ff0fc08ce20 con 0x7ff0f4003f20 2024-04-16T15:37:02.257 INFO:teuthology.orchestra.run.smithi080.stderr:pool 'cephfs_data' created 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.260+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 msgr2=0x7ff0f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.260+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 0x7ff0f806ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff100034000 tx=0x7ff100009030 comp rx=0 tx=0).stop 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.260+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 msgr2=0x7ff10c153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.260+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007f30 tx=0x7ff0fc011660 comp rx=0 tx=0).stop 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.260+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 shutdown_connections 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff10c158a10 0x7ff10c158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff0f806c920 0x7ff0f806ede0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff10c0ca030 0x7ff10c0ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.260 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 --2- 172.21.15.80:0/4116703205 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0f4003f20 0x7ff10c153c20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 >> 172.21.15.80:0/4116703205 conn(0x7ff10c0d2550 msgr2=0x7ff10c160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 shutdown_connections 2024-04-16T15:37:02.261 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.261+0000 7ff111241640 1 -- 172.21.15.80:0/4116703205 wait complete. 2024-04-16T15:37:02.285 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T15:37:02.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.395+0000 7f0ed3288640 1 Processor -- start 2024-04-16T15:37:02.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.396+0000 7f0ed3288640 1 -- start start 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.396+0000 7f0ed3288640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f0ecc145020 0x7f0ecc06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed3288640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc15bd50 con 0x7f0ecc06f480 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed3288640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc15c030 con 0x7f0ecc0cd9f0 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed3288640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc15c310 con 0x7f0ecc145020 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed0823640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f0ecc06f480 0x7f0ecc0cd2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32798/0 (socket says 172.21.15.80:32798) 2024-04-16T15:37:02.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed0823640 1 -- 172.21.15.80:0/3566508096 learned_addr learned my addr 172.21.15.80:0/3566508096 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:02.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed1024640 1 --2- 172.21.15.80:0/3566508096 >> v2:172.21.15.80:3300/0 conn(0x7f0ecc145020 0x7f0ecc06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:02.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed1024640 1 -- 172.21.15.80:0/3566508096 >> v1:172.21.15.87:6789/0 conn(0x7f0ecc0cd9f0 legacy=0x7f0ecc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:02.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed1024640 1 -- 172.21.15.80:0/3566508096 >> v1:172.21.15.80:6789/0 conn(0x7f0ecc06f480 legacy=0x7f0ecc0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.397+0000 7f0ed1024640 1 -- 172.21.15.80:0/3566508096 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc15c5f0 con 0x7f0ecc145020 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ed1024640 1 --2- 172.21.15.80:0/3566508096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc06ef40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80097a0 tx=0x7f0ec802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c0cedb9597796e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ec3fff640 1 -- 172.21.15.80:0/3566508096 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8035020 con 0x7f0ecc145020 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ec3fff640 1 -- 172.21.15.80:0/3566508096 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec8031830 con 0x7f0ecc145020 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ec3fff640 1 -- 172.21.15.80:0/3566508096 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8031c00 con 0x7f0ecc145020 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ed3288640 1 -- 172.21.15.80:0/3566508096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 msgr2=0x7f0ecc06ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.398+0000 7f0ed3288640 1 --2- 172.21.15.80:0/3566508096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc06ef40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80097a0 tx=0x7f0ec802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.399+0000 7f0ed3288640 1 -- 172.21.15.80:0/3566508096 shutdown_connections 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.399+0000 7f0ed3288640 1 --2- 172.21.15.80:0/3566508096 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc06ef40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.399+0000 7f0ed3288640 1 -- 172.21.15.80:0/3566508096 >> 172.21.15.80:0/3566508096 conn(0x7f0ecc067d90 msgr2=0x7f0ecc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:02.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.399+0000 7f0ed3288640 1 -- 172.21.15.80:0/3566508096 shutdown_connections 2024-04-16T15:37:02.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.399+0000 7f0ed3288640 1 -- 172.21.15.80:0/3566508096 wait complete. 2024-04-16T15:37:02.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.400+0000 7f0ed3288640 1 Processor -- start 2024-04-16T15:37:02.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.400+0000 7f0ed3288640 1 -- start start 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.400+0000 7f0ed3288640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ecc06f480 0x7f0ecc13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.400+0000 7f0ed3288640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ecc0cd9f0 0x7f0ecc071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc15fac0 con 0x7f0ecc145020 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc15f940 con 0x7f0ecc0cd9f0 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc15fc40 con 0x7f0ecc06f480 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46718/0 (socket says 172.21.15.80:46718) 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 -- 172.21.15.80:0/1551467891 learned_addr learned my addr 172.21.15.80:0/1551467891 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed0823640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ecc0cd9f0 0x7f0ecc071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:02.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 -- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ecc06f480 msgr2=0x7f0ecc13b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ecc06f480 0x7f0ecc13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 -- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ecc0cd9f0 msgr2=0x7f0ecc071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ecc0cd9f0 0x7f0ecc071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 -- 172.21.15.80:0/1551467891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc143f80 con 0x7f0ecc145020 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed1825640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c780 tx=0x7f0ec400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4004b60 con 0x7f0ecc145020 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4004d00 con 0x7f0ecc145020 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc1f5df0 con 0x7f0ecc145020 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400aa90 con 0x7f0ecc145020 2024-04-16T15:37:02.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.401+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc1f63b0 con 0x7f0ecc145020 2024-04-16T15:37:02.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.402+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc068a40 con 0x7f0ecc145020 2024-04-16T15:37:02.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.403+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ec400ac30 con 0x7f0ecc145020 2024-04-16T15:37:02.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.403+0000 7f0ec1ffb640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 0x7f0eb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:02.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.403+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f0ec408be90 con 0x7f0ecc145020 2024-04-16T15:37:02.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.403+0000 7f0ed1024640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 0x7f0eb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:02.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.404+0000 7f0ed1024640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 0x7f0eb006edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8036000 tx=0x7f0ec8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:02.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.408+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ec4020070 con 0x7f0ecc145020 2024-04-16T15:37:02.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:02.623+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0ecc1f6580 con 0x7f0ecc145020 2024-04-16T15:37:03.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.281+0000 7f0ec1ffb640 1 -- 172.21.15.80:0/1551467891 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f0ec405a220 con 0x7f0ecc145020 2024-04-16T15:37:03.281 INFO:teuthology.orchestra.run.smithi080.stderr:new fs with metadata pool 5 and data pool 6 2024-04-16T15:37:03.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.291+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 msgr2=0x7f0eb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.291+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 0x7f0eb006edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8036000 tx=0x7f0ec8030000 comp rx=0 tx=0).stop 2024-04-16T15:37:03.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.291+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 msgr2=0x7f0ecc072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.291+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c780 tx=0x7f0ec400cc40 comp rx=0 tx=0).stop 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.294+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 shutdown_connections 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.294+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ecc145020 0x7f0ecc072310 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.294+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ecc0cd9f0 0x7f0ecc071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.295+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f0eb006c8f0 0x7f0eb006edb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.295+0000 7f0ed3288640 1 --2- 172.21.15.80:0/1551467891 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f0ecc06f480 0x7f0ecc13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.295+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 >> 172.21.15.80:0/1551467891 conn(0x7f0ecc067d90 msgr2=0x7f0ecc0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:03.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.296+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 shutdown_connections 2024-04-16T15:37:03.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.296+0000 7f0ed3288640 1 -- 172.21.15.80:0/1551467891 wait complete. 2024-04-16T15:37:03.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:37:03.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.417+0000 7fdd6b647640 1 Processor -- start 2024-04-16T15:37:03.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.417+0000 7fdd6b647640 1 -- start start 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd6415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdd6415ef80 0x7fdd640cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd64163350 0x7fdd640d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fdd64162900 con 0x7fdd64163350 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fdd64162ec0 con 0x7fdd6415ef80 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd6b647640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fdd640d1d70 con 0x7fdd640d1450 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd69be4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd64163350 0x7fdd640d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.418+0000 7fdd69be4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fdd64163350 0x7fdd640d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46734/0 (socket says 172.21.15.80:46734) 2024-04-16T15:37:03.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 -- 172.21.15.80:0/1985742077 learned_addr learned my addr 172.21.15.80:0/1985742077 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd68be2640 1 --2- 172.21.15.80:0/1985742077 >> v2:172.21.15.87:3300/0 conn(0x7fdd6415ef80 0x7fdd640cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd693e3640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd6415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 -- 172.21.15.80:0/1985742077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 msgr2=0x7fdd6415fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd6415fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 -- 172.21.15.80:0/1985742077 >> v2:172.21.15.87:3300/0 conn(0x7fdd6415ef80 msgr2=0x7fdd640cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 --2- 172.21.15.80:0/1985742077 >> v2:172.21.15.87:3300/0 conn(0x7fdd6415ef80 0x7fdd640cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 -- 172.21.15.80:0/1985742077 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd640cfeb0 con 0x7fdd64163350 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.419+0000 7fdd69be4640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640d1830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdd640b7220 tx=0x7fdd5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e92ad87454e825 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd63fff640 1 -- 172.21.15.80:0/1985742077 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c02e070 con 0x7fdd64163350 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd63fff640 1 -- 172.21.15.80:0/1985742077 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c037070 con 0x7fdd64163350 2024-04-16T15:37:03.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd63fff640 1 -- 172.21.15.80:0/1985742077 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c031a00 con 0x7fdd64163350 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 -- 172.21.15.80:0/1985742077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 msgr2=0x7fdd640d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640d1830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdd640b7220 tx=0x7fdd5c02b880 comp rx=0 tx=0).stop 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 -- 172.21.15.80:0/1985742077 shutdown_connections 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640d1830 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 --2- 172.21.15.80:0/1985742077 >> v2:172.21.15.87:3300/0 conn(0x7fdd6415ef80 0x7fdd640cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 --2- 172.21.15.80:0/1985742077 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd6415fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 -- 172.21.15.80:0/1985742077 >> 172.21.15.80:0/1985742077 conn(0x7fdd6406ce20 msgr2=0x7fdd6406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 -- 172.21.15.80:0/1985742077 shutdown_connections 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.420+0000 7fdd6b647640 1 -- 172.21.15.80:0/1985742077 wait complete. 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 Processor -- start 2024-04-16T15:37:03.423 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 -- start start 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd640cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd6415ef80 0x7fdd640c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fdd641637c0 con 0x7fdd64163350 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64162b50 con 0x7fdd6415ef80 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd6b647640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fdd640d2ff0 con 0x7fdd640d1450 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd69be4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd69be4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46738/0 (socket says 172.21.15.80:46738) 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd69be4640 1 -- 172.21.15.80:0/712462615 learned_addr learned my addr 172.21.15.80:0/712462615 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd68be2640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd6415ef80 0x7fdd640c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.422+0000 7fdd693e3640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd640cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 -- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 msgr2=0x7fdd640cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd640cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 -- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd6415ef80 msgr2=0x7fdd640c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd6415ef80 0x7fdd640c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 -- 172.21.15.80:0/712462615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd640c9930 con 0x7fdd64163350 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd693e3640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd640cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd69be4640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0090b0 tx=0x7fdd5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032670 con 0x7fdd64163350 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c032830 con 0x7fdd64163350 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd640cd3b0 con 0x7fdd64163350 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032c20 con 0x7fdd64163350 2024-04-16T15:37:03.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.423+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd640cc0b0 con 0x7fdd64163350 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.424+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd64068a40 con 0x7fdd64163350 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.425+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd5c04c060 con 0x7fdd64163350 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.425+0000 7fdd61ffb640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.425+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdd5c0ad610 con 0x7fdd64163350 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.425+0000 7fdd693e3640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.425+0000 7fdd693e3640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 0x7fdd5006edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009aa0 tx=0x7fdd540039f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.429+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd5c040070 con 0x7fdd64163350 2024-04-16T15:37:03.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.607+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd640d2920 con 0x7fdd64163350 2024-04-16T15:37:03.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.608+0000 7fdd61ffb640 1 -- 172.21.15.80:0/712462615 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16895 (secure 0 0 0) 0x7fdd5c07ba60 con 0x7fdd64163350 2024-04-16T15:37:03.608 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:03.608 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:37:02.624971+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:37:01.116058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T15:37:01.579531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 msgr2=0x7fdd5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 0x7fdd5006edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009aa0 tx=0x7fdd540039f0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 msgr2=0x7fdd640cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0090b0 tx=0x7fdd5c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 shutdown_connections 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fdd64163350 0x7fdd640cce70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdd6415ef80 0x7fdd640c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fdd5006c8f0 0x7fdd5006edb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 --2- 172.21.15.80:0/712462615 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fdd640d1450 0x7fdd640cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 >> 172.21.15.80:0/712462615 conn(0x7fdd6406ce20 msgr2=0x7fdd6406d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 shutdown_connections 2024-04-16T15:37:03.610 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.610+0000 7fdd6b647640 1 -- 172.21.15.80:0/712462615 wait complete. 2024-04-16T15:37:03.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:37:03.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.724+0000 7fe6329d4640 1 Processor -- start 2024-04-16T15:37:03.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.724+0000 7fe6329d4640 1 -- start start 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe6329d4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe62c0b6030 0x7fe62c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe6329d4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe62c0cea50 0x7fe62c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe6329d4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62c161270 con 0x7fe62c13f7c0 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe6329d4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c0a95e0 con 0x7fe62c0b6030 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe6329d4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c160de0 con 0x7fe62c0cea50 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe62b7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe62c0b6030 0x7fe62c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe62bfff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe62c13f7c0 0x7fe62c0b5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:32806/0 (socket says 172.21.15.80:32806) 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe62bfff640 1 -- 172.21.15.80:0/444298483 learned_addr learned my addr 172.21.15.80:0/444298483 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.725+0000 7fe630f71640 1 --2- 172.21.15.80:0/444298483 >> v2:172.21.15.87:3300/0 conn(0x7fe62c0cea50 0x7fe62c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62b7fe640 1 -- 172.21.15.80:0/444298483 >> v2:172.21.15.87:3300/0 conn(0x7fe62c0cea50 msgr2=0x7fe62c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62b7fe640 1 --2- 172.21.15.80:0/444298483 >> v2:172.21.15.87:3300/0 conn(0x7fe62c0cea50 0x7fe62c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62b7fe640 1 -- 172.21.15.80:0/444298483 >> v1:172.21.15.80:6789/0 conn(0x7fe62c13f7c0 legacy=0x7fe62c0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62affd640 1 -- 172.21.15.80:0/444298483 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615222647 0 0) 0x7fe62c161270 con 0x7fe62c13f7c0 2024-04-16T15:37:03.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62b7fe640 1 -- 172.21.15.80:0/444298483 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c13fe10 con 0x7fe62c0b6030 2024-04-16T15:37:03.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62b7fe640 1 --2- 172.21.15.80:0/444298483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c0b6030 0x7fe62c0ce510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe62c15a8f0 tx=0x7fe62002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4333fd32079911fc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62affd640 1 -- 172.21.15.80:0/444298483 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620034070 con 0x7fe62c0b6030 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.726+0000 7fe62affd640 1 -- 172.21.15.80:0/444298483 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe620030610 con 0x7fe62c0b6030 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe62affd640 1 -- 172.21.15.80:0/444298483 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200309e0 con 0x7fe62c0b6030 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 -- 172.21.15.80:0/444298483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c0b6030 msgr2=0x7fe62c0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 --2- 172.21.15.80:0/444298483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c0b6030 0x7fe62c0ce510 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe62c15a8f0 tx=0x7fe62002b960 comp rx=0 tx=0).stop 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 -- 172.21.15.80:0/444298483 shutdown_connections 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 --2- 172.21.15.80:0/444298483 >> v2:172.21.15.87:3300/0 conn(0x7fe62c0cea50 0x7fe62c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 --2- 172.21.15.80:0/444298483 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c0b6030 0x7fe62c0ce510 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 -- 172.21.15.80:0/444298483 >> 172.21.15.80:0/444298483 conn(0x7fe62c0b2940 msgr2=0x7fe62c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 -- 172.21.15.80:0/444298483 shutdown_connections 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.727+0000 7fe6329d4640 1 -- 172.21.15.80:0/444298483 wait complete. 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.728+0000 7fe6329d4640 1 Processor -- start 2024-04-16T15:37:03.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.728+0000 7fe6329d4640 1 -- start start 2024-04-16T15:37:03.731 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe62c0b6030 0x7fe62c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 0x7fe62c1e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c160790 con 0x7fe62c13f7c0 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1604b0 con 0x7fe62c0cea50 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe6329d4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c160a70 con 0x7fe62c0b6030 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46752/0 (socket says 172.21.15.80:46752) 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 -- 172.21.15.80:0/663128263 learned_addr learned my addr 172.21.15.80:0/663128263 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe62b7fe640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 0x7fe62c1e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe62bfff640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe62c0b6030 0x7fe62c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 -- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe62c0b6030 msgr2=0x7fe62c13eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe62c0b6030 0x7fe62c13eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 -- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 msgr2=0x7fe62c1e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.732 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.729+0000 7fe630f71640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 0x7fe62c1e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe630f71640 1 -- 172.21.15.80:0/663128263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c1f38b0 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe62b7fe640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 0x7fe62c1e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe630f71640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe62400efc0 tx=0x7fe62400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624018020 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe624014480 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c1f3b90 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624014870 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.730+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c13f040 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.731+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c06ecb0 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.731+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe624005d10 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.732+0000 7fe628ff9640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 0x7fe61806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.732+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe62408c750 con 0x7fe62c13f7c0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.732+0000 7fe62bfff640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 0x7fe61806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:03.733 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.732+0000 7fe62bfff640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 0x7fe61806edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe61c000f60 tx=0x7fe61c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:03.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.736+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe62c06ecb0 con 0x7fe62c13f7c0 2024-04-16T15:37:03.912 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.913+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe62c0b6710 con 0x7fe62c13f7c0 2024-04-16T15:37:03.913 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.914+0000 7fe628ff9640 1 -- 172.21.15.80:0/663128263 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16895 (secure 0 0 0) 0x7fe62c0b6710 con 0x7fe62c13f7c0 2024-04-16T15:37:03.913 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:03.914 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":38,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:37:02.624971+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:37:01.116058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T15:37:01.579531+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 msgr2=0x7fe61806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 0x7fe61806edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe61c000f60 tx=0x7fe61c007c00 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 msgr2=0x7fe62c1f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe62400efc0 tx=0x7fe62400c490 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 shutdown_connections 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe62c13f7c0 0x7fe62c1f2e10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe62c0cea50 0x7fe62c1e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe61806c8f0 0x7fe61806edb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 --2- 172.21.15.80:0/663128263 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe62c0b6030 0x7fe62c13eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 >> 172.21.15.80:0/663128263 conn(0x7fe62c0b2940 msgr2=0x7fe62c06f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:03.916 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 shutdown_connections 2024-04-16T15:37:03.917 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:03.916+0000 7fe6329d4640 1 -- 172.21.15.80:0/663128263 wait complete. 2024-04-16T15:37:03.927 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T15:37:04.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.033+0000 7fbb7bceb640 1 Processor -- start 2024-04-16T15:37:04.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 -- start start 2024-04-16T15:37:04.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb74161f20 0x7fbb740cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740b74e0 0x7fbb740cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbb740d0ff0 0x7fbb740d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fbb740cfd90 con 0x7fbb740b74e0 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbb740d0050 con 0x7fbb740d0ff0 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb7bceb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740d0330 con 0x7fbb74161f20 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.034+0000 7fbb79286640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740b74e0 0x7fbb740cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fbb740b74e0 0x7fbb740cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46768/0 (socket says 172.21.15.80:46768) 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 -- 172.21.15.80:0/1236982633 learned_addr learned my addr 172.21.15.80:0/1236982633 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb7a288640 1 --2- 172.21.15.80:0/1236982633 >> v2:172.21.15.87:3300/0 conn(0x7fbb740d0ff0 0x7fbb740d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79a87640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb74161f20 0x7fbb740cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 -- 172.21.15.80:0/1236982633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb74161f20 msgr2=0x7fbb740cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb74161f20 0x7fbb740cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 -- 172.21.15.80:0/1236982633 >> v2:172.21.15.87:3300/0 conn(0x7fbb740d0ff0 msgr2=0x7fbb740d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 --2- 172.21.15.80:0/1236982633 >> v2:172.21.15.87:3300/0 conn(0x7fbb740d0ff0 0x7fbb740d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 -- 172.21.15.80:0/1236982633 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb740d0610 con 0x7fbb740b74e0 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.035+0000 7fbb79286640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740b74e0 0x7fbb740cf770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbb740d4520 tx=0x7fbb6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6e8c2027a984ca server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb78a85640 1 -- 172.21.15.80:0/1236982633 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68035020 con 0x7fbb740b74e0 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb78a85640 1 -- 172.21.15.80:0/1236982633 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb68031870 con 0x7fbb740b74e0 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb78a85640 1 -- 172.21.15.80:0/1236982633 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68031c40 con 0x7fbb740b74e0 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1236982633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740b74e0 msgr2=0x7fbb740cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740b74e0 0x7fbb740cf770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbb740d4520 tx=0x7fbb6802b910 comp rx=0 tx=0).stop 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1236982633 shutdown_connections 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1236982633 >> v2:172.21.15.87:3300/0 conn(0x7fbb740d0ff0 0x7fbb740d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740b74e0 0x7fbb740cf770 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1236982633 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb74161f20 0x7fbb740cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1236982633 >> 172.21.15.80:0/1236982633 conn(0x7fbb7408c000 msgr2=0x7fbb740d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1236982633 shutdown_connections 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.036+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1236982633 wait complete. 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.037+0000 7fbb7bceb640 1 Processor -- start 2024-04-16T15:37:04.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 -- start start 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 0x7fbb74146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 0x7fbb740c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740d27e0 con 0x7fbb740d0ff0 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740b5730 con 0x7fbb74161f20 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb7bceb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740d2960 con 0x7fbb740b74e0 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb79286640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb79286640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46774/0 (socket says 172.21.15.80:46774) 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.038+0000 7fbb79286640 1 -- 172.21.15.80:0/1399085313 learned_addr learned my addr 172.21.15.80:0/1399085313 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79a87640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 0x7fbb74146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb7a288640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 0x7fbb740c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 -- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 msgr2=0x7fbb74146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.041 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 0x7fbb74146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 -- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 msgr2=0x7fbb740c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 0x7fbb740c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 -- 172.21.15.80:0/1399085313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb74147750 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79a87640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 0x7fbb74146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb7a288640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 0x7fbb740c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb79286640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbb68000c00 tx=0x7fbb680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6803ad60 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb680443f0 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb680447c0 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb74146eb0 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.039+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb74147470 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.040+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb74068a40 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.040+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb6804b060 con 0x7fbb740d0ff0 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.041+0000 7fbb727fc640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.041+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fbb680ade20 con 0x7fbb740d0ff0 2024-04-16T15:37:04.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.041+0000 7fbb79a87640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.041+0000 7fbb79a87640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 0x7fbb6006edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009f50 tx=0x7fbb6400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.045+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb6803f070 con 0x7fbb740d0ff0 2024-04-16T15:37:04.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.258+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbb740d1620 con 0x7fbb740d0ff0 2024-04-16T15:37:04.286 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.287+0000 7fbb727fc640 1 -- 172.21.15.80:0/1399085313 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fbb6802f320 con 0x7fbb740d0ff0 2024-04-16T15:37:04.287 INFO:tasks.ceph.mds.a.smithi080.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f017b5f9640 time 2024-04-16T15:37:04.289751+0000 2024-04-16T15:37:04.287 INFO:tasks.ceph.mds.a.smithi080.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:37:04.287 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.287 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0185981f4c] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr:2024-04-16T15:37:04.288+0000 7f017b5f9640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f017b5f9640 time 2024-04-16T15:37:04.289751+0000 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0185981f4c] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.288 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr:*** Caught signal (Aborted) ** 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: in thread 7f017b5f9640 thread_name:ms_dispatch 2024-04-16T15:37:04.289 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0185054db0] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f01850a154c] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: raise() 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: abort() 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0185981fa6] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr:2024-04-16T15:37:04.289+0000 7f017b5f9640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: in thread 7f017b5f9640 thread_name:ms_dispatch 2024-04-16T15:37:04.290 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0185054db0] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f01850a154c] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: raise() 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: abort() 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0185981fa6] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:37:04.291 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 msgr2=0x7fbb6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 0x7fbb6006edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009f50 tx=0x7fbb6400b040 comp rx=0 tx=0).stop 2024-04-16T15:37:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 msgr2=0x7fbb740c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbb68000c00 tx=0x7fbb680046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 shutdown_connections 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb74161f20 0x7fbb740c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb740d0ff0 0x7fbb740c97b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 --2- 172.21.15.80:0/1399085313 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fbb740b74e0 0x7fbb74146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 >> 172.21.15.80:0/1399085313 conn(0x7fbb7408c000 msgr2=0x7fbb740d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 shutdown_connections 2024-04-16T15:37:04.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.290+0000 7fbb7bceb640 1 -- 172.21.15.80:0/1399085313 wait complete. 2024-04-16T15:37:04.293 INFO:tasks.ceph.mds.a.smithi080.stderr: -1> 2024-04-16T15:37:04.288+0000 7f017b5f9640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f017b5f9640 time 2024-04-16T15:37:04.289751+0000 2024-04-16T15:37:04.293 INFO:tasks.ceph.mds.a.smithi080.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:37:04.293 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0185981f4c] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 0> 2024-04-16T15:37:04.289+0000 7f017b5f9640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: in thread 7f017b5f9640 thread_name:ms_dispatch 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0185054db0] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f01850a154c] 2024-04-16T15:37:04.294 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: raise() 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: abort() 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0185981fa6] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: -4> 2024-04-16T15:37:04.288+0000 7f017b5f9640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7f017b5f9640 time 2024-04-16T15:37:04.289751+0000 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.295 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0185981f4c] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: -3> 2024-04-16T15:37:04.289+0000 7f017b5f9640 -1 *** Caught signal (Aborted) ** 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: in thread 7f017b5f9640 thread_name:ms_dispatch 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0185054db0] 2024-04-16T15:37:04.296 INFO:tasks.ceph.mds.a.smithi080.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f01850a154c] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 3: raise() 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 4: abort() 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0185981fa6] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7f018598210a] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 7: (MDLog::trim()+0xf2a) [0x557d267f71aa] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x557d267f7559] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7f01854db924] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7f018509f802] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7f018503f450] 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T15:37:04.297 INFO:tasks.ceph.mds.a.smithi080.stderr: 2024-04-16T15:37:04.300 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T15:37:04.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T15:37:04.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.408+0000 7f863b7db640 1 Processor -- start 2024-04-16T15:37:04.407 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.408+0000 7f863b7db640 1 -- start start 2024-04-16T15:37:04.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f863b7db640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863409b180 0x7f86340ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f863b7db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86340cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f863b7db640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86340ce870 con 0x7f863415fd90 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f863b7db640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f86340b22b0 con 0x7f863409b180 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f863b7db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f86340ceb50 con 0x7f8634160170 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863409b180 0x7f86340ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f863409b180 0x7f86340ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46788/0 (socket says 172.21.15.80:46788) 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 -- 172.21.15.80:0/2824219178 learned_addr learned my addr 172.21.15.80:0/2824219178 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8639d78640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86340cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 -- 172.21.15.80:0/2824219178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 msgr2=0x7f86340cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86340cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 -- 172.21.15.80:0/2824219178 >> v1:172.21.15.87:6789/0 conn(0x7f863415fd90 legacy=0x7f863409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.409+0000 7f8638d76640 1 -- 172.21.15.80:0/2824219178 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86340b1f40 con 0x7f863409b180 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.410+0000 7f8638d76640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863409b180 0x7f86340ccf50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec70a8a5fefa569 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.410+0000 7f862bfff640 1 -- 172.21.15.80:0/2824219178 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624034070 con 0x7f863409b180 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.410+0000 7f862bfff640 1 -- 172.21.15.80:0/2824219178 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624030840 con 0x7f863409b180 2024-04-16T15:37:04.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.410+0000 7f862bfff640 1 -- 172.21.15.80:0/2824219178 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624030c10 con 0x7f863409b180 2024-04-16T15:37:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 -- 172.21.15.80:0/2824219178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863409b180 msgr2=0x7f86340ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863409b180 0x7f86340ccf50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402b980 comp rx=0 tx=0).stop 2024-04-16T15:37:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 -- 172.21.15.80:0/2824219178 shutdown_connections 2024-04-16T15:37:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86340cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 --2- 172.21.15.80:0/2824219178 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863409b180 0x7f86340ccf50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 -- 172.21.15.80:0/2824219178 >> 172.21.15.80:0/2824219178 conn(0x7f86340b4060 msgr2=0x7f86340b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 -- 172.21.15.80:0/2824219178 shutdown_connections 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.411+0000 7f863b7db640 1 -- 172.21.15.80:0/2824219178 wait complete. 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.412+0000 7f863b7db640 1 Processor -- start 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.412+0000 7f863b7db640 1 -- start start 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f863409b180 0x7f86340b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86341f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f863409b7a0 con 0x7f863415fd90 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f86340b39a0 con 0x7f863409b180 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f863409b920 con 0x7f8634160170 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:46804/0 (socket says 172.21.15.80:46804) 2024-04-16T15:37:04.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 -- 172.21.15.80:0/242502408 learned_addr learned my addr 172.21.15.80:0/242502408 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8639577640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f863409b180 0x7f86340b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8639d78640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86341f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 -- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 msgr2=0x7f86341f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86341f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 -- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f863409b180 msgr2=0x7f86340b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f863409b180 0x7f86340b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 -- 172.21.15.80:0/242502408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86340b8450 con 0x7f863415fd90 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8639d78640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86341f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8638d76640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f862402b9c0 tx=0x7f86240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624034040 con 0x7f863415fd90 2024-04-16T15:37:04.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624039d90 con 0x7f863415fd90 2024-04-16T15:37:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624043610 con 0x7f863415fd90 2024-04-16T15:37:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.413+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86340c7870 con 0x7f863415fd90 2024-04-16T15:37:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.414+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86340c7e30 con 0x7f863415fd90 2024-04-16T15:37:04.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.415+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8634069150 con 0x7f863415fd90 2024-04-16T15:37:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.415+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f862404a060 con 0x7f863415fd90 2024-04-16T15:37:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.415+0000 7f8629ffb640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 0x7f861806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.416+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f86240add50 con 0x7f863415fd90 2024-04-16T15:37:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.416+0000 7f8639577640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 0x7f861806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:04.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.416+0000 7f8639577640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 0x7f861806edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8630007fd0 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:04.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.420+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86240b1030 con 0x7f863415fd90 2024-04-16T15:37:04.581 INFO:tasks.ceph.mds.a.smithi080.stderr:daemon-helper: command crashed with signal 6 2024-04-16T15:37:04.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:04.636+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f86340b3e40 con 0x7f863415fd90 2024-04-16T15:37:05.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.291+0000 7f8629ffb640 1 -- 172.21.15.80:0/242502408 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f862403e070 con 0x7f863415fd90 2024-04-16T15:37:05.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 msgr2=0x7f861806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 0x7f861806edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8630007fd0 tx=0x7f8630009040 comp rx=0 tx=0).stop 2024-04-16T15:37:05.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 msgr2=0x7f8634152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f862402b9c0 tx=0x7f86240046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 shutdown_connections 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f861806c8f0 0x7f861806edb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f8634160170 0x7f86341f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f863415fd90 0x7f8634152a80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 --2- 172.21.15.80:0/242502408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f863409b180 0x7f86340b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 >> 172.21.15.80:0/242502408 conn(0x7f86340b4060 msgr2=0x7f86340709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 shutdown_connections 2024-04-16T15:37:05.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.294+0000 7f863b7db640 1 -- 172.21.15.80:0/242502408 wait complete. 2024-04-16T15:37:05.305 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T15:37:05.305 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:37:05.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.409+0000 7f3e9847e640 1 Processor -- start 2024-04-16T15:37:05.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.409+0000 7f3e9847e640 1 -- start start 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9847e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e90144f00 0x7f3e900cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9847e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e900b3840 0x7f3e900b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9847e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900ceab0 con 0x7f3e900b5a00 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9847e640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3e900cf0e0 con 0x7f3e90144f00 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9847e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900b45c0 con 0x7f3e900b3840 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9621a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e90144f00 0x7f3e900cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9621a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3e90144f00 0x7f3e900cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55004/0 (socket says 172.21.15.80:55004) 2024-04-16T15:37:05.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.410+0000 7f3e9621a640 1 -- 172.21.15.80:0/2647904280 learned_addr learned my addr 172.21.15.80:0/2647904280 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e95a19640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e900b3840 0x7f3e900b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e9621a640 1 -- 172.21.15.80:0/2647904280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e900b3840 msgr2=0x7f3e900b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e9621a640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e900b3840 0x7f3e900b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e9621a640 1 -- 172.21.15.80:0/2647904280 >> v1:172.21.15.87:6789/0 conn(0x7f3e900b5a00 legacy=0x7f3e900b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e9621a640 1 -- 172.21.15.80:0/2647904280 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900b42e0 con 0x7f3e90144f00 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.411+0000 7f3e9621a640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e90144f00 0x7f3e900cf570 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e900cf260 tx=0x7f3e8c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8c0a6973cfc16d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e95218640 1 -- 172.21.15.80:0/2647904280 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c02caf0 con 0x7f3e90144f00 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e95218640 1 -- 172.21.15.80:0/2647904280 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c02cc90 con 0x7f3e90144f00 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e95218640 1 -- 172.21.15.80:0/2647904280 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c034610 con 0x7f3e90144f00 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 -- 172.21.15.80:0/2647904280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e90144f00 msgr2=0x7f3e900cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e90144f00 0x7f3e900cf570 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e900cf260 tx=0x7f3e8c02bf50 comp rx=0 tx=0).stop 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 -- 172.21.15.80:0/2647904280 shutdown_connections 2024-04-16T15:37:05.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e900b3840 0x7f3e900b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2647904280 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e90144f00 0x7f3e900cf570 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 -- 172.21.15.80:0/2647904280 >> 172.21.15.80:0/2647904280 conn(0x7f3e900b2940 msgr2=0x7f3e9006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:05.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 -- 172.21.15.80:0/2647904280 shutdown_connections 2024-04-16T15:37:05.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.412+0000 7f3e9847e640 1 -- 172.21.15.80:0/2647904280 wait complete. 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.413+0000 7f3e9847e640 1 Processor -- start 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.413+0000 7f3e9847e640 1 -- start start 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900b5a00 0x7f3e90141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e90144f00 0x7f3e900ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90160110 con 0x7f3e900b3840 2024-04-16T15:37:05.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900cfab0 con 0x7f3e900b5a00 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9847e640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3e90160290 con 0x7f3e90144f00 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9621a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9621a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55020/0 (socket says 172.21.15.80:55020) 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e9621a640 1 -- 172.21.15.80:0/2881429624 learned_addr learned my addr 172.21.15.80:0/2881429624 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e95a19640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900b5a00 0x7f3e90141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.414+0000 7f3e96a1b640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e90144f00 0x7f3e900ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 -- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e90144f00 msgr2=0x7f3e900ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e90144f00 0x7f3e900ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 -- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900b5a00 msgr2=0x7f3e90141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900b5a00 0x7f3e90141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 -- 172.21.15.80:0/2881429624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e901f1800 con 0x7f3e900b3840 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9621a640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c036040 tx=0x7f3e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c043020 con 0x7f3e900b3840 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c03e450 con 0x7f3e900b3840 2024-04-16T15:37:05.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e901f1ae0 con 0x7f3e900b3840 2024-04-16T15:37:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c009510 con 0x7f3e900b3840 2024-04-16T15:37:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.415+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901f20a0 con 0x7f3e900b3840 2024-04-16T15:37:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.416+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e90068a40 con 0x7f3e900b3840 2024-04-16T15:37:05.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.416+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e8c046020 con 0x7f3e900b3840 2024-04-16T15:37:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.417+0000 7f3e86ffd640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.417+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3e8c0ae260 con 0x7f3e900b3840 2024-04-16T15:37:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.417+0000 7f3e95a19640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.417+0000 7f3e95a19640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 0x7f3e7406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009b40 tx=0x7f3e80009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.421+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e8c04d030 con 0x7f3e900b3840 2024-04-16T15:37:05.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.636+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e9006c520 con 0x7f3e900b3840 2024-04-16T15:37:05.636 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.636+0000 7f3e86ffd640 1 -- 172.21.15.80:0/2881429624 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5178 (secure 0 0 0) 0x7f3e8c07bf40 con 0x7f3e900b3840 2024-04-16T15:37:05.636 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:05.636 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/743042553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":743042553},{"type":"v1","addr":"172.21.15.87:6834","nonce":743042553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3593860190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3593860190},{"type":"v1","addr":"172.21.15.87:6835","nonce":3593860190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2311942895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2311942895},{"type":"v1","addr":"172.21.15.80:6836","nonce":2311942895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:37:02.624927+0000","modified":"2024-04-16T15:37:04.638832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3642267828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3642267828},{"type":"v1","addr":"172.21.15.80:6837","nonce":3642267828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5523,"qdb_cluster":[5523]},"id":2}]} 2024-04-16T15:37:05.636 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 msgr2=0x7f3e7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 0x7f3e7406edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009b40 tx=0x7f3e80009190 comp rx=0 tx=0).stop 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 msgr2=0x7f3e900a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c036040 tx=0x7f3e8c004a40 comp rx=0 tx=0).stop 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 shutdown_connections 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3e7406c8f0 0x7f3e7406edb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.638 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3e90144f00 0x7f3e900ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e900b5a00 0x7f3e90141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.638+0000 7f3e9847e640 1 --2- 172.21.15.80:0/2881429624 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3e900b3840 0x7f3e900a94d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.639+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 >> 172.21.15.80:0/2881429624 conn(0x7f3e900b2940 msgr2=0x7f3e900cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.639+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 shutdown_connections 2024-04-16T15:37:05.639 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.639+0000 7f3e9847e640 1 -- 172.21.15.80:0/2881429624 wait complete. 2024-04-16T15:37:05.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:37:05.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.751+0000 7fce33967640 1 Processor -- start 2024-04-16T15:37:05.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.751+0000 7fce33967640 1 -- start start 2024-04-16T15:37:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce33967640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fce2c0aff10 0x7fce2c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce33967640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce33967640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce2c15daf0 con 0x7fce2c160120 2024-04-16T15:37:05.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce33967640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fce2c0cee30 con 0x7fce2c0aff10 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce33967640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c0b02f0 con 0x7fce2c0ce490 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce31703640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fce2c0aff10 0x7fce2c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce31703640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fce2c0aff10 0x7fce2c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.80:51298/0 (socket says 172.21.15.80:51298) 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce31f04640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fce2c160120 0x7fce2c160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:47592/0 (socket says 172.21.15.80:47592) 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce31703640 1 -- 172.21.15.80:0/3611571808 learned_addr learned my addr 172.21.15.80:0/3611571808 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.752+0000 7fce30f02640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.753+0000 7fce31703640 1 -- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 msgr2=0x7fce2c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.753+0000 7fce31703640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c0ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.753+0000 7fce31703640 1 -- 172.21.15.80:0/3611571808 >> v1:172.21.15.87:6789/0 conn(0x7fce2c160120 legacy=0x7fce2c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.753+0000 7fce31703640 1 -- 172.21.15.80:0/3611571808 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c070740 con 0x7fce2c0aff10 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.753+0000 7fce31703640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c0aff10 0x7fce2c15d5b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce28009870 tx=0x7fce2802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28e03a428ecad56 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce23fff640 1 -- 172.21.15.80:0/3611571808 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28034070 con 0x7fce2c0aff10 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce23fff640 1 -- 172.21.15.80:0/3611571808 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28030840 con 0x7fce2c0aff10 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce23fff640 1 -- 172.21.15.80:0/3611571808 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28030c10 con 0x7fce2c0aff10 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 -- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c0aff10 msgr2=0x7fce2c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c0aff10 0x7fce2c15d5b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce28009870 tx=0x7fce2802b980 comp rx=0 tx=0).stop 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 -- 172.21.15.80:0/3611571808 shutdown_connections 2024-04-16T15:37:05.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 --2- 172.21.15.80:0/3611571808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c0aff10 0x7fce2c15d5b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 -- 172.21.15.80:0/3611571808 >> 172.21.15.80:0/3611571808 conn(0x7fce2c0b2520 msgr2=0x7fce2c0b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 -- 172.21.15.80:0/3611571808 shutdown_connections 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.754+0000 7fce33967640 1 -- 172.21.15.80:0/3611571808 wait complete. 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.755+0000 7fce33967640 1 Processor -- start 2024-04-16T15:37:05.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.755+0000 7fce33967640 1 -- start start 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c160120 0x7fce2c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c0cd720 con 0x7fce2c0aff10 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c0ce050 con 0x7fce2c160120 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce33967640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c0cda00 con 0x7fce2c0ce490 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce31703640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce31703640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55032/0 (socket says 172.21.15.80:55032) 2024-04-16T15:37:05.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce31703640 1 -- 172.21.15.80:0/650000658 learned_addr learned my addr 172.21.15.80:0/650000658 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce30f02640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.756+0000 7fce31f04640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c160120 0x7fce2c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 -- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 msgr2=0x7fce2c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 -- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c160120 msgr2=0x7fce2c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c160120 0x7fce2c15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 -- 172.21.15.80:0/650000658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c0ada80 con 0x7fce2c0aff10 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce30f02640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce31703640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce2802b9c0 tx=0x7fce28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28048070 con 0x7fce2c0aff10 2024-04-16T15:37:05.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28030640 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c0add60 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28034040 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.757+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c0ae320 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.758+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2c068a40 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.759+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce2804b070 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.759+0000 7fce21ffb640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.759+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fce280adbd0 con 0x7fce2c0aff10 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.759+0000 7fce30f02640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:05.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.760+0000 7fce30f02640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 0x7fce1006edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce2c14f910 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:05.762 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.763+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce2807be70 con 0x7fce2c0aff10 2024-04-16T15:37:05.937 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.938+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce2c0b32e0 con 0x7fce2c0aff10 2024-04-16T15:37:05.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.939+0000 7fce21ffb640 1 -- 172.21.15.80:0/650000658 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16882 (secure 0 0 0) 0x7fce28030810 con 0x7fce2c0aff10 2024-04-16T15:37:05.939 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:05.939 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:37:04.281722+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:37:01.116058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T15:37:01.579531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:37:05.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.941+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 msgr2=0x7fce1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.941+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 0x7fce1006edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce2c14f910 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2024-04-16T15:37:05.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 msgr2=0x7fce2c0aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:05.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce2802b9c0 tx=0x7fce28004730 comp rx=0 tx=0).stop 2024-04-16T15:37:05.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 shutdown_connections 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce2c160120 0x7fce2c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fce2c0ce490 0x7fce2c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 --2- 172.21.15.80:0/650000658 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fce2c0aff10 0x7fce2c0aeb20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 >> 172.21.15.80:0/650000658 conn(0x7fce2c0b2520 msgr2=0x7fce2c15f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 shutdown_connections 2024-04-16T15:37:05.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:05.942+0000 7fce33967640 1 -- 172.21.15.80:0/650000658 wait complete. 2024-04-16T15:37:05.952 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T15:37:05.953 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:06.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.055+0000 7f3415037640 1 Processor -- start 2024-04-16T15:37:06.055 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.055+0000 7f3415037640 1 -- start start 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f3415037640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f341009b180 0x7f341009b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f3415037640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34100b3810 0x7f34100ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f3415037640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341015cc00 con 0x7f341015c820 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f3415037640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f34100ced80 con 0x7f34100b3810 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f3415037640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f34100ce7c0 con 0x7f341009b180 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f340f59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34100b3810 0x7f34100ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f340f59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f34100b3810 0x7f34100ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55044/0 (socket says 172.21.15.80:55044) 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.056+0000 7f340f59e640 1 -- 172.21.15.80:0/764150992 learned_addr learned my addr 172.21.15.80:0/764150992 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340f59e640 1 -- 172.21.15.80:0/764150992 >> v2:172.21.15.87:3300/0 conn(0x7f341009b180 msgr2=0x7f341009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340f59e640 1 --2- 172.21.15.80:0/764150992 >> v2:172.21.15.87:3300/0 conn(0x7f341009b180 0x7f341009b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340f59e640 1 -- 172.21.15.80:0/764150992 >> v1:172.21.15.87:6789/0 conn(0x7f341015c820 legacy=0x7f341009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340f59e640 1 -- 172.21.15.80:0/764150992 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34100ceaa0 con 0x7f34100b3810 2024-04-16T15:37:06.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340f59e640 1 --2- 172.21.15.80:0/764150992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34100b3810 0x7f34100ccef0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f34100736a0 tx=0x7f340002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3697334d297a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.057+0000 7f340dd9b640 1 -- 172.21.15.80:0/764150992 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340002e070 con 0x7f34100b3810 2024-04-16T15:37:06.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f340dd9b640 1 -- 172.21.15.80:0/764150992 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400037070 con 0x7f34100b3810 2024-04-16T15:37:06.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f340dd9b640 1 -- 172.21.15.80:0/764150992 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400031a00 con 0x7f34100b3810 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 -- 172.21.15.80:0/764150992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34100b3810 msgr2=0x7f34100ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 --2- 172.21.15.80:0/764150992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34100b3810 0x7f34100ccef0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f34100736a0 tx=0x7f340002b880 comp rx=0 tx=0).stop 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 -- 172.21.15.80:0/764150992 shutdown_connections 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 --2- 172.21.15.80:0/764150992 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f34100b3810 0x7f34100ccef0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 --2- 172.21.15.80:0/764150992 >> v2:172.21.15.87:3300/0 conn(0x7f341009b180 0x7f341009b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.059 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 -- 172.21.15.80:0/764150992 >> 172.21.15.80:0/764150992 conn(0x7f34100cef90 msgr2=0x7f34100cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 -- 172.21.15.80:0/764150992 shutdown_connections 2024-04-16T15:37:06.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.058+0000 7f3415037640 1 -- 172.21.15.80:0/764150992 wait complete. 2024-04-16T15:37:06.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 Processor -- start 2024-04-16T15:37:06.060 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 -- start start 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f341009b180 0x7f34100cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100b3810 0x7f341015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f34100cd430 con 0x7f341015c820 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f34100b22e0 con 0x7f341009b180 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f3415037640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f34100cd5b0 con 0x7f34100b3810 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.060+0000 7f340f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55056/0 (socket says 172.21.15.80:55056) 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 -- 172.21.15.80:0/1536237570 learned_addr learned my addr 172.21.15.80:0/1536237570 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340ed9d640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f341009b180 0x7f34100cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.063 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340e59c640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100b3810 0x7f341015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 -- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100b3810 msgr2=0x7f341015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100b3810 0x7f341015d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 -- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f341009b180 msgr2=0x7f34100cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f341009b180 0x7f34100cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 -- 172.21.15.80:0/1536237570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341015dd40 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f340f59e640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34000090b0 tx=0x7f34000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400032880 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400032a40 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400032e30 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341015e010 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.061+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341015e5d0 con 0x7f341015c820 2024-04-16T15:37:06.064 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.062+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3410068a40 con 0x7f341015c820 2024-04-16T15:37:06.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.063+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34000453f0 con 0x7f341015c820 2024-04-16T15:37:06.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.063+0000 7f34077fe640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 0x7f33f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.063+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f34000adbb0 con 0x7f341015c820 2024-04-16T15:37:06.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.063+0000 7f340ed9d640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 0x7f33f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.065 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.064+0000 7f340ed9d640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 0x7f33f006ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3408009f60 tx=0x7f34080094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.067 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.067+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3400040070 con 0x7f341015c820 2024-04-16T15:37:06.238 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.238+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3410071230 con 0x7f33f006c920 2024-04-16T15:37:06.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.244+0000 7f34077fe640 1 -- 172.21.15.80:0/1536237570 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239277 (secure 0 0 0) 0x7f3410071230 con 0x7f33f006c920 2024-04-16T15:37:06.246 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:06.247 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 msgr2=0x7f33f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 0x7f33f006ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3408009f60 tx=0x7f34080094f0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 msgr2=0x7f34101568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34000090b0 tx=0x7f34000046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 shutdown_connections 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f341015c820 0x7f34101568c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f33f006c920 0x7f33f006ede0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f34100b3810 0x7f341015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 --2- 172.21.15.80:0/1536237570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f341009b180 0x7f34100cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 >> 172.21.15.80:0/1536237570 conn(0x7f34100cef90 msgr2=0x7f34100cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 shutdown_connections 2024-04-16T15:37:06.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.247+0000 7f3415037640 1 -- 172.21.15.80:0/1536237570 wait complete. 2024-04-16T15:37:06.257 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-16T15:37:05.174173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220548,"kb_used_data":4348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754172,"statfs":{"total":773094113280,"available":772868272128,"internally_reserved":0,"allocated":4452352,"data_stored":2565965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000705"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292905+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:03.292905+0000","last_peered":"2024-04-16T15:37:03.292905+0000","last_clean":"2024-04-16T15:37:03.292905+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:03.292905+0000","last_undegraded":"2024-04-16T15:37:03.292905+0000","last_fullsized":"2024-04-16T15:37:03.292905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:14.060053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299362+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:03.299362+0000","last_peered":"2024-04-16T15:37:03.299362+0000","last_clean":"2024-04-16T15:37:03.299362+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:03.299362+0000","last_undegraded":"2024-04-16T15:37:03.299362+0000","last_fullsized":"2024-04-16T15:37:03.299362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299316+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:03.299316+0000","last_peered":"2024-04-16T15:37:03.299316+0000","last_clean":"2024-04-16T15:37:03.299316+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:03.299316+0000","last_undegraded":"2024-04-16T15:37:03.299316+0000","last_fullsized":"2024-04-16T15:37:03.299316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299338+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:03.299338+0000","last_peered":"2024-04-16T15:37:03.299338+0000","last_clean":"2024-04-16T15:37:03.299338+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:03.299338+0000","last_undegraded":"2024-04-16T15:37:03.299338+0000","last_fullsized":"2024-04-16T15:37:03.299338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299432+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:03.299432+0000","last_peered":"2024-04-16T15:37:03.299432+0000","last_clean":"2024-04-16T15:37:03.299432+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:03.299432+0000","last_undegraded":"2024-04-16T15:37:03.299432+0000","last_fullsized":"2024-04-16T15:37:03.299432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306392+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:03.306392+0000","last_peered":"2024-04-16T15:37:03.306392+0000","last_clean":"2024-04-16T15:37:03.306392+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:03.306392+0000","last_undegraded":"2024-04-16T15:37:03.306392+0000","last_fullsized":"2024-04-16T15:37:03.306392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299498+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:03.299498+0000","last_peered":"2024-04-16T15:37:03.299498+0000","last_clean":"2024-04-16T15:37:03.299498+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:03.299498+0000","last_undegraded":"2024-04-16T15:37:03.299498+0000","last_fullsized":"2024-04-16T15:37:03.299498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299426+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:03.299426+0000","last_peered":"2024-04-16T15:37:03.299426+0000","last_clean":"2024-04-16T15:37:03.299426+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:03.299426+0000","last_undegraded":"2024-04-16T15:37:03.299426+0000","last_fullsized":"2024-04-16T15:37:03.299426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.307283+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:03.307283+0000","last_peered":"2024-04-16T15:37:03.307283+0000","last_clean":"2024-04-16T15:37:03.307283+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:03.307283+0000","last_undegraded":"2024-04-16T15:37:03.307283+0000","last_fullsized":"2024-04-16T15:37:03.307283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299405+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:03.299405+0000","last_peered":"2024-04-16T15:37:03.299405+0000","last_clean":"2024-04-16T15:37:03.299405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:03.299405+0000","last_undegraded":"2024-04-16T15:37:03.299405+0000","last_fullsized":"2024-04-16T15:37:03.299405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.277502+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:03.277502+0000","last_peered":"2024-04-16T15:37:03.277502+0000","last_clean":"2024-04-16T15:37:03.277502+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:03.277502+0000","last_undegraded":"2024-04-16T15:37:03.277502+0000","last_fullsized":"2024-04-16T15:37:03.277502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299478+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:03.299478+0000","last_peered":"2024-04-16T15:37:03.299478+0000","last_clean":"2024-04-16T15:37:03.299478+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:03.299478+0000","last_undegraded":"2024-04-16T15:37:03.299478+0000","last_fullsized":"2024-04-16T15:37:03.299478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292524+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:03.292524+0000","last_peered":"2024-04-16T15:37:03.292524+0000","last_clean":"2024-04-16T15:37:03.292524+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:03.292524+0000","last_undegraded":"2024-04-16T15:37:03.292524+0000","last_fullsized":"2024-04-16T15:37:03.292524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:41.163158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.278441+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:03.278441+0000","last_peered":"2024-04-16T15:37:03.278441+0000","last_clean":"2024-04-16T15:37:03.278441+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:03.278441+0000","last_undegraded":"2024-04-16T15:37:03.278441+0000","last_fullsized":"2024-04-16T15:37:03.278441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.279728+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:03.279728+0000","last_peered":"2024-04-16T15:37:03.279728+0000","last_clean":"2024-04-16T15:37:03.279728+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:03.279728+0000","last_undegraded":"2024-04-16T15:37:03.279728+0000","last_fullsized":"2024-04-16T15:37:03.279728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:06.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:06.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.406+0000 7f954b606640 1 Processor -- start 2024-04-16T15:37:06.406 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.406+0000 7f954b606640 1 -- start start 2024-04-16T15:37:06.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f954b606640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f95440b6030 0x7f95440ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.409 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f954b606640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9544161270 con 0x7f954413f7c0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f954b606640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954413fe10 con 0x7f95440cea50 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f954b606640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f95440a95e0 con 0x7f95440b6030 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f95493a2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f954413f7c0 0x7f95440b5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41724/0 (socket says 172.21.15.80:41724) 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f95493a2640 1 -- 172.21.15.80:0/2214243382 learned_addr learned my addr 172.21.15.80:0/2214243382 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f9548ba1640 1 --2- 172.21.15.80:0/2214243382 >> v2:172.21.15.87:3300/0 conn(0x7f95440b6030 0x7f95440ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063351117 0 0) 0x7f9544161270 con 0x7f954413f7c0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.407+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9530003520 con 0x7f954413f7c0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2041152785 0 0) 0x7f9530003520 con 0x7f954413f7c0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 >> v2:172.21.15.87:3300/0 conn(0x7f95440b6030 msgr2=0x7f95440ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 --2- 172.21.15.80:0/2214243382 >> v2:172.21.15.87:3300/0 conn(0x7f95440b6030 0x7f95440ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 >> v1:172.21.15.87:6789/0 conn(0x7f95440cea50 legacy=0x7f954415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9544142d20 con 0x7f954413f7c0 2024-04-16T15:37:06.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f953c001670 con 0x7f954413f7c0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 >> v1:172.21.15.80:6789/0 conn(0x7f954413f7c0 legacy=0x7f95440b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 0x7f9530003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9530004800 0x7f9530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95300051c0 0x7f953000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f953000c040 con 0x7f95300039b0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f953000c1f0 con 0x7f95300051c0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f953000c3f0 con 0x7f9530004800 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 0x7f9530003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f9548ba1640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9530004800 0x7f9530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f9549ba3640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95300051c0 0x7f953000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 -- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9530004800 msgr2=0x7f9530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9530004800 0x7f9530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 -- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95300051c0 msgr2=0x7f953000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95300051c0 0x7f953000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f95493a2640 1 -- 172.21.15.80:0/2214243382 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9530003520 con 0x7f95300039b0 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f9549ba3640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95300051c0 0x7f953000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.408+0000 7f9549ba3640 1 -- 172.21.15.80:0/2214243382 reap_dead start 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f95493a2640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 0x7f9530003dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c240 tx=0x7f9530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d833e2e70c38dee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c007d10 con 0x7f95300039b0 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c030070 con 0x7f95300039b0 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f953bfff640 1 -- 172.21.15.80:0/2214243382 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c02cdc0 con 0x7f95300039b0 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 -- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 msgr2=0x7f9530003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 0x7f9530003dd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c240 tx=0x7f9530005830 comp rx=0 tx=0).stop 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 -- 172.21.15.80:0/2214243382 shutdown_connections 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 --2- 172.21.15.80:0/2214243382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95300039b0 0x7f9530003dd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 -- 172.21.15.80:0/2214243382 >> 172.21.15.80:0/2214243382 conn(0x7f95440b2940 msgr2=0x7f954406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.409+0000 7f954b606640 1 -- 172.21.15.80:0/2214243382 shutdown_connections 2024-04-16T15:37:06.413 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.410+0000 7f954b606640 1 -- 172.21.15.80:0/2214243382 wait complete. 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 Processor -- start 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 -- start start 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95300039b0 0x7f95441448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95441f4750 0x7f9544140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9544160790 con 0x7f95441f77a0 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9544160de0 con 0x7f95441f4750 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f954b606640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9544160a70 con 0x7f95300039b0 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f9548ba1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f9548ba1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55070/0 (socket says 172.21.15.80:55070) 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.411+0000 7f9548ba1640 1 -- 172.21.15.80:0/1685973920 learned_addr learned my addr 172.21.15.80:0/1685973920 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f95493a2640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95300039b0 0x7f95441448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9549ba3640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95441f4750 0x7f9544140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 -- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95300039b0 msgr2=0x7f95441448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95300039b0 0x7f95441448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 -- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95441f4750 msgr2=0x7f9544140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95441f4750 0x7f9544140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 -- 172.21.15.80:0/1685973920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95440b3e40 con 0x7f95441f77a0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9548ba1640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f95340116d0 tx=0x7f9534011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953400f960 con 0x7f95441f77a0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953400fb00 con 0x7f95441f77a0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9544144ea0 con 0x7f95441f77a0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534015460 con 0x7f95441f77a0 2024-04-16T15:37:06.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.412+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95440b43c0 con 0x7f95441f77a0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.413+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9544068a40 con 0x7f95441f77a0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.414+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9534015600 con 0x7f95441f77a0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.414+0000 7f9539ffb640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 0x7f952806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.414+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f953408c630 con 0x7f95441f77a0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.414+0000 7f95493a2640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 0x7f952806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.415+0000 7f95493a2640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 0x7f952806ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f953c034000 tx=0x7f953c039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.418+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9534019030 con 0x7f95441f77a0 2024-04-16T15:37:06.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.591+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f954415fd40 con 0x7f952806c920 2024-04-16T15:37:06.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.597+0000 7f9539ffb640 1 -- 172.21.15.80:0/1685973920 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239277 (secure 0 0 0) 0x7f954415fd40 con 0x7f952806c920 2024-04-16T15:37:06.599 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:06.600 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 msgr2=0x7f952806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 0x7f952806ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f953c034000 tx=0x7f953c039040 comp rx=0 tx=0).stop 2024-04-16T15:37:06.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 msgr2=0x7f95440ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f95340116d0 tx=0x7f9534011b90 comp rx=0 tx=0).stop 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 shutdown_connections 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f95441f4750 0x7f9544140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95441f77a0 0x7f95440ae400 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f952806c920 0x7f952806ede0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 --2- 172.21.15.80:0/1685973920 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f95300039b0 0x7f95441448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 >> 172.21.15.80:0/1685973920 conn(0x7f95440b2940 msgr2=0x7f954415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 shutdown_connections 2024-04-16T15:37:06.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.600+0000 7f954b606640 1 -- 172.21.15.80:0/1685973920 wait complete. 2024-04-16T15:37:06.611 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-16T15:37:05.174173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220548,"kb_used_data":4348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754172,"statfs":{"total":773094113280,"available":772868272128,"internally_reserved":0,"allocated":4452352,"data_stored":2565965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000705"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292905+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:03.292905+0000","last_peered":"2024-04-16T15:37:03.292905+0000","last_clean":"2024-04-16T15:37:03.292905+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:03.292905+0000","last_undegraded":"2024-04-16T15:37:03.292905+0000","last_fullsized":"2024-04-16T15:37:03.292905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:14.060053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299362+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:03.299362+0000","last_peered":"2024-04-16T15:37:03.299362+0000","last_clean":"2024-04-16T15:37:03.299362+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:03.299362+0000","last_undegraded":"2024-04-16T15:37:03.299362+0000","last_fullsized":"2024-04-16T15:37:03.299362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299316+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:03.299316+0000","last_peered":"2024-04-16T15:37:03.299316+0000","last_clean":"2024-04-16T15:37:03.299316+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:03.299316+0000","last_undegraded":"2024-04-16T15:37:03.299316+0000","last_fullsized":"2024-04-16T15:37:03.299316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299338+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:03.299338+0000","last_peered":"2024-04-16T15:37:03.299338+0000","last_clean":"2024-04-16T15:37:03.299338+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:03.299338+0000","last_undegraded":"2024-04-16T15:37:03.299338+0000","last_fullsized":"2024-04-16T15:37:03.299338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299432+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:03.299432+0000","last_peered":"2024-04-16T15:37:03.299432+0000","last_clean":"2024-04-16T15:37:03.299432+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:03.299432+0000","last_undegraded":"2024-04-16T15:37:03.299432+0000","last_fullsized":"2024-04-16T15:37:03.299432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306392+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:03.306392+0000","last_peered":"2024-04-16T15:37:03.306392+0000","last_clean":"2024-04-16T15:37:03.306392+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:03.306392+0000","last_undegraded":"2024-04-16T15:37:03.306392+0000","last_fullsized":"2024-04-16T15:37:03.306392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299498+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:03.299498+0000","last_peered":"2024-04-16T15:37:03.299498+0000","last_clean":"2024-04-16T15:37:03.299498+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:03.299498+0000","last_undegraded":"2024-04-16T15:37:03.299498+0000","last_fullsized":"2024-04-16T15:37:03.299498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299426+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:03.299426+0000","last_peered":"2024-04-16T15:37:03.299426+0000","last_clean":"2024-04-16T15:37:03.299426+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:03.299426+0000","last_undegraded":"2024-04-16T15:37:03.299426+0000","last_fullsized":"2024-04-16T15:37:03.299426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.307283+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:03.307283+0000","last_peered":"2024-04-16T15:37:03.307283+0000","last_clean":"2024-04-16T15:37:03.307283+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:03.307283+0000","last_undegraded":"2024-04-16T15:37:03.307283+0000","last_fullsized":"2024-04-16T15:37:03.307283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299405+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:03.299405+0000","last_peered":"2024-04-16T15:37:03.299405+0000","last_clean":"2024-04-16T15:37:03.299405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:03.299405+0000","last_undegraded":"2024-04-16T15:37:03.299405+0000","last_fullsized":"2024-04-16T15:37:03.299405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.277502+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:03.277502+0000","last_peered":"2024-04-16T15:37:03.277502+0000","last_clean":"2024-04-16T15:37:03.277502+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:03.277502+0000","last_undegraded":"2024-04-16T15:37:03.277502+0000","last_fullsized":"2024-04-16T15:37:03.277502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299478+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:03.299478+0000","last_peered":"2024-04-16T15:37:03.299478+0000","last_clean":"2024-04-16T15:37:03.299478+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:03.299478+0000","last_undegraded":"2024-04-16T15:37:03.299478+0000","last_fullsized":"2024-04-16T15:37:03.299478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292524+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:03.292524+0000","last_peered":"2024-04-16T15:37:03.292524+0000","last_clean":"2024-04-16T15:37:03.292524+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:03.292524+0000","last_undegraded":"2024-04-16T15:37:03.292524+0000","last_fullsized":"2024-04-16T15:37:03.292524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:41.163158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.278441+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:03.278441+0000","last_peered":"2024-04-16T15:37:03.278441+0000","last_clean":"2024-04-16T15:37:03.278441+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:03.278441+0000","last_undegraded":"2024-04-16T15:37:03.278441+0000","last_fullsized":"2024-04-16T15:37:03.278441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.279728+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:03.279728+0000","last_peered":"2024-04-16T15:37:03.279728+0000","last_clean":"2024-04-16T15:37:03.279728+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:03.279728+0000","last_undegraded":"2024-04-16T15:37:03.279728+0000","last_fullsized":"2024-04-16T15:37:03.279728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:06.615 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:06.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.755+0000 7fda61159640 1 Processor -- start 2024-04-16T15:37:06.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.755+0000 7fda61159640 1 -- start start 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda61159640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda5c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda61159640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5c06e410 con 0x7fda5c15a400 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda61159640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5c06e6f0 con 0x7fda5c070710 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda61159640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fda5c15dc80 con 0x7fda5c15d710 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5ad9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fda5c15a400 0x7fda5c070000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41728/0 (socket says 172.21.15.80:41728) 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5ad9d640 1 -- 172.21.15.80:0/119635482 learned_addr learned my addr 172.21.15.80:0/119635482 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286057248 0 0) 0x7fda5c06e410 con 0x7fda5c15a400 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48003520 con 0x7fda5c15a400 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5259c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda5c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2925663061 0 0) 0x7fda48003520 con 0x7fda5c15a400 2024-04-16T15:37:06.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 msgr2=0x7fda5c06bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda5c06bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 >> v1:172.21.15.87:6789/0 conn(0x7fda5c070710 legacy=0x7fda5c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c06e9d0 con 0x7fda5c15a400 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fda4c001670 con 0x7fda5c15a400 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 >> v1:172.21.15.80:6789/0 conn(0x7fda5c15a400 legacy=0x7fda5c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda480039e0 0x7fda48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda48004800 0x7fda48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda48005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c15dc80 con 0x7fda48004800 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda4800bb80 con 0x7fda480039e0 2024-04-16T15:37:06.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fda4800bd80 con 0x7fda5c15d710 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5259c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda48004800 0x7fda48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.756+0000 7fda5ad9d640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda480039e0 0x7fda48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5b59e640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda48005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 -- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 msgr2=0x7fda48005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda48005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 -- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda480039e0 msgr2=0x7fda48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda480039e0 0x7fda48003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 -- 172.21.15.80:0/119635482 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda48003520 con 0x7fda48004800 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5b59e640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c15d710 0x7fda48005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.757+0000 7fda5259c640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda48004800 0x7fda48004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fda44009ac0 tx=0x7fda48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a379ffc6b1ac1d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44039070 con 0x7fda48004800 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda4402c6b0 con 0x7fda48004800 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda5a59c640 1 -- 172.21.15.80:0/119635482 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44009690 con 0x7fda48004800 2024-04-16T15:37:06.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 -- 172.21.15.80:0/119635482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda48004800 msgr2=0x7fda48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 --2- 172.21.15.80:0/119635482 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda48004800 0x7fda48004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fda44009ac0 tx=0x7fda48005830 comp rx=0 tx=0).stop 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda5b59e640 1 -- 172.21.15.80:0/119635482 reap_dead start 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 -- 172.21.15.80:0/119635482 shutdown_connections 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 -- 172.21.15.80:0/119635482 >> 172.21.15.80:0/119635482 conn(0x7fda5c0cd610 msgr2=0x7fda5c0cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 -- 172.21.15.80:0/119635482 shutdown_connections 2024-04-16T15:37:06.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.758+0000 7fda61159640 1 -- 172.21.15.80:0/119635482 wait complete. 2024-04-16T15:37:06.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.759+0000 7fda61159640 1 Processor -- start 2024-04-16T15:37:06.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 -- start start 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 0x7fda5c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c149de0 0x7fda5c0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c0b0300 con 0x7fda5c1463f0 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c06ba30 con 0x7fda48004800 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda61159640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fda5c0b0480 con 0x7fda5c149de0 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda5b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda5b59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55094/0 (socket says 172.21.15.80:55094) 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.760+0000 7fda5b59e640 1 -- 172.21.15.80:0/2361585440 learned_addr learned my addr 172.21.15.80:0/2361585440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5ad9d640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 0x7fda5c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5259c640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c149de0 0x7fda5c0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 -- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c149de0 msgr2=0x7fda5c0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c149de0 0x7fda5c0aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 -- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 msgr2=0x7fda5c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 0x7fda5c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 -- 172.21.15.80:0/2361585440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c146d80 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5ad9d640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 0x7fda5c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda5b59e640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fda54000f80 tx=0x7fda5400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54006b50 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54006d10 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c0af4a0 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54003970 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.761+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c0b41f0 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.762+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c068a40 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.763+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda5401a020 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.763+0000 7fda53fff640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 0x7fda3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.763+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fda5408b3d0 con 0x7fda5c1463f0 2024-04-16T15:37:06.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.763+0000 7fda5ad9d640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 0x7fda3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:06.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.764+0000 7fda5ad9d640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 0x7fda3c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda4c000c00 tx=0x7fda4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:06.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.767+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda54059670 con 0x7fda5c1463f0 2024-04-16T15:37:06.938 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.939+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda5c15fb30 con 0x7fda3c06c8f0 2024-04-16T15:37:06.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.944+0000 7fda53fff640 1 -- 172.21.15.80:0/2361585440 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239277 (secure 0 0 0) 0x7fda5c15fb30 con 0x7fda3c06c8f0 2024-04-16T15:37:06.946 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:06.948 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:06.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 msgr2=0x7fda3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 0x7fda3c06edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda4c000c00 tx=0x7fda4c009040 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 msgr2=0x7fda5c146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fda54000f80 tx=0x7fda5400eb90 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 shutdown_connections 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fda5c1463f0 0x7fda5c146840 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fda3c06c8f0 0x7fda3c06edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fda5c149de0 0x7fda5c0aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 --2- 172.21.15.80:0/2361585440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda48004800 0x7fda5c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 >> 172.21.15.80:0/2361585440 conn(0x7fda5c0cd610 msgr2=0x7fda5c15dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 shutdown_connections 2024-04-16T15:37:06.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:06.947+0000 7fda61159640 1 -- 172.21.15.80:0/2361585440 wait complete. 2024-04-16T15:37:06.958 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-16T15:37:05.174173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220548,"kb_used_data":4348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754172,"statfs":{"total":773094113280,"available":772868272128,"internally_reserved":0,"allocated":4452352,"data_stored":2565965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000705"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292905+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:03.292905+0000","last_peered":"2024-04-16T15:37:03.292905+0000","last_clean":"2024-04-16T15:37:03.292905+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:03.292905+0000","last_undegraded":"2024-04-16T15:37:03.292905+0000","last_fullsized":"2024-04-16T15:37:03.292905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:14.060053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299362+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:03.299362+0000","last_peered":"2024-04-16T15:37:03.299362+0000","last_clean":"2024-04-16T15:37:03.299362+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:03.299362+0000","last_undegraded":"2024-04-16T15:37:03.299362+0000","last_fullsized":"2024-04-16T15:37:03.299362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299316+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:03.299316+0000","last_peered":"2024-04-16T15:37:03.299316+0000","last_clean":"2024-04-16T15:37:03.299316+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:03.299316+0000","last_undegraded":"2024-04-16T15:37:03.299316+0000","last_fullsized":"2024-04-16T15:37:03.299316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299338+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:03.299338+0000","last_peered":"2024-04-16T15:37:03.299338+0000","last_clean":"2024-04-16T15:37:03.299338+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:03.299338+0000","last_undegraded":"2024-04-16T15:37:03.299338+0000","last_fullsized":"2024-04-16T15:37:03.299338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299432+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:03.299432+0000","last_peered":"2024-04-16T15:37:03.299432+0000","last_clean":"2024-04-16T15:37:03.299432+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:03.299432+0000","last_undegraded":"2024-04-16T15:37:03.299432+0000","last_fullsized":"2024-04-16T15:37:03.299432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306392+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:03.306392+0000","last_peered":"2024-04-16T15:37:03.306392+0000","last_clean":"2024-04-16T15:37:03.306392+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:03.306392+0000","last_undegraded":"2024-04-16T15:37:03.306392+0000","last_fullsized":"2024-04-16T15:37:03.306392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299498+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:03.299498+0000","last_peered":"2024-04-16T15:37:03.299498+0000","last_clean":"2024-04-16T15:37:03.299498+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:03.299498+0000","last_undegraded":"2024-04-16T15:37:03.299498+0000","last_fullsized":"2024-04-16T15:37:03.299498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299426+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:03.299426+0000","last_peered":"2024-04-16T15:37:03.299426+0000","last_clean":"2024-04-16T15:37:03.299426+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:03.299426+0000","last_undegraded":"2024-04-16T15:37:03.299426+0000","last_fullsized":"2024-04-16T15:37:03.299426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.307283+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:03.307283+0000","last_peered":"2024-04-16T15:37:03.307283+0000","last_clean":"2024-04-16T15:37:03.307283+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:03.307283+0000","last_undegraded":"2024-04-16T15:37:03.307283+0000","last_fullsized":"2024-04-16T15:37:03.307283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299405+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:03.299405+0000","last_peered":"2024-04-16T15:37:03.299405+0000","last_clean":"2024-04-16T15:37:03.299405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:03.299405+0000","last_undegraded":"2024-04-16T15:37:03.299405+0000","last_fullsized":"2024-04-16T15:37:03.299405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.277502+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:03.277502+0000","last_peered":"2024-04-16T15:37:03.277502+0000","last_clean":"2024-04-16T15:37:03.277502+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:03.277502+0000","last_undegraded":"2024-04-16T15:37:03.277502+0000","last_fullsized":"2024-04-16T15:37:03.277502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299478+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:03.299478+0000","last_peered":"2024-04-16T15:37:03.299478+0000","last_clean":"2024-04-16T15:37:03.299478+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:03.299478+0000","last_undegraded":"2024-04-16T15:37:03.299478+0000","last_fullsized":"2024-04-16T15:37:03.299478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292524+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:03.292524+0000","last_peered":"2024-04-16T15:37:03.292524+0000","last_clean":"2024-04-16T15:37:03.292524+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:03.292524+0000","last_undegraded":"2024-04-16T15:37:03.292524+0000","last_fullsized":"2024-04-16T15:37:03.292524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:41.163158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:01.253388+0000","last_change":"2024-04-16T15:37:01.253388+0000","last_active":"2024-04-16T15:37:01.253388+0000","last_peered":"2024-04-16T15:37:01.253388+0000","last_clean":"2024-04-16T15:37:01.253388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:01.253388+0000","last_undegraded":"2024-04-16T15:37:01.253388+0000","last_fullsized":"2024-04-16T15:37:01.253388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-16T15:37:02.257211+0000","last_change":"2024-04-16T15:37:02.257211+0000","last_active":"2024-04-16T15:37:02.257211+0000","last_peered":"2024-04-16T15:37:02.257211+0000","last_clean":"2024-04-16T15:37:02.257211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-16T15:37:02.257211+0000","last_undegraded":"2024-04-16T15:37:02.257211+0000","last_fullsized":"2024-04-16T15:37:02.257211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.278441+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:03.278441+0000","last_peered":"2024-04-16T15:37:03.278441+0000","last_clean":"2024-04-16T15:37:03.278441+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:03.278441+0000","last_undegraded":"2024-04-16T15:37:03.278441+0000","last_fullsized":"2024-04-16T15:37:03.278441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.279728+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:03.279728+0000","last_peered":"2024-04-16T15:37:03.279728+0000","last_clean":"2024-04-16T15:37:03.279728+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:03.279728+0000","last_undegraded":"2024-04-16T15:37:03.279728+0000","last_fullsized":"2024-04-16T15:37:03.279728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":170438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":760806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-16T15:37:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-16T15:37:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-16T15:37:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-16T15:37:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-16T15:37:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-16T15:37:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-16T15:37:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-16T15:37:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:01.253388+0000', 'last_change': '2024-04-16T15:37:01.253388+0000', 'last_active': '2024-04-16T15:37:01.253388+0000', 'last_peered': '2024-04-16T15:37:01.253388+0000', 'last_clean': '2024-04-16T15:37:01.253388+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:01.253388+0000', 'last_undegraded': '2024-04-16T15:37:01.253388+0000', 'last_fullsized': '2024-04-16T15:37:01.253388+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:01.253388+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-16T15:37:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-16T15:37:02.257211+0000', 'last_change': '2024-04-16T15:37:02.257211+0000', 'last_active': '2024-04-16T15:37:02.257211+0000', 'last_peered': '2024-04-16T15:37:02.257211+0000', 'last_clean': '2024-04-16T15:37:02.257211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-16T15:37:02.257211+0000', 'last_undegraded': '2024-04-16T15:37:02.257211+0000', 'last_fullsized': '2024-04-16T15:37:02.257211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'last_clean_scrub_stamp': '2024-04-16T15:37:02.257211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-16T15:37:06.975 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-16T15:37:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.101+0000 7f39da5db640 1 Processor -- start 2024-04-16T15:37:07.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.101+0000 7f39da5db640 1 -- start start 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39da5db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39da5db640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39d40cf360 0x7f39d40cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39da5db640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d40cfd30 con 0x7f39d40d26d0 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39da5db640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f39d40ba670 con 0x7f39d40cf360 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39da5db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f39d40b7ce0 con 0x7f39d415e780 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d8b78640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f39d40cf360 0x7f39d40cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f39d40d26d0 0x7f39d40b9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:47624/0 (socket says 172.21.15.80:47624) 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d37fe640 1 -- 172.21.15.80:0/3357601809 learned_addr learned my addr 172.21.15.80:0/3357601809 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:07.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:44006/0 (socket says 172.21.15.80:44006) 2024-04-16T15:37:07.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 -- 172.21.15.80:0/3357601809 >> v2:172.21.15.87:3300/0 conn(0x7f39d40cf360 msgr2=0x7f39d40cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:07.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 --2- 172.21.15.80:0/3357601809 >> v2:172.21.15.87:3300/0 conn(0x7f39d40cf360 0x7f39d40cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 -- 172.21.15.80:0/3357601809 >> v1:172.21.15.87:6789/0 conn(0x7f39d40d26d0 legacy=0x7f39d40b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.102+0000 7f39d3fff640 1 -- 172.21.15.80:0/3357601809 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d40b7fc0 con 0x7f39d415e780 2024-04-16T15:37:07.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.103+0000 7f39d3fff640 1 --2- 172.21.15.80:0/3357601809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39c40097a0 tx=0x7f39c402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28b28a9c208a9223 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.103+0000 7f39d2ffd640 1 -- 172.21.15.80:0/3357601809 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4034070 con 0x7f39d415e780 2024-04-16T15:37:07.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.103+0000 7f39d2ffd640 1 -- 172.21.15.80:0/3357601809 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c4030610 con 0x7f39d415e780 2024-04-16T15:37:07.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.103+0000 7f39d2ffd640 1 -- 172.21.15.80:0/3357601809 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40309e0 con 0x7f39d415e780 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 -- 172.21.15.80:0/3357601809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 msgr2=0x7f39d40b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 --2- 172.21.15.80:0/3357601809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39c40097a0 tx=0x7f39c402b960 comp rx=0 tx=0).stop 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 -- 172.21.15.80:0/3357601809 shutdown_connections 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 --2- 172.21.15.80:0/3357601809 >> v2:172.21.15.87:3300/0 conn(0x7f39d40cf360 0x7f39d40cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 --2- 172.21.15.80:0/3357601809 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d415e780 0x7f39d40b7700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 -- 172.21.15.80:0/3357601809 >> 172.21.15.80:0/3357601809 conn(0x7f39d40734f0 msgr2=0x7f39d4073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 -- 172.21.15.80:0/3357601809 shutdown_connections 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.104+0000 7f39da5db640 1 -- 172.21.15.80:0/3357601809 wait complete. 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.105+0000 7f39da5db640 1 Processor -- start 2024-04-16T15:37:07.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.105+0000 7f39da5db640 1 -- start start 2024-04-16T15:37:07.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 0x7f39d41e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39d40d26d0 0x7f39d4161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f39d40b8860 con 0x7f39d415e780 2024-04-16T15:37:07.107 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f39d40b8580 con 0x7f39d40d26d0 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39da5db640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f39d415eb60 con 0x7f39d40cf360 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 0x7f39d41e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55100/0 (socket says 172.21.15.80:55100) 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 -- 172.21.15.80:0/3248563247 learned_addr learned my addr 172.21.15.80:0/3248563247 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d37fe640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39d40d26d0 0x7f39d4161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 -- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 msgr2=0x7f39d41e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 0x7f39d41e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 -- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39d40d26d0 msgr2=0x7f39d4161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39d40d26d0 0x7f39d4161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d8b78640 1 -- 172.21.15.80:0/3248563247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d41f5b50 con 0x7f39d415e780 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.106+0000 7f39d3fff640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 0x7f39d41e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39d8b78640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00efc0 tx=0x7f39cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc018020 con 0x7f39d415e780 2024-04-16T15:37:07.108 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc014480 con 0x7f39d415e780 2024-04-16T15:37:07.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d41f5df0 con 0x7f39d415e780 2024-04-16T15:37:07.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc014870 con 0x7f39d415e780 2024-04-16T15:37:07.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.107+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d41f63b0 con 0x7f39d415e780 2024-04-16T15:37:07.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.108+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d4068a40 con 0x7f39d415e780 2024-04-16T15:37:07.109 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.108+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39cc005d10 con 0x7f39d415e780 2024-04-16T15:37:07.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.109+0000 7f39d0ff9640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 0x7f39c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.109+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f39cc08c5d0 con 0x7f39d415e780 2024-04-16T15:37:07.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.109+0000 7f39d3fff640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 0x7f39c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.110 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.109+0000 7f39d3fff640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 0x7f39c006edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39c4036000 tx=0x7f39c403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.112 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.113+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39cc022070 con 0x7f39d415e780 2024-04-16T15:37:07.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-16T15:37:07.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.362+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f39d40d3480 con 0x7f39d415e780 2024-04-16T15:37:07.362 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.363+0000 7f39d0ff9640 1 -- 172.21.15.80:0/3248563247 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f39cc010040 con 0x7f39d415e780 2024-04-16T15:37:07.362 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:07.362 INFO:teuthology.orchestra.run.smithi080.stdout:{"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":104,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1713281734,"num_in_osds":8,"osd_in_since":1713281725,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":226164736,"bytes_avail":772867948544,"bytes_total":773094113280,"write_bytes_sec":2422,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5523}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-16T15:36:53.171963+0000","services":{}},"progress_events":{}} 2024-04-16T15:37:07.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.364+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 msgr2=0x7f39c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.364+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 0x7f39c006edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39c4036000 tx=0x7f39c403b040 comp rx=0 tx=0).stop 2024-04-16T15:37:07.364 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.364+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 msgr2=0x7f39d41e7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00efc0 tx=0x7f39cc00c490 comp rx=0 tx=0).stop 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 shutdown_connections 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f39d415e780 0x7f39d41e7d60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39d40d26d0 0x7f39d4161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f39c006c8f0 0x7f39c006edb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 --2- 172.21.15.80:0/3248563247 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f39d40cf360 0x7f39d41e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 >> 172.21.15.80:0/3248563247 conn(0x7f39d40734f0 msgr2=0x7f39d40b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 shutdown_connections 2024-04-16T15:37:07.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.365+0000 7f39da5db640 1 -- 172.21.15.80:0/3248563247 wait complete. 2024-04-16T15:37:07.375 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-16T15:37:07.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:07.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.478+0000 7f0553e16640 1 Processor -- start 2024-04-16T15:37:07.478 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.478+0000 7f0553e16640 1 -- start start 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0553e16640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f054c071eb0 0x7f054c072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0553e16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0553e16640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c0727d0 con 0x7f054c0ce460 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0553e16640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f054c0b57a0 con 0x7f054c071eb0 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0553e16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f054c0afbe0 con 0x7f054c15c0f0 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f05513b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f0551bb2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f054c071eb0 0x7f054c072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f05523b3640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f054c0ce460 0x7f054c0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:47638/0 (socket says 172.21.15.80:47638) 2024-04-16T15:37:07.479 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f05513b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:44016/0 (socket says 172.21.15.80:44016) 2024-04-16T15:37:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.479+0000 7f05523b3640 1 -- 172.21.15.80:0/1877557640 learned_addr learned my addr 172.21.15.80:0/1877557640 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.480+0000 7f05513b1640 1 -- 172.21.15.80:0/1877557640 >> v2:172.21.15.87:3300/0 conn(0x7f054c071eb0 msgr2=0x7f054c072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.480+0000 7f05513b1640 1 --2- 172.21.15.80:0/1877557640 >> v2:172.21.15.87:3300/0 conn(0x7f054c071eb0 0x7f054c072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.480+0000 7f05513b1640 1 -- 172.21.15.80:0/1877557640 >> v1:172.21.15.87:6789/0 conn(0x7f054c0ce460 legacy=0x7f054c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.480+0000 7f05513b1640 1 -- 172.21.15.80:0/1877557640 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c0afec0 con 0x7f054c15c0f0 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.480+0000 7f05513b1640 1 --2- 172.21.15.80:0/1877557640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097a0 tx=0x7f053c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd4ae0f408d51b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0550bb0640 1 -- 172.21.15.80:0/1877557640 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0315a0 con 0x7f054c15c0f0 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0550bb0640 1 -- 172.21.15.80:0/1877557640 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c037070 con 0x7f054c15c0f0 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0550bb0640 1 -- 172.21.15.80:0/1877557640 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c031960 con 0x7f054c15c0f0 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 -- 172.21.15.80:0/1877557640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 msgr2=0x7f054c0b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.481 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 --2- 172.21.15.80:0/1877557640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f053c0097a0 tx=0x7f053c02b840 comp rx=0 tx=0).stop 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 -- 172.21.15.80:0/1877557640 shutdown_connections 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 --2- 172.21.15.80:0/1877557640 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c0b3610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 --2- 172.21.15.80:0/1877557640 >> v2:172.21.15.87:3300/0 conn(0x7f054c071eb0 0x7f054c072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 -- 172.21.15.80:0/1877557640 >> 172.21.15.80:0/1877557640 conn(0x7f054c0b2940 msgr2=0x7f054c06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 -- 172.21.15.80:0/1877557640 shutdown_connections 2024-04-16T15:37:07.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.481+0000 7f0553e16640 1 -- 172.21.15.80:0/1877557640 wait complete. 2024-04-16T15:37:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.482+0000 7f0553e16640 1 Processor -- start 2024-04-16T15:37:07.484 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.482+0000 7f0553e16640 1 -- start start 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c071eb0 0x7f054c140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0b3b50 con 0x7f054c0ce460 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0b50e0 con 0x7f054c071eb0 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0553e16640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f054c140d90 con 0x7f054c15c0f0 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f05513b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f05513b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55104/0 (socket says 172.21.15.80:55104) 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f05513b1640 1 -- 172.21.15.80:0/2100913917 learned_addr learned my addr 172.21.15.80:0/2100913917 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f0551bb2640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c071eb0 0x7f054c140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.483+0000 7f05523b3640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 -- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 msgr2=0x7f054c1f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.485 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c1f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 -- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c071eb0 msgr2=0x7f054c140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c071eb0 0x7f054c140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 -- 172.21.15.80:0/2100913917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c1f2560 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05513b1640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f053c02b880 tx=0x7f053c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c032630 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0327d0 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c032bc0 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c1f2840 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.484+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c143b20 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.485+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c14b340 con 0x7f054c0ce460 2024-04-16T15:37:07.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.485+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f053c04d3f0 con 0x7f054c0ce460 2024-04-16T15:37:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.486+0000 7f05427fc640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.486+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f053c02f030 con 0x7f054c0ce460 2024-04-16T15:37:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.486+0000 7f0551bb2640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:07.487 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.486+0000 7f0551bb2640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 0x7f053006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0548011340 tx=0x7f054800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:07.489 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.490+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f053c040070 con 0x7f054c0ce460 2024-04-16T15:37:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.661+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f054c1f2a10 con 0x7f053006c8f0 2024-04-16T15:37:07.666 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.667+0000 7f05427fc640 1 -- 172.21.15.80:0/2100913917 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251921 (secure 0 0 0) 0x7f0548003990 con 0x7f053006c8f0 2024-04-16T15:37:07.669 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:07.670 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 msgr2=0x7f053006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 0x7f053006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0548011340 tx=0x7f054800b040 comp rx=0 tx=0).stop 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 msgr2=0x7f054c1f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f053c02b880 tx=0x7f053c0046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 shutdown_connections 2024-04-16T15:37:07.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f054c15c0f0 0x7f054c1f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f054c0ce460 0x7f054c1f1a00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 --2- 172.21.15.80:0/2100913917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f054c071eb0 0x7f054c140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 >> 172.21.15.80:0/2100913917 conn(0x7f054c0b2940 msgr2=0x7f054c154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 shutdown_connections 2024-04-16T15:37:07.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:07.670+0000 7f0553e16640 1 -- 172.21.15.80:0/2100913917 wait complete. 2024-04-16T15:37:07.680 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-16T15:37:07.174504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220864,"kb_used_data":4684,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753856,"statfs":{"total":773094113280,"available":772867948544,"internally_reserved":0,"allocated":4796416,"data_stored":2729480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.916676"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303357+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:03.303357+0000","last_peered":"2024-04-16T15:37:03.303357+0000","last_clean":"2024-04-16T15:37:03.303357+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:03.303357+0000","last_undegraded":"2024-04-16T15:37:03.303357+0000","last_fullsized":"2024-04-16T15:37:03.303357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.291457+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:03.291457+0000","last_peered":"2024-04-16T15:37:03.291457+0000","last_clean":"2024-04-16T15:37:03.291457+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:03.291457+0000","last_undegraded":"2024-04-16T15:37:03.291457+0000","last_fullsized":"2024-04-16T15:37:03.291457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302342+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:03.302342+0000","last_peered":"2024-04-16T15:37:03.302342+0000","last_clean":"2024-04-16T15:37:03.302342+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:03.302342+0000","last_undegraded":"2024-04-16T15:37:03.302342+0000","last_fullsized":"2024-04-16T15:37:03.302342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.293618+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:03.293618+0000","last_peered":"2024-04-16T15:37:03.293618+0000","last_clean":"2024-04-16T15:37:03.293618+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:03.293618+0000","last_undegraded":"2024-04-16T15:37:03.293618+0000","last_fullsized":"2024-04-16T15:37:03.293618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.297897+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:03.297897+0000","last_peered":"2024-04-16T15:37:03.297897+0000","last_clean":"2024-04-16T15:37:03.297897+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:03.297897+0000","last_undegraded":"2024-04-16T15:37:03.297897+0000","last_fullsized":"2024-04-16T15:37:03.297897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292905+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:03.292905+0000","last_peered":"2024-04-16T15:37:03.292905+0000","last_clean":"2024-04-16T15:37:03.292905+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:03.292905+0000","last_undegraded":"2024-04-16T15:37:03.292905+0000","last_fullsized":"2024-04-16T15:37:03.292905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:14.060053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299362+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:03.299362+0000","last_peered":"2024-04-16T15:37:03.299362+0000","last_clean":"2024-04-16T15:37:03.299362+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:03.299362+0000","last_undegraded":"2024-04-16T15:37:03.299362+0000","last_fullsized":"2024-04-16T15:37:03.299362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295434+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:03.295434+0000","last_peered":"2024-04-16T15:37:03.295434+0000","last_clean":"2024-04-16T15:37:03.295434+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:03.295434+0000","last_undegraded":"2024-04-16T15:37:03.295434+0000","last_fullsized":"2024-04-16T15:37:03.295434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299316+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:03.299316+0000","last_peered":"2024-04-16T15:37:03.299316+0000","last_clean":"2024-04-16T15:37:03.299316+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:03.299316+0000","last_undegraded":"2024-04-16T15:37:03.299316+0000","last_fullsized":"2024-04-16T15:37:03.299316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302438+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:03.302438+0000","last_peered":"2024-04-16T15:37:03.302438+0000","last_clean":"2024-04-16T15:37:03.302438+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:03.302438+0000","last_undegraded":"2024-04-16T15:37:03.302438+0000","last_fullsized":"2024-04-16T15:37:03.302438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299338+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:03.299338+0000","last_peered":"2024-04-16T15:37:03.299338+0000","last_clean":"2024-04-16T15:37:03.299338+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:03.299338+0000","last_undegraded":"2024-04-16T15:37:03.299338+0000","last_fullsized":"2024-04-16T15:37:03.299338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302468+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:03.302468+0000","last_peered":"2024-04-16T15:37:03.302468+0000","last_clean":"2024-04-16T15:37:03.302468+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:03.302468+0000","last_undegraded":"2024-04-16T15:37:03.302468+0000","last_fullsized":"2024-04-16T15:37:03.302468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299432+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:03.299432+0000","last_peered":"2024-04-16T15:37:03.299432+0000","last_clean":"2024-04-16T15:37:03.299432+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:03.299432+0000","last_undegraded":"2024-04-16T15:37:03.299432+0000","last_fullsized":"2024-04-16T15:37:03.299432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303520+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:03.303520+0000","last_peered":"2024-04-16T15:37:03.303520+0000","last_clean":"2024-04-16T15:37:03.303520+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:03.303520+0000","last_undegraded":"2024-04-16T15:37:03.303520+0000","last_fullsized":"2024-04-16T15:37:03.303520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:35.334660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.304033+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:03.304033+0000","last_peered":"2024-04-16T15:37:03.304033+0000","last_clean":"2024-04-16T15:37:03.304033+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:03.304033+0000","last_undegraded":"2024-04-16T15:37:03.304033+0000","last_fullsized":"2024-04-16T15:37:03.304033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.298312+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:03.298312+0000","last_peered":"2024-04-16T15:37:03.298312+0000","last_clean":"2024-04-16T15:37:03.298312+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:03.298312+0000","last_undegraded":"2024-04-16T15:37:03.298312+0000","last_fullsized":"2024-04-16T15:37:03.298312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302903+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:03.302903+0000","last_peered":"2024-04-16T15:37:03.302903+0000","last_clean":"2024-04-16T15:37:03.302903+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:03.302903+0000","last_undegraded":"2024-04-16T15:37:03.302903+0000","last_fullsized":"2024-04-16T15:37:03.302903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.305334+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:03.305334+0000","last_peered":"2024-04-16T15:37:03.305334+0000","last_clean":"2024-04-16T15:37:03.305334+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:03.305334+0000","last_undegraded":"2024-04-16T15:37:03.305334+0000","last_fullsized":"2024-04-16T15:37:03.305334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.300603+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:03.300603+0000","last_peered":"2024-04-16T15:37:03.300603+0000","last_clean":"2024-04-16T15:37:03.300603+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:03.300603+0000","last_undegraded":"2024-04-16T15:37:03.300603+0000","last_fullsized":"2024-04-16T15:37:03.300603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306392+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:03.306392+0000","last_peered":"2024-04-16T15:37:03.306392+0000","last_clean":"2024-04-16T15:37:03.306392+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:03.306392+0000","last_undegraded":"2024-04-16T15:37:03.306392+0000","last_fullsized":"2024-04-16T15:37:03.306392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.300236+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:03.300236+0000","last_peered":"2024-04-16T15:37:03.300236+0000","last_clean":"2024-04-16T15:37:03.300236+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:03.300236+0000","last_undegraded":"2024-04-16T15:37:03.300236+0000","last_fullsized":"2024-04-16T15:37:03.300236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:35.334660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281229+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:03.281229+0000","last_peered":"2024-04-16T15:37:03.281229+0000","last_clean":"2024-04-16T15:37:03.281229+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:03.281229+0000","last_undegraded":"2024-04-16T15:37:03.281229+0000","last_fullsized":"2024-04-16T15:37:03.281229+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.282897+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:03.282897+0000","last_peered":"2024-04-16T15:37:03.282897+0000","last_clean":"2024-04-16T15:37:03.282897+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:03.282897+0000","last_undegraded":"2024-04-16T15:37:03.282897+0000","last_fullsized":"2024-04-16T15:37:03.282897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299498+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:03.299498+0000","last_peered":"2024-04-16T15:37:03.299498+0000","last_clean":"2024-04-16T15:37:03.299498+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:03.299498+0000","last_undegraded":"2024-04-16T15:37:03.299498+0000","last_fullsized":"2024-04-16T15:37:03.299498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295752+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:03.295752+0000","last_peered":"2024-04-16T15:37:03.295752+0000","last_clean":"2024-04-16T15:37:03.295752+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:03.295752+0000","last_undegraded":"2024-04-16T15:37:03.295752+0000","last_fullsized":"2024-04-16T15:37:03.295752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295192+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:03.295192+0000","last_peered":"2024-04-16T15:37:03.295192+0000","last_clean":"2024-04-16T15:37:03.295192+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:03.295192+0000","last_undegraded":"2024-04-16T15:37:03.295192+0000","last_fullsized":"2024-04-16T15:37:03.295192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303293+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:03.303293+0000","last_peered":"2024-04-16T15:37:03.303293+0000","last_clean":"2024-04-16T15:37:03.303293+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:03.303293+0000","last_undegraded":"2024-04-16T15:37:03.303293+0000","last_fullsized":"2024-04-16T15:37:03.303293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281458+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:03.281458+0000","last_peered":"2024-04-16T15:37:03.281458+0000","last_clean":"2024-04-16T15:37:03.281458+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:03.281458+0000","last_undegraded":"2024-04-16T15:37:03.281458+0000","last_fullsized":"2024-04-16T15:37:03.281458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299426+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:03.299426+0000","last_peered":"2024-04-16T15:37:03.299426+0000","last_clean":"2024-04-16T15:37:03.299426+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:03.299426+0000","last_undegraded":"2024-04-16T15:37:03.299426+0000","last_fullsized":"2024-04-16T15:37:03.299426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.307283+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:03.307283+0000","last_peered":"2024-04-16T15:37:03.307283+0000","last_clean":"2024-04-16T15:37:03.307283+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:03.307283+0000","last_undegraded":"2024-04-16T15:37:03.307283+0000","last_fullsized":"2024-04-16T15:37:03.307283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:03.306967+0000","last_peered":"2024-04-16T15:37:03.306967+0000","last_clean":"2024-04-16T15:37:03.306967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:03.306967+0000","last_undegraded":"2024-04-16T15:37:03.306967+0000","last_fullsized":"2024-04-16T15:37:03.306967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299900+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:03.299900+0000","last_peered":"2024-04-16T15:37:03.299900+0000","last_clean":"2024-04-16T15:37:03.299900+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:03.299900+0000","last_undegraded":"2024-04-16T15:37:03.299900+0000","last_fullsized":"2024-04-16T15:37:03.299900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281048+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:03.281048+0000","last_peered":"2024-04-16T15:37:03.281048+0000","last_clean":"2024-04-16T15:37:03.281048+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:03.281048+0000","last_undegraded":"2024-04-16T15:37:03.281048+0000","last_fullsized":"2024-04-16T15:37:03.281048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299405+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:03.299405+0000","last_peered":"2024-04-16T15:37:03.299405+0000","last_clean":"2024-04-16T15:37:03.299405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:03.299405+0000","last_undegraded":"2024-04-16T15:37:03.299405+0000","last_fullsized":"2024-04-16T15:37:03.299405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302579+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:03.302579+0000","last_peered":"2024-04-16T15:37:03.302579+0000","last_clean":"2024-04-16T15:37:03.302579+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:03.302579+0000","last_undegraded":"2024-04-16T15:37:03.302579+0000","last_fullsized":"2024-04-16T15:37:03.302579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.277502+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:03.277502+0000","last_peered":"2024-04-16T15:37:03.277502+0000","last_clean":"2024-04-16T15:37:03.277502+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:03.277502+0000","last_undegraded":"2024-04-16T15:37:03.277502+0000","last_fullsized":"2024-04-16T15:37:03.277502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302949+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:03.302949+0000","last_peered":"2024-04-16T15:37:03.302949+0000","last_clean":"2024-04-16T15:37:03.302949+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:03.302949+0000","last_undegraded":"2024-04-16T15:37:03.302949+0000","last_fullsized":"2024-04-16T15:37:03.302949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299478+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:03.299478+0000","last_peered":"2024-04-16T15:37:03.299478+0000","last_clean":"2024-04-16T15:37:03.299478+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:03.299478+0000","last_undegraded":"2024-04-16T15:37:03.299478+0000","last_fullsized":"2024-04-16T15:37:03.299478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.285659+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:03.285659+0000","last_peered":"2024-04-16T15:37:03.285659+0000","last_clean":"2024-04-16T15:37:03.285659+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:03.285659+0000","last_undegraded":"2024-04-16T15:37:03.285659+0000","last_fullsized":"2024-04-16T15:37:03.285659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.296285+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:03.296285+0000","last_peered":"2024-04-16T15:37:03.296285+0000","last_clean":"2024-04-16T15:37:03.296285+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:03.296285+0000","last_undegraded":"2024-04-16T15:37:03.296285+0000","last_fullsized":"2024-04-16T15:37:03.296285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.283926+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:03.283926+0000","last_peered":"2024-04-16T15:37:03.283926+0000","last_clean":"2024-04-16T15:37:03.283926+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:03.283926+0000","last_undegraded":"2024-04-16T15:37:03.283926+0000","last_fullsized":"2024-04-16T15:37:03.283926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.297350+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:03.297350+0000","last_peered":"2024-04-16T15:37:03.297350+0000","last_clean":"2024-04-16T15:37:03.297350+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:03.297350+0000","last_undegraded":"2024-04-16T15:37:03.297350+0000","last_fullsized":"2024-04-16T15:37:03.297350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295409+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:03.295409+0000","last_peered":"2024-04-16T15:37:03.295409+0000","last_clean":"2024-04-16T15:37:03.295409+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:03.295409+0000","last_undegraded":"2024-04-16T15:37:03.295409+0000","last_fullsized":"2024-04-16T15:37:03.295409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281152+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:03.281152+0000","last_peered":"2024-04-16T15:37:03.281152+0000","last_clean":"2024-04-16T15:37:03.281152+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:03.281152+0000","last_undegraded":"2024-04-16T15:37:03.281152+0000","last_fullsized":"2024-04-16T15:37:03.281152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292524+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:03.292524+0000","last_peered":"2024-04-16T15:37:03.292524+0000","last_clean":"2024-04-16T15:37:03.292524+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:03.292524+0000","last_undegraded":"2024-04-16T15:37:03.292524+0000","last_fullsized":"2024-04-16T15:37:03.292524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:41.163158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.278441+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:03.278441+0000","last_peered":"2024-04-16T15:37:03.278441+0000","last_clean":"2024-04-16T15:37:03.278441+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:03.278441+0000","last_undegraded":"2024-04-16T15:37:03.278441+0000","last_fullsized":"2024-04-16T15:37:03.278441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.279728+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:03.279728+0000","last_peered":"2024-04-16T15:37:03.279728+0000","last_clean":"2024-04-16T15:37:03.279728+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:03.279728+0000","last_undegraded":"2024-04-16T15:37:03.279728+0000","last_fullsized":"2024-04-16T15:37:03.279728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":191085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":780883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:10.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.799+0000 7ff7a80b3640 1 Processor -- start 2024-04-16T15:37:10.798 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.799+0000 7ff7a80b3640 1 -- start start 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a80b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a80b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7a00b3d60 0x7ff7a00ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a80b3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a00ae360 con 0x7ff7a00ade20 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a80b3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a006f4e0 con 0x7ff7a00b3d60 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a80b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a00ae920 con 0x7ff7a015c4a0 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a6650640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff7a00ade20 0x7ff7a00af4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41744/0 (socket says 172.21.15.80:41744) 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a6650640 1 -- 172.21.15.80:0/51239068 learned_addr learned my addr 172.21.15.80:0/51239068 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:10.800 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a564e640 1 --2- 172.21.15.80:0/51239068 >> v2:172.21.15.87:3300/0 conn(0x7ff7a00b3d60 0x7ff7a00ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a5e4f640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a4e4d640 1 -- 172.21.15.80:0/51239068 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180685281 0 0) 0x7ff7a00ae360 con 0x7ff7a00ade20 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a4e4d640 1 -- 172.21.15.80:0/51239068 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff78c003520 con 0x7ff7a00ade20 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a564e640 1 -- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 msgr2=0x7ff7a00b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a564e640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a00b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a564e640 1 -- 172.21.15.80:0/51239068 >> v1:172.21.15.80:6789/0 conn(0x7ff7a00ade20 legacy=0x7ff7a00af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.801 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.800+0000 7ff7a564e640 1 -- 172.21.15.80:0/51239068 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a00ae640 con 0x7ff7a00b3d60 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.801+0000 7ff7a564e640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00b3d60 0x7ff7a00ad8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097a0 tx=0x7ff79002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc47787a3f792b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.801+0000 7ff7a4e4d640 1 -- 172.21.15.80:0/51239068 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790035020 con 0x7ff7a00b3d60 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.801+0000 7ff7a4e4d640 1 -- 172.21.15.80:0/51239068 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff790031830 con 0x7ff7a00b3d60 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.801+0000 7ff7a4e4d640 1 -- 172.21.15.80:0/51239068 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790031c00 con 0x7ff7a00b3d60 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 -- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00b3d60 msgr2=0x7ff7a00ad8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00b3d60 0x7ff7a00ad8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7900097a0 tx=0x7ff79002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 -- 172.21.15.80:0/51239068 shutdown_connections 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00b3d60 0x7ff7a00ad8e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/51239068 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a00b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 -- 172.21.15.80:0/51239068 >> 172.21.15.80:0/51239068 conn(0x7ff7a00b2520 msgr2=0x7ff7a00b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 -- 172.21.15.80:0/51239068 shutdown_connections 2024-04-16T15:37:10.803 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.802+0000 7ff7a80b3640 1 -- 172.21.15.80:0/51239068 wait complete. 2024-04-16T15:37:10.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.803+0000 7ff7a80b3640 1 Processor -- start 2024-04-16T15:37:10.804 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.803+0000 7ff7a80b3640 1 -- start start 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00ade20 0x7ff7a0149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a0162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a015efe0 con 0x7ff7a015a6f0 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a006f9f0 con 0x7ff7a00ade20 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a80b3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a00afbf0 con 0x7ff7a015c4a0 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a6650640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.806 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a6650640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55106/0 (socket says 172.21.15.80:55106) 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a6650640 1 -- 172.21.15.80:0/1932659045 learned_addr learned my addr 172.21.15.80:0/1932659045 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a564e640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a0162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.804+0000 7ff7a5e4f640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00ade20 0x7ff7a0149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 -- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 msgr2=0x7ff7a0162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a0162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 -- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00ade20 msgr2=0x7ff7a0149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00ade20 0x7ff7a0149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 -- 172.21.15.80:0/1932659045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a0160b50 con 0x7ff7a015a6f0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a6650640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff79800cb10 tx=0x7ff79800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798017070 con 0x7ff7a015a6f0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79800ac10 con 0x7ff7a015a6f0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a0160e30 con 0x7ff7a015a6f0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798012400 con 0x7ff7a015a6f0 2024-04-16T15:37:10.807 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.805+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a01613f0 con 0x7ff7a015a6f0 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.806+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a0068a40 con 0x7ff7a015a6f0 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.806+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff79801a070 con 0x7ff7a015a6f0 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.807+0000 7ff7967fc640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 0x7ff78406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.807+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff79808ba80 con 0x7ff7a015a6f0 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.807+0000 7ff7a5e4f640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 0x7ff78406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:10.808 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.807+0000 7ff7a5e4f640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 0x7ff78406edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009aa0 tx=0x7ff79c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:10.810 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.811+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff798059650 con 0x7ff7a015a6f0 2024-04-16T15:37:10.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.982+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7a00b5710 con 0x7ff78406c8f0 2024-04-16T15:37:10.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.988+0000 7ff7967fc640 1 -- 172.21.15.80:0/1932659045 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251921 (secure 0 0 0) 0x7ff7a00b5710 con 0x7ff78406c8f0 2024-04-16T15:37:10.990 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:10.992 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 msgr2=0x7ff78406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 0x7ff78406edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009aa0 tx=0x7ff79c009190 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 msgr2=0x7ff7a015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff79800cb10 tx=0x7ff79800a060 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 shutdown_connections 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff7a015a6f0 0x7ff7a015ab80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff78406c8f0 0x7ff78406edb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff7a015c4a0 0x7ff7a0162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 --2- 172.21.15.80:0/1932659045 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7a00ade20 0x7ff7a0149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 >> 172.21.15.80:0/1932659045 conn(0x7ff7a00b2520 msgr2=0x7ff7a01578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:10.994 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 shutdown_connections 2024-04-16T15:37:10.995 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:10.991+0000 7ff7a80b3640 1 -- 172.21.15.80:0/1932659045 wait complete. 2024-04-16T15:37:11.002 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-16T15:37:09.174930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220864,"kb_used_data":4684,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753856,"statfs":{"total":773094113280,"available":772867948544,"internally_reserved":0,"allocated":4796416,"data_stored":2729480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.911433"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303357+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:03.303357+0000","last_peered":"2024-04-16T15:37:03.303357+0000","last_clean":"2024-04-16T15:37:03.303357+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:03.303357+0000","last_undegraded":"2024-04-16T15:37:03.303357+0000","last_fullsized":"2024-04-16T15:37:03.303357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.291457+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:03.291457+0000","last_peered":"2024-04-16T15:37:03.291457+0000","last_clean":"2024-04-16T15:37:03.291457+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:03.291457+0000","last_undegraded":"2024-04-16T15:37:03.291457+0000","last_fullsized":"2024-04-16T15:37:03.291457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302342+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:03.302342+0000","last_peered":"2024-04-16T15:37:03.302342+0000","last_clean":"2024-04-16T15:37:03.302342+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:03.302342+0000","last_undegraded":"2024-04-16T15:37:03.302342+0000","last_fullsized":"2024-04-16T15:37:03.302342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.293618+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:03.293618+0000","last_peered":"2024-04-16T15:37:03.293618+0000","last_clean":"2024-04-16T15:37:03.293618+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:03.293618+0000","last_undegraded":"2024-04-16T15:37:03.293618+0000","last_fullsized":"2024-04-16T15:37:03.293618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.297897+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:03.297897+0000","last_peered":"2024-04-16T15:37:03.297897+0000","last_clean":"2024-04-16T15:37:03.297897+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:03.297897+0000","last_undegraded":"2024-04-16T15:37:03.297897+0000","last_fullsized":"2024-04-16T15:37:03.297897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292905+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:03.292905+0000","last_peered":"2024-04-16T15:37:03.292905+0000","last_clean":"2024-04-16T15:37:03.292905+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:03.292905+0000","last_undegraded":"2024-04-16T15:37:03.292905+0000","last_fullsized":"2024-04-16T15:37:03.292905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:14.060053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299362+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:03.299362+0000","last_peered":"2024-04-16T15:37:03.299362+0000","last_clean":"2024-04-16T15:37:03.299362+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:03.299362+0000","last_undegraded":"2024-04-16T15:37:03.299362+0000","last_fullsized":"2024-04-16T15:37:03.299362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295434+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:03.295434+0000","last_peered":"2024-04-16T15:37:03.295434+0000","last_clean":"2024-04-16T15:37:03.295434+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:03.295434+0000","last_undegraded":"2024-04-16T15:37:03.295434+0000","last_fullsized":"2024-04-16T15:37:03.295434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299316+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:03.299316+0000","last_peered":"2024-04-16T15:37:03.299316+0000","last_clean":"2024-04-16T15:37:03.299316+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:03.299316+0000","last_undegraded":"2024-04-16T15:37:03.299316+0000","last_fullsized":"2024-04-16T15:37:03.299316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302438+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:03.302438+0000","last_peered":"2024-04-16T15:37:03.302438+0000","last_clean":"2024-04-16T15:37:03.302438+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:03.302438+0000","last_undegraded":"2024-04-16T15:37:03.302438+0000","last_fullsized":"2024-04-16T15:37:03.302438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299338+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:03.299338+0000","last_peered":"2024-04-16T15:37:03.299338+0000","last_clean":"2024-04-16T15:37:03.299338+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:03.299338+0000","last_undegraded":"2024-04-16T15:37:03.299338+0000","last_fullsized":"2024-04-16T15:37:03.299338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302468+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:03.302468+0000","last_peered":"2024-04-16T15:37:03.302468+0000","last_clean":"2024-04-16T15:37:03.302468+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:03.302468+0000","last_undegraded":"2024-04-16T15:37:03.302468+0000","last_fullsized":"2024-04-16T15:37:03.302468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299432+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:03.299432+0000","last_peered":"2024-04-16T15:37:03.299432+0000","last_clean":"2024-04-16T15:37:03.299432+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:03.299432+0000","last_undegraded":"2024-04-16T15:37:03.299432+0000","last_fullsized":"2024-04-16T15:37:03.299432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303520+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:03.303520+0000","last_peered":"2024-04-16T15:37:03.303520+0000","last_clean":"2024-04-16T15:37:03.303520+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:03.303520+0000","last_undegraded":"2024-04-16T15:37:03.303520+0000","last_fullsized":"2024-04-16T15:37:03.303520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:35.334660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.304033+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:03.304033+0000","last_peered":"2024-04-16T15:37:03.304033+0000","last_clean":"2024-04-16T15:37:03.304033+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:03.304033+0000","last_undegraded":"2024-04-16T15:37:03.304033+0000","last_fullsized":"2024-04-16T15:37:03.304033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.298312+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:03.298312+0000","last_peered":"2024-04-16T15:37:03.298312+0000","last_clean":"2024-04-16T15:37:03.298312+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:03.298312+0000","last_undegraded":"2024-04-16T15:37:03.298312+0000","last_fullsized":"2024-04-16T15:37:03.298312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302903+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:03.302903+0000","last_peered":"2024-04-16T15:37:03.302903+0000","last_clean":"2024-04-16T15:37:03.302903+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:03.302903+0000","last_undegraded":"2024-04-16T15:37:03.302903+0000","last_fullsized":"2024-04-16T15:37:03.302903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.305334+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:03.305334+0000","last_peered":"2024-04-16T15:37:03.305334+0000","last_clean":"2024-04-16T15:37:03.305334+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:03.305334+0000","last_undegraded":"2024-04-16T15:37:03.305334+0000","last_fullsized":"2024-04-16T15:37:03.305334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.300603+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:03.300603+0000","last_peered":"2024-04-16T15:37:03.300603+0000","last_clean":"2024-04-16T15:37:03.300603+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:03.300603+0000","last_undegraded":"2024-04-16T15:37:03.300603+0000","last_fullsized":"2024-04-16T15:37:03.300603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306392+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:03.306392+0000","last_peered":"2024-04-16T15:37:03.306392+0000","last_clean":"2024-04-16T15:37:03.306392+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:03.306392+0000","last_undegraded":"2024-04-16T15:37:03.306392+0000","last_fullsized":"2024-04-16T15:37:03.306392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.300236+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:03.300236+0000","last_peered":"2024-04-16T15:37:03.300236+0000","last_clean":"2024-04-16T15:37:03.300236+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:03.300236+0000","last_undegraded":"2024-04-16T15:37:03.300236+0000","last_fullsized":"2024-04-16T15:37:03.300236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:35.334660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281229+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:03.281229+0000","last_peered":"2024-04-16T15:37:03.281229+0000","last_clean":"2024-04-16T15:37:03.281229+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:03.281229+0000","last_undegraded":"2024-04-16T15:37:03.281229+0000","last_fullsized":"2024-04-16T15:37:03.281229+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.282897+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:03.282897+0000","last_peered":"2024-04-16T15:37:03.282897+0000","last_clean":"2024-04-16T15:37:03.282897+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:03.282897+0000","last_undegraded":"2024-04-16T15:37:03.282897+0000","last_fullsized":"2024-04-16T15:37:03.282897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299498+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:03.299498+0000","last_peered":"2024-04-16T15:37:03.299498+0000","last_clean":"2024-04-16T15:37:03.299498+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:03.299498+0000","last_undegraded":"2024-04-16T15:37:03.299498+0000","last_fullsized":"2024-04-16T15:37:03.299498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295752+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:03.295752+0000","last_peered":"2024-04-16T15:37:03.295752+0000","last_clean":"2024-04-16T15:37:03.295752+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:03.295752+0000","last_undegraded":"2024-04-16T15:37:03.295752+0000","last_fullsized":"2024-04-16T15:37:03.295752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295192+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:03.295192+0000","last_peered":"2024-04-16T15:37:03.295192+0000","last_clean":"2024-04-16T15:37:03.295192+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:03.295192+0000","last_undegraded":"2024-04-16T15:37:03.295192+0000","last_fullsized":"2024-04-16T15:37:03.295192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.303293+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:03.303293+0000","last_peered":"2024-04-16T15:37:03.303293+0000","last_clean":"2024-04-16T15:37:03.303293+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:03.303293+0000","last_undegraded":"2024-04-16T15:37:03.303293+0000","last_fullsized":"2024-04-16T15:37:03.303293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281458+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:03.281458+0000","last_peered":"2024-04-16T15:37:03.281458+0000","last_clean":"2024-04-16T15:37:03.281458+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:03.281458+0000","last_undegraded":"2024-04-16T15:37:03.281458+0000","last_fullsized":"2024-04-16T15:37:03.281458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299426+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:03.299426+0000","last_peered":"2024-04-16T15:37:03.299426+0000","last_clean":"2024-04-16T15:37:03.299426+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:03.299426+0000","last_undegraded":"2024-04-16T15:37:03.299426+0000","last_fullsized":"2024-04-16T15:37:03.299426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:22.287615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.307283+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:03.307283+0000","last_peered":"2024-04-16T15:37:03.307283+0000","last_clean":"2024-04-16T15:37:03.307283+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:03.307283+0000","last_undegraded":"2024-04-16T15:37:03.307283+0000","last_fullsized":"2024-04-16T15:37:03.307283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.306967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:03.306967+0000","last_peered":"2024-04-16T15:37:03.306967+0000","last_clean":"2024-04-16T15:37:03.306967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:03.306967+0000","last_undegraded":"2024-04-16T15:37:03.306967+0000","last_fullsized":"2024-04-16T15:37:03.306967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299900+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:03.299900+0000","last_peered":"2024-04-16T15:37:03.299900+0000","last_clean":"2024-04-16T15:37:03.299900+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:03.299900+0000","last_undegraded":"2024-04-16T15:37:03.299900+0000","last_fullsized":"2024-04-16T15:37:03.299900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281048+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:03.281048+0000","last_peered":"2024-04-16T15:37:03.281048+0000","last_clean":"2024-04-16T15:37:03.281048+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:03.281048+0000","last_undegraded":"2024-04-16T15:37:03.281048+0000","last_fullsized":"2024-04-16T15:37:03.281048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299405+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:03.299405+0000","last_peered":"2024-04-16T15:37:03.299405+0000","last_clean":"2024-04-16T15:37:03.299405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:03.299405+0000","last_undegraded":"2024-04-16T15:37:03.299405+0000","last_fullsized":"2024-04-16T15:37:03.299405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302579+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:03.302579+0000","last_peered":"2024-04-16T15:37:03.302579+0000","last_clean":"2024-04-16T15:37:03.302579+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:03.302579+0000","last_undegraded":"2024-04-16T15:37:03.302579+0000","last_fullsized":"2024-04-16T15:37:03.302579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.277502+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:03.277502+0000","last_peered":"2024-04-16T15:37:03.277502+0000","last_clean":"2024-04-16T15:37:03.277502+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:03.277502+0000","last_undegraded":"2024-04-16T15:37:03.277502+0000","last_fullsized":"2024-04-16T15:37:03.277502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.302949+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:03.302949+0000","last_peered":"2024-04-16T15:37:03.302949+0000","last_clean":"2024-04-16T15:37:03.302949+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:03.302949+0000","last_undegraded":"2024-04-16T15:37:03.302949+0000","last_fullsized":"2024-04-16T15:37:03.302949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.299478+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:03.299478+0000","last_peered":"2024-04-16T15:37:03.299478+0000","last_clean":"2024-04-16T15:37:03.299478+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:03.299478+0000","last_undegraded":"2024-04-16T15:37:03.299478+0000","last_fullsized":"2024-04-16T15:37:03.299478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:52.757016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.285659+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:03.285659+0000","last_peered":"2024-04-16T15:37:03.285659+0000","last_clean":"2024-04-16T15:37:03.285659+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:03.285659+0000","last_undegraded":"2024-04-16T15:37:03.285659+0000","last_fullsized":"2024-04-16T15:37:03.285659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.296285+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:03.296285+0000","last_peered":"2024-04-16T15:37:03.296285+0000","last_clean":"2024-04-16T15:37:03.296285+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:03.296285+0000","last_undegraded":"2024-04-16T15:37:03.296285+0000","last_fullsized":"2024-04-16T15:37:03.296285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.283926+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:03.283926+0000","last_peered":"2024-04-16T15:37:03.283926+0000","last_clean":"2024-04-16T15:37:03.283926+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:03.283926+0000","last_undegraded":"2024-04-16T15:37:03.283926+0000","last_fullsized":"2024-04-16T15:37:03.283926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.297350+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:03.297350+0000","last_peered":"2024-04-16T15:37:03.297350+0000","last_clean":"2024-04-16T15:37:03.297350+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:03.297350+0000","last_undegraded":"2024-04-16T15:37:03.297350+0000","last_fullsized":"2024-04-16T15:37:03.297350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.295409+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:03.295409+0000","last_peered":"2024-04-16T15:37:03.295409+0000","last_clean":"2024-04-16T15:37:03.295409+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:03.295409+0000","last_undegraded":"2024-04-16T15:37:03.295409+0000","last_fullsized":"2024-04-16T15:37:03.295409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.281152+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:03.281152+0000","last_peered":"2024-04-16T15:37:03.281152+0000","last_clean":"2024-04-16T15:37:03.281152+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:03.281152+0000","last_undegraded":"2024-04-16T15:37:03.281152+0000","last_fullsized":"2024-04-16T15:37:03.281152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.292524+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:03.292524+0000","last_peered":"2024-04-16T15:37:03.292524+0000","last_clean":"2024-04-16T15:37:03.292524+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:03.292524+0000","last_undegraded":"2024-04-16T15:37:03.292524+0000","last_fullsized":"2024-04-16T15:37:03.292524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:41.163158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.278441+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:03.278441+0000","last_peered":"2024-04-16T15:37:03.278441+0000","last_clean":"2024-04-16T15:37:03.278441+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:03.278441+0000","last_undegraded":"2024-04-16T15:37:03.278441+0000","last_fullsized":"2024-04-16T15:37:03.278441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T15:37:03.279728+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:03.279728+0000","last_peered":"2024-04-16T15:37:03.279728+0000","last_clean":"2024-04-16T15:37:03.279728+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:03.279728+0000","last_undegraded":"2024-04-16T15:37:03.279728+0000","last_fullsized":"2024-04-16T15:37:03.279728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":191085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":780883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:11.008 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T15:37:11.008 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T15:37:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.153+0000 7fa499dd4640 1 Processor -- start 2024-04-16T15:37:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.153+0000 7fa499dd4640 1 -- start start 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa499dd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa49415cdc0 0x7fa4940ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa499dd4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4940ceea0 con 0x7fa494145eb0 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa499dd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4940cf180 con 0x7fa4940d1ac0 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa499dd4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa4940cf460 con 0x7fa49415cdc0 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4937fe640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fa494145eb0 0x7fa4940d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41748/0 (socket says 172.21.15.80:41748) 2024-04-16T15:37:11.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4937fe640 1 -- 172.21.15.80:0/616724796 learned_addr learned my addr 172.21.15.80:0/616724796 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825766891 0 0) 0x7fa4940ceea0 con 0x7fa494145eb0 2024-04-16T15:37:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa492ffd640 1 --2- 172.21.15.80:0/616724796 >> v2:172.21.15.87:3300/0 conn(0x7fa49415cdc0 0x7fa4940ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa47c003520 con 0x7fa494145eb0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2557584864 0 0) 0x7fa47c003520 con 0x7fa494145eb0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 >> v2:172.21.15.87:3300/0 conn(0x7fa49415cdc0 msgr2=0x7fa4940ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 --2- 172.21.15.80:0/616724796 >> v2:172.21.15.87:3300/0 conn(0x7fa49415cdc0 0x7fa4940ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 >> v1:172.21.15.87:6789/0 conn(0x7fa4940d1ac0 legacy=0x7fa49406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4940cf740 con 0x7fa494145eb0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.154+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7fa484001670 con 0x7fa494145eb0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 >> v1:172.21.15.80:6789/0 conn(0x7fa494145eb0 legacy=0x7fa4940d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0039b0 0x7fa47c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c004800 0x7fa47c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 0x7fa47c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa4940cf460 con 0x7fa47c0051c0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c00c060 con 0x7fa47c004800 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa47c00c260 con 0x7fa47c0039b0 2024-04-16T15:37:11.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 0x7fa47c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa4937fe640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0039b0 0x7fa47c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa492ffd640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c004800 0x7fa47c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 -- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0039b0 msgr2=0x7fa47c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa47c0039b0 0x7fa47c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 -- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c004800 msgr2=0x7fa47c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c004800 0x7fa47c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.155+0000 7fa493fff640 1 -- 172.21.15.80:0/616724796 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47c003520 con 0x7fa47c0051c0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa493fff640 1 -- 172.21.15.80:0/616724796 reap_dead start 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa493fff640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 0x7fa47c00b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa48c001750 tx=0x7fa47c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8a061c81081151 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c001370 con 0x7fa47c0051c0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c005310 con 0x7fa47c0051c0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa4927fc640 1 -- 172.21.15.80:0/616724796 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c003830 con 0x7fa47c0051c0 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 -- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 msgr2=0x7fa47c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 0x7fa47c00b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa48c001750 tx=0x7fa47c005830 comp rx=0 tx=0).stop 2024-04-16T15:37:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 -- 172.21.15.80:0/616724796 shutdown_connections 2024-04-16T15:37:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 --2- 172.21.15.80:0/616724796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa47c0051c0 0x7fa47c00b9c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 -- 172.21.15.80:0/616724796 >> 172.21.15.80:0/616724796 conn(0x7fa4940b6ba0 msgr2=0x7fa49409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 -- 172.21.15.80:0/616724796 shutdown_connections 2024-04-16T15:37:11.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.156+0000 7fa499dd4640 1 -- 172.21.15.80:0/616724796 wait complete. 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 Processor -- start 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 -- start start 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0051c0 0x7fa4940b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 0x7fa4940b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fa494146410 con 0x7fa49415eb50 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa494146290 con 0x7fa47c0051c0 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.158+0000 7fa499dd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fa4940d1ef0 con 0x7fa494153250 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55126/0 (socket says 172.21.15.80:55126) 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 -- 172.21.15.80:0/1403625833 learned_addr learned my addr 172.21.15.80:0/1403625833 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa4937fe640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0051c0 0x7fa4940b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa492ffd640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 0x7fa4940b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 -- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 msgr2=0x7fa4940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 0x7fa4940b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 -- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0051c0 msgr2=0x7fa4940b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0051c0 0x7fa4940b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 -- 172.21.15.80:0/1403625833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4940afca0 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa492ffd640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 0x7fa4940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa493fff640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa48c000c00 tx=0x7fa48c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c001370 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c0050d0 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4940b37d0 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c007a30 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.159+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4940b2f30 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.160+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494068a40 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.161+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa48c032810 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.161+0000 7fa47bfff640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 0x7fa48006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.161+0000 7fa4937fe640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 0x7fa48006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.161+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa48c0ac500 con 0x7fa49415eb50 2024-04-16T15:37:11.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.162+0000 7fa4937fe640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 0x7fa48006edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa484007cf0 tx=0x7fa484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.166+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa48c07a830 con 0x7fa49415eb50 2024-04-16T15:37:11.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.416+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa4940ae7f0 con 0x7fa49415eb50 2024-04-16T15:37:11.417 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.418+0000 7fa47bfff640 1 -- 172.21.15.80:0/1403625833 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fa48c07a130 con 0x7fa49415eb50 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQCZmh5maTEdJRAAjycncCgzkzPFmaorV1Xi0w== 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stdout: caps mds = "allow" 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stdout: caps mon = "allow r" 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T15:37:11.418 INFO:teuthology.orchestra.run.smithi080.stderr:updated caps for client.0 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 msgr2=0x7fa48006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 0x7fa48006edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa484007cf0 tx=0x7fa484009040 comp rx=0 tx=0).stop 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 msgr2=0x7fa49415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa48c000c00 tx=0x7fa48c001120 comp rx=0 tx=0).stop 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 shutdown_connections 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa49415eb50 0x7fa49415efd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fa48006c8f0 0x7fa48006edb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fa494153250 0x7fa4940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 --2- 172.21.15.80:0/1403625833 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa47c0051c0 0x7fa4940b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 >> 172.21.15.80:0/1403625833 conn(0x7fa4940b6ba0 msgr2=0x7fa4940cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:11.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 shutdown_connections 2024-04-16T15:37:11.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.420+0000 7fa499dd4640 1 -- 172.21.15.80:0/1403625833 wait complete. 2024-04-16T15:37:11.431 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:37:11.533 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.534+0000 7fb92093d640 1 Processor -- start 2024-04-16T15:37:11.534 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.534+0000 7fb92093d640 1 -- start start 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb92093d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c15a400 0x7fb91c070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb92093d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb91c15d710 0x7fb91c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb92093d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91c06e410 con 0x7fb91c0b0300 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb92093d640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fb91c15dc80 con 0x7fb91c15d710 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb92093d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c06ba30 con 0x7fb91c15a400 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb919d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb91c15d710 0x7fb91c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb919d9b640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fb91c15d710 0x7fb91c070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55136/0 (socket says 172.21.15.80:55136) 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb919d9b640 1 -- 172.21.15.80:0/2906984889 learned_addr learned my addr 172.21.15.80:0/2906984889 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.535+0000 7fb91a59c640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c15a400 0x7fb91c070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb919d9b640 1 -- 172.21.15.80:0/2906984889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c15a400 msgr2=0x7fb91c070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb919d9b640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c15a400 0x7fb91c070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb919d9b640 1 -- 172.21.15.80:0/2906984889 >> v1:172.21.15.87:6789/0 conn(0x7fb91c0b0300 legacy=0x7fb91c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb919d9b640 1 -- 172.21.15.80:0/2906984889 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c06e6f0 con 0x7fb91c15d710 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb919d9b640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15d710 0x7fb91c070540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb910009870 tx=0x7fb91002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880039b1ed991a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.536+0000 7fb91959a640 1 -- 172.21.15.80:0/2906984889 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910035020 con 0x7fb91c15d710 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb91959a640 1 -- 172.21.15.80:0/2906984889 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910031640 con 0x7fb91c15d710 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb91959a640 1 -- 172.21.15.80:0/2906984889 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91002d040 con 0x7fb91c15d710 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 -- 172.21.15.80:0/2906984889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15d710 msgr2=0x7fb91c070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15d710 0x7fb91c070540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb910009870 tx=0x7fb91002b8f0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 -- 172.21.15.80:0/2906984889 shutdown_connections 2024-04-16T15:37:11.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15d710 0x7fb91c070540 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 --2- 172.21.15.80:0/2906984889 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c15a400 0x7fb91c070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 -- 172.21.15.80:0/2906984889 >> 172.21.15.80:0/2906984889 conn(0x7fb91c0cd610 msgr2=0x7fb91c0cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 -- 172.21.15.80:0/2906984889 shutdown_connections 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.537+0000 7fb92093d640 1 -- 172.21.15.80:0/2906984889 wait complete. 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 Processor -- start 2024-04-16T15:37:11.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 -- start start 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 0x7fb91c14acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 0x7fb91c0c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c070df0 con 0x7fb91c15a400 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c070a80 con 0x7fb91c15d710 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb92093d640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c070f70 con 0x7fb91c0b0300 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb919d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb919d9b640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55150/0 (socket says 172.21.15.80:55150) 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.539+0000 7fb919d9b640 1 -- 172.21.15.80:0/1243935805 learned_addr learned my addr 172.21.15.80:0/1243935805 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb91ad9d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 0x7fb91c0c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb91a59c640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 0x7fb91c14acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 -- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 msgr2=0x7fb91c14acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 0x7fb91c14acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 -- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 msgr2=0x7fb91c0c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 0x7fb91c0c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 -- 172.21.15.80:0/1243935805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c14e3f0 con 0x7fb91c15a400 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb91ad9d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 0x7fb91c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb91a59c640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 0x7fb91c14acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb919d9b640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb910000c00 tx=0x7fb9100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910040070 con 0x7fb91c15a400 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9100399f0 con 0x7fb91c15a400 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c0c5d10 con 0x7fb91c15a400 2024-04-16T15:37:11.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910035040 con 0x7fb91c15a400 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.540+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c14b200 con 0x7fb91c15a400 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.541+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91c0c5b30 con 0x7fb91c15a400 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.541+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb91004b060 con 0x7fb91c15a400 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.542+0000 7fb90affd640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 0x7fb8fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.542+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb9100ad530 con 0x7fb91c15a400 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.542+0000 7fb91a59c640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 0x7fb8fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:11.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.542+0000 7fb91a59c640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 0x7fb8fc06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0073f0 tx=0x7fb90c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:11.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.546+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb91c0c5b30 con 0x7fb91c15a400 2024-04-16T15:37:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.757+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb91c068a40 con 0x7fb91c15a400 2024-04-16T15:37:11.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.757+0000 7fb90affd640 1 -- 172.21.15.80:0/1243935805 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5178 (secure 0 0 0) 0x7fb91007b860 con 0x7fb91c15a400 2024-04-16T15:37:11.757 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:11.757 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/743042553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":743042553},{"type":"v1","addr":"172.21.15.87:6834","nonce":743042553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3593860190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3593860190},{"type":"v1","addr":"172.21.15.87:6835","nonce":3593860190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.80:6836/2311942895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2311942895},{"type":"v1","addr":"172.21.15.80:6836","nonce":2311942895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:37:02.624927+0000","modified":"2024-04-16T15:37:04.638832+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5523},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5523":{"gid":5523,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.80:6837/3642267828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6835","nonce":3642267828},{"type":"v1","addr":"172.21.15.80:6837","nonce":3642267828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5523,"qdb_cluster":[5523]},"id":2}]} 2024-04-16T15:37:11.758 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 16 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 msgr2=0x7fb8fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 0x7fb8fc06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0073f0 tx=0x7fb90c00b040 comp rx=0 tx=0).stop 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 msgr2=0x7fb91c0c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb910000c00 tx=0x7fb9100046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 shutdown_connections 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb91c15d710 0x7fb91c0c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb91c15a400 0x7fb91c0c6d30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fb8fc06c8f0 0x7fb8fc06edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 --2- 172.21.15.80:0/1243935805 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fb91c0b0300 0x7fb91c14acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:11.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 >> 172.21.15.80:0/1243935805 conn(0x7fb91c0cd610 msgr2=0x7fb91c074f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:11.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 shutdown_connections 2024-04-16T15:37:11.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:11.759+0000 7fb92093d640 1 -- 172.21.15.80:0/1243935805 wait complete. 2024-04-16T15:37:11.771 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_readahead.TestReadahead) ... ERROR 2024-04-16T15:37:11.771 INFO:tasks.cephfs_test_runner: 2024-04-16T15:37:11.771 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T15:37:11.771 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner: 2024-04-16T15:37:11.772 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:Ran 1 test in 41.917s 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:ERROR: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T15:37:11.773 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:37:11.774 INFO:tasks.cephfs_test_runner: 2024-04-16T15:37:11.774 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-04-16T15:37:12.060 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a0999e1dd34c4a5cbbd27a9322047649 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 2024-04-16T15:37:12.061 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T15:37:12.075 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-16T15:37:12.086 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-16T15:37:12.086 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:37:12.086 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:37:12.106 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T15:37:12.107 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-04-16T15:37:12.107 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:37:12.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17802 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T15:37:12.162 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:37:12.162 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:37:12.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16642 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T15:37:12.182 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-16T15:37:12.183 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T15:37:12.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16642 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T15:37:12.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.242 DEBUG:teuthology.orchestra.run.smithi080:> ip netns list 2024-04-16T15:37:12.257 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T15:37:12.258 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T15:37:12.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T15:37:12.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T15:37:12.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo ip link delete ceph-brx 2024-04-16T15:37:12.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.506 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-04-16T15:37:12.526 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T15:37:12.526 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T15:37:12.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T15:37:12.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.600 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T15:37:12.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T15:37:12.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-04-16T15:37:12.778 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T15:37:12.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T15:37:12.789 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.895+0000 7f3f1af5f640 1 Processor -- start 2024-04-16T15:37:12.894 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.895+0000 7f3f1af5f640 1 -- start start 2024-04-16T15:37:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f1af5f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f140cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f1af5f640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3f140b6110 0x7f3f140b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f1af5f640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f140ceab0 con 0x7f3f140b3840 2024-04-16T15:37:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f1af5f640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3f140cf0e0 con 0x7f3f140b6110 2024-04-16T15:37:12.898 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f1af5f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3f140b45c0 con 0x7f3f14144f00 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f13fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f3f140b3840 0x7f3f140b5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41764/0 (socket says 172.21.15.80:41764) 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f13fff640 1 -- 172.21.15.80:0/1485164402 learned_addr learned my addr 172.21.15.80:0/1485164402 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479736062 0 0) 0x7f3f140ceab0 con 0x7f3f140b3840 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f04003520 con 0x7f3f140b3840 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f140cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f194fc640 1 --2- 172.21.15.80:0/1485164402 >> v2:172.21.15.87:3300/0 conn(0x7f3f140b6110 0x7f3f140b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2195879154 0 0) 0x7f3f04003520 con 0x7f3f140b3840 2024-04-16T15:37:12.899 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 msgr2=0x7f3f140cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f140cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 >> v2:172.21.15.87:3300/0 conn(0x7f3f140b6110 msgr2=0x7f3f140b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 --2- 172.21.15.80:0/1485164402 >> v2:172.21.15.87:3300/0 conn(0x7f3f140b6110 0x7f3f140b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f140b42e0 con 0x7f3f140b3840 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f3f00001670 con 0x7f3f140b3840 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 >> v1:172.21.15.80:6789/0 conn(0x7f3f140b3840 legacy=0x7f3f140b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f040039b0 0x7f3f04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f04004800 0x7f3f04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3f140cf0e0 con 0x7f3f040039b0 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f140b45c0 con 0x7f3f04004800 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.896+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0400b9c0 con 0x7f3f14144f00 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f040039b0 0x7f3f04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f13fff640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f04004800 0x7f3f04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f194fc640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 -- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 msgr2=0x7f3f040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:12.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f14144f00 0x7f3f040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 -- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f04004800 msgr2=0x7f3f04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f04004800 0x7f3f04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 -- 172.21.15.80:0/1485164402 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f04003520 con 0x7f3f040039b0 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f13fff640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f04004800 0x7f3f04004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.897+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f040039b0 0x7f3f04003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009ac0 tx=0x7f3f04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c463ec90e6f3ad34 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08039070 con 0x7f3f040039b0 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0802c6b0 con 0x7f3f040039b0 2024-04-16T15:37:12.902 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f137fe640 1 -- 172.21.15.80:0/1485164402 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08009690 con 0x7f3f040039b0 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 -- 172.21.15.80:0/1485164402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f040039b0 msgr2=0x7f3f04003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/1485164402 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f040039b0 0x7f3f04003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009ac0 tx=0x7f3f04005830 comp rx=0 tx=0).stop 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f194fc640 1 -- 172.21.15.80:0/1485164402 reap_dead start 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 -- 172.21.15.80:0/1485164402 shutdown_connections 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 -- 172.21.15.80:0/1485164402 >> 172.21.15.80:0/1485164402 conn(0x7f3f140b2940 msgr2=0x7f3f1406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 -- 172.21.15.80:0/1485164402 shutdown_connections 2024-04-16T15:37:12.903 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.898+0000 7f3f1af5f640 1 -- 172.21.15.80:0/1485164402 wait complete. 2024-04-16T15:37:12.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.899+0000 7f3f1af5f640 1 Processor -- start 2024-04-16T15:37:12.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.899+0000 7f3f1af5f640 1 -- start start 2024-04-16T15:37:12.906 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 0x7f3f140aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 0x7f3f141f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14160290 con 0x7f3f140ad340 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14160110 con 0x7f3f140c70e0 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f1af5f640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f3f141452e0 con 0x7f3f040039b0 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f194fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.900+0000 7f3f194fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55166/0 (socket says 172.21.15.80:55166) 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 -- 172.21.15.80:0/2569607206 learned_addr learned my addr 172.21.15.80:0/2569607206 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:12.907 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f13fff640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 0x7f3f141f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 0x7f3f140aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 -- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 msgr2=0x7f3f140aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 0x7f3f140aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 -- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 msgr2=0x7f3f141f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 0x7f3f141f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 -- 172.21.15.80:0/2569607206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f140af3a0 con 0x7f3f140ad340 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f13fff640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 0x7f3f141f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:12.908 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 0x7f3f140aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f194fc640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3f1406fea0 tx=0x7f3f0c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00007d50 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0c01d070 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f141f2aa0 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c015670 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.901+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f141f3060 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.902+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f14068a40 con 0x7f3f140ad340 2024-04-16T15:37:12.909 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.903+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f0c015810 con 0x7f3f140ad340 2024-04-16T15:37:12.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.903+0000 7f3f117fa640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 0x7f3ef806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:12.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.903+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3f0c08c3c0 con 0x7f3f140ad340 2024-04-16T15:37:12.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.903+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 0x7f3ef806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:12.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.903+0000 7f3f18cfb640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 0x7f3ef806ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3f08036000 tx=0x7f3f08030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:12.910 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:12.907+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f0c010040 con 0x7f3f140ad340 2024-04-16T15:37:13.079 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.079+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f1406c520 con 0x7f3ef806c920 2024-04-16T15:37:13.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.085+0000 7f3f117fa640 1 -- 172.21.15.80:0/2569607206 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251846 (secure 0 0 0) 0x7f3f1406c520 con 0x7f3ef806c920 2024-04-16T15:37:13.087 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:13.088 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:13.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 msgr2=0x7f3ef806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 0x7f3ef806ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3f08036000 tx=0x7f3f08030000 comp rx=0 tx=0).stop 2024-04-16T15:37:13.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 msgr2=0x7f3f140ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3f1406fea0 tx=0x7f3f0c00f580 comp rx=0 tx=0).stop 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 shutdown_connections 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3f140ad340 0x7f3f140ad7c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3f140c70e0 0x7f3f141f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f3ef806c920 0x7f3ef806ede0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 --2- 172.21.15.80:0/2569607206 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f3f040039b0 0x7f3f140aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 >> 172.21.15.80:0/2569607206 conn(0x7f3f140b2940 msgr2=0x7f3f140cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 shutdown_connections 2024-04-16T15:37:13.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.088+0000 7f3f1af5f640 1 -- 172.21.15.80:0/2569607206 wait complete. 2024-04-16T15:37:13.099 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-16T15:37:11.175262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220920,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753800,"statfs":{"total":773094113280,"available":772867891200,"internally_reserved":0,"allocated":4857856,"data_stored":2762940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001482"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380823+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:06.380823+0000","last_peered":"2024-04-16T15:37:06.380823+0000","last_clean":"2024-04-16T15:37:06.380823+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:06.380823+0000","last_undegraded":"2024-04-16T15:37:06.380823+0000","last_fullsized":"2024-04-16T15:37:06.380823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220953+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:06.220953+0000","last_peered":"2024-04-16T15:37:06.220953+0000","last_clean":"2024-04-16T15:37:06.220953+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:06.220953+0000","last_undegraded":"2024-04-16T15:37:06.220953+0000","last_fullsized":"2024-04-16T15:37:06.220953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380899+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:06.380899+0000","last_peered":"2024-04-16T15:37:06.380899+0000","last_clean":"2024-04-16T15:37:06.380899+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:06.380899+0000","last_undegraded":"2024-04-16T15:37:06.380899+0000","last_fullsized":"2024-04-16T15:37:06.380899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380731+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:06.380731+0000","last_peered":"2024-04-16T15:37:06.380731+0000","last_clean":"2024-04-16T15:37:06.380731+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:06.380731+0000","last_undegraded":"2024-04-16T15:37:06.380731+0000","last_fullsized":"2024-04-16T15:37:06.380731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823459+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:06.823459+0000","last_peered":"2024-04-16T15:37:06.823459+0000","last_clean":"2024-04-16T15:37:06.823459+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:06.823459+0000","last_undegraded":"2024-04-16T15:37:06.823459+0000","last_fullsized":"2024-04-16T15:37:06.823459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754686+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:05.754686+0000","last_peered":"2024-04-16T15:37:05.754686+0000","last_clean":"2024-04-16T15:37:05.754686+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:05.754686+0000","last_undegraded":"2024-04-16T15:37:05.754686+0000","last_fullsized":"2024-04-16T15:37:05.754686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755359+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:05.755359+0000","last_peered":"2024-04-16T15:37:05.755359+0000","last_clean":"2024-04-16T15:37:05.755359+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:05.755359+0000","last_undegraded":"2024-04-16T15:37:05.755359+0000","last_fullsized":"2024-04-16T15:37:05.755359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823881+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:06.823881+0000","last_peered":"2024-04-16T15:37:06.823881+0000","last_clean":"2024-04-16T15:37:06.823881+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:06.823881+0000","last_undegraded":"2024-04-16T15:37:06.823881+0000","last_fullsized":"2024-04-16T15:37:06.823881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754717+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:05.754717+0000","last_peered":"2024-04-16T15:37:05.754717+0000","last_clean":"2024-04-16T15:37:05.754717+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:05.754717+0000","last_undegraded":"2024-04-16T15:37:05.754717+0000","last_fullsized":"2024-04-16T15:37:05.754717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221170+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:06.221170+0000","last_peered":"2024-04-16T15:37:06.221170+0000","last_clean":"2024-04-16T15:37:06.221170+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:06.221170+0000","last_undegraded":"2024-04-16T15:37:06.221170+0000","last_fullsized":"2024-04-16T15:37:06.221170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754846+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:05.754846+0000","last_peered":"2024-04-16T15:37:05.754846+0000","last_clean":"2024-04-16T15:37:05.754846+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:05.754846+0000","last_undegraded":"2024-04-16T15:37:05.754846+0000","last_fullsized":"2024-04-16T15:37:05.754846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220986+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:06.220986+0000","last_peered":"2024-04-16T15:37:06.220986+0000","last_clean":"2024-04-16T15:37:06.220986+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:06.220986+0000","last_undegraded":"2024-04-16T15:37:06.220986+0000","last_fullsized":"2024-04-16T15:37:06.220986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755060+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:05.755060+0000","last_peered":"2024-04-16T15:37:05.755060+0000","last_clean":"2024-04-16T15:37:05.755060+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:05.755060+0000","last_undegraded":"2024-04-16T15:37:05.755060+0000","last_fullsized":"2024-04-16T15:37:05.755060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221200+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:06.221200+0000","last_peered":"2024-04-16T15:37:06.221200+0000","last_clean":"2024-04-16T15:37:06.221200+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:06.221200+0000","last_undegraded":"2024-04-16T15:37:06.221200+0000","last_fullsized":"2024-04-16T15:37:06.221200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380762+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:06.380762+0000","last_peered":"2024-04-16T15:37:06.380762+0000","last_clean":"2024-04-16T15:37:06.380762+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:06.380762+0000","last_undegraded":"2024-04-16T15:37:06.380762+0000","last_fullsized":"2024-04-16T15:37:06.380762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823838+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:06.823838+0000","last_peered":"2024-04-16T15:37:06.823838+0000","last_clean":"2024-04-16T15:37:06.823838+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:06.823838+0000","last_undegraded":"2024-04-16T15:37:06.823838+0000","last_fullsized":"2024-04-16T15:37:06.823838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221222+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:06.221222+0000","last_peered":"2024-04-16T15:37:06.221222+0000","last_clean":"2024-04-16T15:37:06.221222+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:06.221222+0000","last_undegraded":"2024-04-16T15:37:06.221222+0000","last_fullsized":"2024-04-16T15:37:06.221222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823655+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:06.823655+0000","last_peered":"2024-04-16T15:37:06.823655+0000","last_clean":"2024-04-16T15:37:06.823655+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:06.823655+0000","last_undegraded":"2024-04-16T15:37:06.823655+0000","last_fullsized":"2024-04-16T15:37:06.823655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380540+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:06.380540+0000","last_peered":"2024-04-16T15:37:06.380540+0000","last_clean":"2024-04-16T15:37:06.380540+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:06.380540+0000","last_undegraded":"2024-04-16T15:37:06.380540+0000","last_fullsized":"2024-04-16T15:37:06.380540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754898+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:05.754898+0000","last_peered":"2024-04-16T15:37:05.754898+0000","last_clean":"2024-04-16T15:37:05.754898+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:05.754898+0000","last_undegraded":"2024-04-16T15:37:05.754898+0000","last_fullsized":"2024-04-16T15:37:05.754898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823711+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:06.823711+0000","last_peered":"2024-04-16T15:37:06.823711+0000","last_clean":"2024-04-16T15:37:06.823711+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:06.823711+0000","last_undegraded":"2024-04-16T15:37:06.823711+0000","last_fullsized":"2024-04-16T15:37:06.823711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220901+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:06.220901+0000","last_peered":"2024-04-16T15:37:06.220901+0000","last_clean":"2024-04-16T15:37:06.220901+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:06.220901+0000","last_undegraded":"2024-04-16T15:37:06.220901+0000","last_fullsized":"2024-04-16T15:37:06.220901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823320+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:06.823320+0000","last_peered":"2024-04-16T15:37:06.823320+0000","last_clean":"2024-04-16T15:37:06.823320+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:06.823320+0000","last_undegraded":"2024-04-16T15:37:06.823320+0000","last_fullsized":"2024-04-16T15:37:06.823320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755232+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:05.755232+0000","last_peered":"2024-04-16T15:37:05.755232+0000","last_clean":"2024-04-16T15:37:05.755232+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:05.755232+0000","last_undegraded":"2024-04-16T15:37:05.755232+0000","last_fullsized":"2024-04-16T15:37:05.755232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380782+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:06.380782+0000","last_peered":"2024-04-16T15:37:06.380782+0000","last_clean":"2024-04-16T15:37:06.380782+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:06.380782+0000","last_undegraded":"2024-04-16T15:37:06.380782+0000","last_fullsized":"2024-04-16T15:37:06.380782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823831+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:06.823831+0000","last_peered":"2024-04-16T15:37:06.823831+0000","last_clean":"2024-04-16T15:37:06.823831+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:06.823831+0000","last_undegraded":"2024-04-16T15:37:06.823831+0000","last_fullsized":"2024-04-16T15:37:06.823831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380546+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:06.380546+0000","last_peered":"2024-04-16T15:37:06.380546+0000","last_clean":"2024-04-16T15:37:06.380546+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:06.380546+0000","last_undegraded":"2024-04-16T15:37:06.380546+0000","last_fullsized":"2024-04-16T15:37:06.380546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220905+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:06.220905+0000","last_peered":"2024-04-16T15:37:06.220905+0000","last_clean":"2024-04-16T15:37:06.220905+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:06.220905+0000","last_undegraded":"2024-04-16T15:37:06.220905+0000","last_fullsized":"2024-04-16T15:37:06.220905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754906+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:05.754906+0000","last_peered":"2024-04-16T15:37:05.754906+0000","last_clean":"2024-04-16T15:37:05.754906+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:05.754906+0000","last_undegraded":"2024-04-16T15:37:05.754906+0000","last_fullsized":"2024-04-16T15:37:05.754906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754713+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:05.754713+0000","last_peered":"2024-04-16T15:37:05.754713+0000","last_clean":"2024-04-16T15:37:05.754713+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:05.754713+0000","last_undegraded":"2024-04-16T15:37:05.754713+0000","last_fullsized":"2024-04-16T15:37:05.754713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:06.823967+0000","last_peered":"2024-04-16T15:37:06.823967+0000","last_clean":"2024-04-16T15:37:06.823967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:06.823967+0000","last_undegraded":"2024-04-16T15:37:06.823967+0000","last_fullsized":"2024-04-16T15:37:06.823967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823846+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:06.823846+0000","last_peered":"2024-04-16T15:37:06.823846+0000","last_clean":"2024-04-16T15:37:06.823846+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:06.823846+0000","last_undegraded":"2024-04-16T15:37:06.823846+0000","last_fullsized":"2024-04-16T15:37:06.823846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221004+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:06.221004+0000","last_peered":"2024-04-16T15:37:06.221004+0000","last_clean":"2024-04-16T15:37:06.221004+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:06.221004+0000","last_undegraded":"2024-04-16T15:37:06.221004+0000","last_fullsized":"2024-04-16T15:37:06.221004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754967+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:05.754967+0000","last_peered":"2024-04-16T15:37:05.754967+0000","last_clean":"2024-04-16T15:37:05.754967+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:05.754967+0000","last_undegraded":"2024-04-16T15:37:05.754967+0000","last_fullsized":"2024-04-16T15:37:05.754967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380639+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:06.380639+0000","last_peered":"2024-04-16T15:37:06.380639+0000","last_clean":"2024-04-16T15:37:06.380639+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:06.380639+0000","last_undegraded":"2024-04-16T15:37:06.380639+0000","last_fullsized":"2024-04-16T15:37:06.380639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754853+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:05.754853+0000","last_peered":"2024-04-16T15:37:05.754853+0000","last_clean":"2024-04-16T15:37:05.754853+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:05.754853+0000","last_undegraded":"2024-04-16T15:37:05.754853+0000","last_fullsized":"2024-04-16T15:37:05.754853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221142+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:06.221142+0000","last_peered":"2024-04-16T15:37:06.221142+0000","last_clean":"2024-04-16T15:37:06.221142+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:06.221142+0000","last_undegraded":"2024-04-16T15:37:06.221142+0000","last_fullsized":"2024-04-16T15:37:06.221142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755206+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:05.755206+0000","last_peered":"2024-04-16T15:37:05.755206+0000","last_clean":"2024-04-16T15:37:05.755206+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:05.755206+0000","last_undegraded":"2024-04-16T15:37:05.755206+0000","last_fullsized":"2024-04-16T15:37:05.755206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380705+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:06.380705+0000","last_peered":"2024-04-16T15:37:06.380705+0000","last_clean":"2024-04-16T15:37:06.380705+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:06.380705+0000","last_undegraded":"2024-04-16T15:37:06.380705+0000","last_fullsized":"2024-04-16T15:37:06.380705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380706+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:06.380706+0000","last_peered":"2024-04-16T15:37:06.380706+0000","last_clean":"2024-04-16T15:37:06.380706+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:06.380706+0000","last_undegraded":"2024-04-16T15:37:06.380706+0000","last_fullsized":"2024-04-16T15:37:06.380706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380811+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:06.380811+0000","last_peered":"2024-04-16T15:37:06.380811+0000","last_clean":"2024-04-16T15:37:06.380811+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:06.380811+0000","last_undegraded":"2024-04-16T15:37:06.380811+0000","last_fullsized":"2024-04-16T15:37:06.380811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220921+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:06.220921+0000","last_peered":"2024-04-16T15:37:06.220921+0000","last_clean":"2024-04-16T15:37:06.220921+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:06.220921+0000","last_undegraded":"2024-04-16T15:37:06.220921+0000","last_fullsized":"2024-04-16T15:37:06.220921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823486+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:06.823486+0000","last_peered":"2024-04-16T15:37:06.823486+0000","last_clean":"2024-04-16T15:37:06.823486+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:06.823486+0000","last_undegraded":"2024-04-16T15:37:06.823486+0000","last_fullsized":"2024-04-16T15:37:06.823486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823322+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:06.823322+0000","last_peered":"2024-04-16T15:37:06.823322+0000","last_clean":"2024-04-16T15:37:06.823322+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:06.823322+0000","last_undegraded":"2024-04-16T15:37:06.823322+0000","last_fullsized":"2024-04-16T15:37:06.823322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755189+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:05.755189+0000","last_peered":"2024-04-16T15:37:05.755189+0000","last_clean":"2024-04-16T15:37:05.755189+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:05.755189+0000","last_undegraded":"2024-04-16T15:37:05.755189+0000","last_fullsized":"2024-04-16T15:37:05.755189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755068+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:05.755068+0000","last_peered":"2024-04-16T15:37:05.755068+0000","last_clean":"2024-04-16T15:37:05.755068+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:05.755068+0000","last_undegraded":"2024-04-16T15:37:05.755068+0000","last_fullsized":"2024-04-16T15:37:05.755068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755094+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:05.755094+0000","last_peered":"2024-04-16T15:37:05.755094+0000","last_clean":"2024-04-16T15:37:05.755094+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:05.755094+0000","last_undegraded":"2024-04-16T15:37:05.755094+0000","last_fullsized":"2024-04-16T15:37:05.755094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:13.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:13.243 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.243+0000 7f307dd82640 1 Processor -- start 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.243+0000 7f307dd82640 1 -- start start 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f307dd82640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3078145a30 0x7f307806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f307dd82640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30781610b0 con 0x7f30780ce280 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f307dd82640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780ccd90 con 0x7f3078145fb0 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f307dd82640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f3078145e10 con 0x7f3078145a30 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f30777fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f3078145a30 0x7f307806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.244 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f3077fff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f30780ce280 0x7f30781609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41780/0 (socket says 172.21.15.80:41780) 2024-04-16T15:37:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f3077fff640 1 -- 172.21.15.80:0/472516925 learned_addr learned my addr 172.21.15.80:0/472516925 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f30777fe640 1 -- 172.21.15.80:0/472516925 >> v1:172.21.15.87:6789/0 conn(0x7f3078145fb0 legacy=0x7f3078160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f30777fe640 1 -- 172.21.15.80:0/472516925 >> v1:172.21.15.80:6789/0 conn(0x7f30780ce280 legacy=0x7f30781609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.245 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.244+0000 7f30777fe640 1 -- 172.21.15.80:0/472516925 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780b1520 con 0x7f3078145a30 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f30777fe640 1 --2- 172.21.15.80:0/472516925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307806b9a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f30680097a0 tx=0x7f306802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7bf264a8df25a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f30767fc640 1 -- 172.21.15.80:0/472516925 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068035020 con 0x7f3078145a30 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f30767fc640 1 -- 172.21.15.80:0/472516925 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3068031830 con 0x7f3078145a30 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f30767fc640 1 -- 172.21.15.80:0/472516925 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068031c00 con 0x7f3078145a30 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f307dd82640 1 -- 172.21.15.80:0/472516925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 msgr2=0x7f307806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.249 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f307dd82640 1 --2- 172.21.15.80:0/472516925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307806b9a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f30680097a0 tx=0x7f306802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f307dd82640 1 -- 172.21.15.80:0/472516925 shutdown_connections 2024-04-16T15:37:13.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.245+0000 7f307dd82640 1 --2- 172.21.15.80:0/472516925 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307806b9a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.246+0000 7f307dd82640 1 -- 172.21.15.80:0/472516925 >> 172.21.15.80:0/472516925 conn(0x7f307809aa70 msgr2=0x7f30780b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.246+0000 7f307dd82640 1 -- 172.21.15.80:0/472516925 shutdown_connections 2024-04-16T15:37:13.250 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.246+0000 7f307dd82640 1 -- 172.21.15.80:0/472516925 wait complete. 2024-04-16T15:37:13.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.247+0000 7f307dd82640 1 Processor -- start 2024-04-16T15:37:13.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.247+0000 7f307dd82640 1 -- start start 2024-04-16T15:37:13.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30780ce280 0x7f30780cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.254 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3078145fb0 0x7f30780ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f30780b1dc0 con 0x7f3078145a30 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f30780b1ae0 con 0x7f3078145fb0 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f30780b2d00 con 0x7f30780ce280 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55176/0 (socket says 172.21.15.80:55176) 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 -- 172.21.15.80:0/3439465712 learned_addr learned my addr 172.21.15.80:0/3439465712 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f30777fe640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30780ce280 0x7f30780cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.255 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3077fff640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3078145fb0 0x7f30780ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 -- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30780ce280 msgr2=0x7f30780cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30780ce280 0x7f30780cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 -- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3078145fb0 msgr2=0x7f30780ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3078145fb0 0x7f30780ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 -- 172.21.15.80:0/3439465712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780b5930 con 0x7f3078145a30 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f3076ffd640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c460 tx=0x7f306c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c016020 con 0x7f3078145a30 2024-04-16T15:37:13.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c012870 con 0x7f3078145a30 2024-04-16T15:37:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30780b5c10 con 0x7f3078145a30 2024-04-16T15:37:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c012c60 con 0x7f3078145a30 2024-04-16T15:37:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.248+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30780b61d0 con 0x7f3078145a30 2024-04-16T15:37:13.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.249+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3078068a40 con 0x7f3078145a30 2024-04-16T15:37:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.250+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f306c019020 con 0x7f3078145a30 2024-04-16T15:37:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.250+0000 7f305ffff640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 0x7f306406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.250+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f306c08b990 con 0x7f3078145a30 2024-04-16T15:37:13.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.250+0000 7f30777fe640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 0x7f306406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.251+0000 7f30777fe640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 0x7f306406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3068036000 tx=0x7f306803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.255+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f306c020030 con 0x7f3078145a30 2024-04-16T15:37:13.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.428+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30780b3030 con 0x7f306406c8f0 2024-04-16T15:37:13.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.433+0000 7f305ffff640 1 -- 172.21.15.80:0/3439465712 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251846 (secure 0 0 0) 0x7f30780b3030 con 0x7f306406c8f0 2024-04-16T15:37:13.436 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:13.437 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.436+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 msgr2=0x7f306406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.436+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 0x7f306406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3068036000 tx=0x7f306803c040 comp rx=0 tx=0).stop 2024-04-16T15:37:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 msgr2=0x7f307815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c460 tx=0x7f306c00c920 comp rx=0 tx=0).stop 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 shutdown_connections 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3078145fb0 0x7f30780ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3078145a30 0x7f307815f500 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f306406c8f0 0x7f306406edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 --2- 172.21.15.80:0/3439465712 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f30780ce280 0x7f30780cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 >> 172.21.15.80:0/3439465712 conn(0x7f307809aa70 msgr2=0x7f307806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 shutdown_connections 2024-04-16T15:37:13.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.437+0000 7f307dd82640 1 -- 172.21.15.80:0/3439465712 wait complete. 2024-04-16T15:37:13.447 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-16T15:37:13.175671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220920,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753800,"statfs":{"total":773094113280,"available":772867891200,"internally_reserved":0,"allocated":4857856,"data_stored":2762940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.900616"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380823+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:06.380823+0000","last_peered":"2024-04-16T15:37:06.380823+0000","last_clean":"2024-04-16T15:37:06.380823+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:06.380823+0000","last_undegraded":"2024-04-16T15:37:06.380823+0000","last_fullsized":"2024-04-16T15:37:06.380823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220953+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:06.220953+0000","last_peered":"2024-04-16T15:37:06.220953+0000","last_clean":"2024-04-16T15:37:06.220953+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:06.220953+0000","last_undegraded":"2024-04-16T15:37:06.220953+0000","last_fullsized":"2024-04-16T15:37:06.220953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380899+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:06.380899+0000","last_peered":"2024-04-16T15:37:06.380899+0000","last_clean":"2024-04-16T15:37:06.380899+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:06.380899+0000","last_undegraded":"2024-04-16T15:37:06.380899+0000","last_fullsized":"2024-04-16T15:37:06.380899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380731+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:06.380731+0000","last_peered":"2024-04-16T15:37:06.380731+0000","last_clean":"2024-04-16T15:37:06.380731+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:06.380731+0000","last_undegraded":"2024-04-16T15:37:06.380731+0000","last_fullsized":"2024-04-16T15:37:06.380731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823459+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:06.823459+0000","last_peered":"2024-04-16T15:37:06.823459+0000","last_clean":"2024-04-16T15:37:06.823459+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:06.823459+0000","last_undegraded":"2024-04-16T15:37:06.823459+0000","last_fullsized":"2024-04-16T15:37:06.823459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754686+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:05.754686+0000","last_peered":"2024-04-16T15:37:05.754686+0000","last_clean":"2024-04-16T15:37:05.754686+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:05.754686+0000","last_undegraded":"2024-04-16T15:37:05.754686+0000","last_fullsized":"2024-04-16T15:37:05.754686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755359+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:05.755359+0000","last_peered":"2024-04-16T15:37:05.755359+0000","last_clean":"2024-04-16T15:37:05.755359+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:05.755359+0000","last_undegraded":"2024-04-16T15:37:05.755359+0000","last_fullsized":"2024-04-16T15:37:05.755359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823881+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:06.823881+0000","last_peered":"2024-04-16T15:37:06.823881+0000","last_clean":"2024-04-16T15:37:06.823881+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:06.823881+0000","last_undegraded":"2024-04-16T15:37:06.823881+0000","last_fullsized":"2024-04-16T15:37:06.823881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754717+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:05.754717+0000","last_peered":"2024-04-16T15:37:05.754717+0000","last_clean":"2024-04-16T15:37:05.754717+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:05.754717+0000","last_undegraded":"2024-04-16T15:37:05.754717+0000","last_fullsized":"2024-04-16T15:37:05.754717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221170+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:06.221170+0000","last_peered":"2024-04-16T15:37:06.221170+0000","last_clean":"2024-04-16T15:37:06.221170+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:06.221170+0000","last_undegraded":"2024-04-16T15:37:06.221170+0000","last_fullsized":"2024-04-16T15:37:06.221170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754846+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:05.754846+0000","last_peered":"2024-04-16T15:37:05.754846+0000","last_clean":"2024-04-16T15:37:05.754846+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:05.754846+0000","last_undegraded":"2024-04-16T15:37:05.754846+0000","last_fullsized":"2024-04-16T15:37:05.754846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220986+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:06.220986+0000","last_peered":"2024-04-16T15:37:06.220986+0000","last_clean":"2024-04-16T15:37:06.220986+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:06.220986+0000","last_undegraded":"2024-04-16T15:37:06.220986+0000","last_fullsized":"2024-04-16T15:37:06.220986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755060+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:05.755060+0000","last_peered":"2024-04-16T15:37:05.755060+0000","last_clean":"2024-04-16T15:37:05.755060+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:05.755060+0000","last_undegraded":"2024-04-16T15:37:05.755060+0000","last_fullsized":"2024-04-16T15:37:05.755060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221200+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:06.221200+0000","last_peered":"2024-04-16T15:37:06.221200+0000","last_clean":"2024-04-16T15:37:06.221200+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:06.221200+0000","last_undegraded":"2024-04-16T15:37:06.221200+0000","last_fullsized":"2024-04-16T15:37:06.221200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380762+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:06.380762+0000","last_peered":"2024-04-16T15:37:06.380762+0000","last_clean":"2024-04-16T15:37:06.380762+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:06.380762+0000","last_undegraded":"2024-04-16T15:37:06.380762+0000","last_fullsized":"2024-04-16T15:37:06.380762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823838+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:06.823838+0000","last_peered":"2024-04-16T15:37:06.823838+0000","last_clean":"2024-04-16T15:37:06.823838+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:06.823838+0000","last_undegraded":"2024-04-16T15:37:06.823838+0000","last_fullsized":"2024-04-16T15:37:06.823838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221222+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:06.221222+0000","last_peered":"2024-04-16T15:37:06.221222+0000","last_clean":"2024-04-16T15:37:06.221222+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:06.221222+0000","last_undegraded":"2024-04-16T15:37:06.221222+0000","last_fullsized":"2024-04-16T15:37:06.221222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823655+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:06.823655+0000","last_peered":"2024-04-16T15:37:06.823655+0000","last_clean":"2024-04-16T15:37:06.823655+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:06.823655+0000","last_undegraded":"2024-04-16T15:37:06.823655+0000","last_fullsized":"2024-04-16T15:37:06.823655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380540+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:06.380540+0000","last_peered":"2024-04-16T15:37:06.380540+0000","last_clean":"2024-04-16T15:37:06.380540+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:06.380540+0000","last_undegraded":"2024-04-16T15:37:06.380540+0000","last_fullsized":"2024-04-16T15:37:06.380540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754898+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:05.754898+0000","last_peered":"2024-04-16T15:37:05.754898+0000","last_clean":"2024-04-16T15:37:05.754898+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:05.754898+0000","last_undegraded":"2024-04-16T15:37:05.754898+0000","last_fullsized":"2024-04-16T15:37:05.754898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823711+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:06.823711+0000","last_peered":"2024-04-16T15:37:06.823711+0000","last_clean":"2024-04-16T15:37:06.823711+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:06.823711+0000","last_undegraded":"2024-04-16T15:37:06.823711+0000","last_fullsized":"2024-04-16T15:37:06.823711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220901+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:06.220901+0000","last_peered":"2024-04-16T15:37:06.220901+0000","last_clean":"2024-04-16T15:37:06.220901+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:06.220901+0000","last_undegraded":"2024-04-16T15:37:06.220901+0000","last_fullsized":"2024-04-16T15:37:06.220901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823320+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:06.823320+0000","last_peered":"2024-04-16T15:37:06.823320+0000","last_clean":"2024-04-16T15:37:06.823320+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:06.823320+0000","last_undegraded":"2024-04-16T15:37:06.823320+0000","last_fullsized":"2024-04-16T15:37:06.823320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755232+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:05.755232+0000","last_peered":"2024-04-16T15:37:05.755232+0000","last_clean":"2024-04-16T15:37:05.755232+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:05.755232+0000","last_undegraded":"2024-04-16T15:37:05.755232+0000","last_fullsized":"2024-04-16T15:37:05.755232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380782+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:06.380782+0000","last_peered":"2024-04-16T15:37:06.380782+0000","last_clean":"2024-04-16T15:37:06.380782+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:06.380782+0000","last_undegraded":"2024-04-16T15:37:06.380782+0000","last_fullsized":"2024-04-16T15:37:06.380782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823831+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:06.823831+0000","last_peered":"2024-04-16T15:37:06.823831+0000","last_clean":"2024-04-16T15:37:06.823831+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:06.823831+0000","last_undegraded":"2024-04-16T15:37:06.823831+0000","last_fullsized":"2024-04-16T15:37:06.823831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380546+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:06.380546+0000","last_peered":"2024-04-16T15:37:06.380546+0000","last_clean":"2024-04-16T15:37:06.380546+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:06.380546+0000","last_undegraded":"2024-04-16T15:37:06.380546+0000","last_fullsized":"2024-04-16T15:37:06.380546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220905+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:06.220905+0000","last_peered":"2024-04-16T15:37:06.220905+0000","last_clean":"2024-04-16T15:37:06.220905+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:06.220905+0000","last_undegraded":"2024-04-16T15:37:06.220905+0000","last_fullsized":"2024-04-16T15:37:06.220905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754906+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:05.754906+0000","last_peered":"2024-04-16T15:37:05.754906+0000","last_clean":"2024-04-16T15:37:05.754906+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:05.754906+0000","last_undegraded":"2024-04-16T15:37:05.754906+0000","last_fullsized":"2024-04-16T15:37:05.754906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754713+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:05.754713+0000","last_peered":"2024-04-16T15:37:05.754713+0000","last_clean":"2024-04-16T15:37:05.754713+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:05.754713+0000","last_undegraded":"2024-04-16T15:37:05.754713+0000","last_fullsized":"2024-04-16T15:37:05.754713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:06.823967+0000","last_peered":"2024-04-16T15:37:06.823967+0000","last_clean":"2024-04-16T15:37:06.823967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:06.823967+0000","last_undegraded":"2024-04-16T15:37:06.823967+0000","last_fullsized":"2024-04-16T15:37:06.823967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823846+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:06.823846+0000","last_peered":"2024-04-16T15:37:06.823846+0000","last_clean":"2024-04-16T15:37:06.823846+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:06.823846+0000","last_undegraded":"2024-04-16T15:37:06.823846+0000","last_fullsized":"2024-04-16T15:37:06.823846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221004+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:06.221004+0000","last_peered":"2024-04-16T15:37:06.221004+0000","last_clean":"2024-04-16T15:37:06.221004+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:06.221004+0000","last_undegraded":"2024-04-16T15:37:06.221004+0000","last_fullsized":"2024-04-16T15:37:06.221004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754967+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:05.754967+0000","last_peered":"2024-04-16T15:37:05.754967+0000","last_clean":"2024-04-16T15:37:05.754967+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:05.754967+0000","last_undegraded":"2024-04-16T15:37:05.754967+0000","last_fullsized":"2024-04-16T15:37:05.754967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380639+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:06.380639+0000","last_peered":"2024-04-16T15:37:06.380639+0000","last_clean":"2024-04-16T15:37:06.380639+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:06.380639+0000","last_undegraded":"2024-04-16T15:37:06.380639+0000","last_fullsized":"2024-04-16T15:37:06.380639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754853+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:05.754853+0000","last_peered":"2024-04-16T15:37:05.754853+0000","last_clean":"2024-04-16T15:37:05.754853+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:05.754853+0000","last_undegraded":"2024-04-16T15:37:05.754853+0000","last_fullsized":"2024-04-16T15:37:05.754853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221142+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:06.221142+0000","last_peered":"2024-04-16T15:37:06.221142+0000","last_clean":"2024-04-16T15:37:06.221142+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:06.221142+0000","last_undegraded":"2024-04-16T15:37:06.221142+0000","last_fullsized":"2024-04-16T15:37:06.221142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755206+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:05.755206+0000","last_peered":"2024-04-16T15:37:05.755206+0000","last_clean":"2024-04-16T15:37:05.755206+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:05.755206+0000","last_undegraded":"2024-04-16T15:37:05.755206+0000","last_fullsized":"2024-04-16T15:37:05.755206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380705+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:06.380705+0000","last_peered":"2024-04-16T15:37:06.380705+0000","last_clean":"2024-04-16T15:37:06.380705+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:06.380705+0000","last_undegraded":"2024-04-16T15:37:06.380705+0000","last_fullsized":"2024-04-16T15:37:06.380705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380706+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:06.380706+0000","last_peered":"2024-04-16T15:37:06.380706+0000","last_clean":"2024-04-16T15:37:06.380706+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:06.380706+0000","last_undegraded":"2024-04-16T15:37:06.380706+0000","last_fullsized":"2024-04-16T15:37:06.380706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380811+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:06.380811+0000","last_peered":"2024-04-16T15:37:06.380811+0000","last_clean":"2024-04-16T15:37:06.380811+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:06.380811+0000","last_undegraded":"2024-04-16T15:37:06.380811+0000","last_fullsized":"2024-04-16T15:37:06.380811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220921+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:06.220921+0000","last_peered":"2024-04-16T15:37:06.220921+0000","last_clean":"2024-04-16T15:37:06.220921+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:06.220921+0000","last_undegraded":"2024-04-16T15:37:06.220921+0000","last_fullsized":"2024-04-16T15:37:06.220921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823486+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:06.823486+0000","last_peered":"2024-04-16T15:37:06.823486+0000","last_clean":"2024-04-16T15:37:06.823486+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:06.823486+0000","last_undegraded":"2024-04-16T15:37:06.823486+0000","last_fullsized":"2024-04-16T15:37:06.823486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823322+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:06.823322+0000","last_peered":"2024-04-16T15:37:06.823322+0000","last_clean":"2024-04-16T15:37:06.823322+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:06.823322+0000","last_undegraded":"2024-04-16T15:37:06.823322+0000","last_fullsized":"2024-04-16T15:37:06.823322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755189+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:05.755189+0000","last_peered":"2024-04-16T15:37:05.755189+0000","last_clean":"2024-04-16T15:37:05.755189+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:05.755189+0000","last_undegraded":"2024-04-16T15:37:05.755189+0000","last_fullsized":"2024-04-16T15:37:05.755189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755068+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:05.755068+0000","last_peered":"2024-04-16T15:37:05.755068+0000","last_clean":"2024-04-16T15:37:05.755068+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:05.755068+0000","last_undegraded":"2024-04-16T15:37:05.755068+0000","last_fullsized":"2024-04-16T15:37:05.755068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755094+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:05.755094+0000","last_peered":"2024-04-16T15:37:05.755094+0000","last_clean":"2024-04-16T15:37:05.755094+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:05.755094+0000","last_undegraded":"2024-04-16T15:37:05.755094+0000","last_fullsized":"2024-04-16T15:37:05.755094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:13.453 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T15:37:13.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:13.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.593+0000 7f7e48688640 1 Processor -- start 2024-04-16T15:37:13.592 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.593+0000 7f7e48688640 1 -- start start 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e48688640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7e40141b10 0x7f7e4015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e48688640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4015cc20 con 0x7f7e4015c3d0 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e48688640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4013eb70 con 0x7f7e4015f9f0 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e48688640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4015c940 con 0x7f7e40141b10 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e46c25640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f7e4015c3d0 0x7f7e400b5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:41784/0 (socket says 172.21.15.80:41784) 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e46c25640 1 -- 172.21.15.80:0/2584186009 learned_addr learned my addr 172.21.15.80:0/2584186009 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:13.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45c23640 1 --2- 172.21.15.80:0/2584186009 >> v2:172.21.15.87:3300/0 conn(0x7f7e40141b10 0x7f7e4015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754773321 0 0) 0x7f7e4015cc20 con 0x7f7e4015c3d0 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e2c003520 con 0x7f7e4015c3d0 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 548015417 0 0) 0x7f7e2c003520 con 0x7f7e4015c3d0 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 >> v2:172.21.15.87:3300/0 conn(0x7f7e40141b10 msgr2=0x7f7e4015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 --2- 172.21.15.80:0/2584186009 >> v2:172.21.15.87:3300/0 conn(0x7f7e40141b10 0x7f7e4015fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 >> v1:172.21.15.87:6789/0 conn(0x7f7e4015f9f0 legacy=0x7f7e4015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 --> v1:172.21.15.80:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e40141030 con 0x7f7e4015c3d0 2024-04-16T15:37:13.597 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v1:172.21.15.80:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3144653542 0 0) 0x7f7e380019f0 con 0x7f7e4015c3d0 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 >> v1:172.21.15.80:6789/0 conn(0x7f7e4015c3d0 legacy=0x7f7e400b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e2c0039b0 0x7f7e2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 0x7f7e2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c0051c0 0x7f7e2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4015c940 con 0x7f7e2c004800 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c00c160 con 0x7f7e2c0039b0 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c00c360 con 0x7f7e2c0051c0 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.594+0000 7f7e45c23640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 0x7f7e2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.598 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e46424640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e2c0039b0 0x7f7e2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e46c25640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c0051c0 0x7f7e2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 -- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c0051c0 msgr2=0x7f7e2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c0051c0 0x7f7e2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 -- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e2c0039b0 msgr2=0x7f7e2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e2c0039b0 0x7f7e2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 -- 172.21.15.80:0/2584186009 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c003520 con 0x7f7e2c004800 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e46424640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e2c0039b0 0x7f7e2c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:13.599 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e46c25640 1 -- 172.21.15.80:0/2584186009 reap_dead start 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.595+0000 7f7e45c23640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 0x7f7e2c004c80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ac0 tx=0x7f7e2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2beabc39d066bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c039070 con 0x7f7e2c004800 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c02c6b0 con 0x7f7e2c004800 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e45422640 1 -- 172.21.15.80:0/2584186009 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c009690 con 0x7f7e2c004800 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 -- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 msgr2=0x7f7e2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 0x7f7e2c004c80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ac0 tx=0x7f7e2c005830 comp rx=0 tx=0).stop 2024-04-16T15:37:13.600 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 -- 172.21.15.80:0/2584186009 shutdown_connections 2024-04-16T15:37:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 --2- 172.21.15.80:0/2584186009 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e2c004800 0x7f7e2c004c80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 -- 172.21.15.80:0/2584186009 >> 172.21.15.80:0/2584186009 conn(0x7f7e400b2940 msgr2=0x7f7e4006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.601 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 -- 172.21.15.80:0/2584186009 shutdown_connections 2024-04-16T15:37:13.602 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.596+0000 7f7e48688640 1 -- 172.21.15.80:0/2584186009 wait complete. 2024-04-16T15:37:13.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.597+0000 7f7e48688640 1 Processor -- start 2024-04-16T15:37:13.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.597+0000 7f7e48688640 1 -- start start 2024-04-16T15:37:13.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c004800 0x7f7e401f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e40140860 0x7f7e4013d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4015fdd0 con 0x7f7e401e71b0 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7e401415f0 con 0x7f7e40140860 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e48688640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4015ff50 con 0x7f7e2c004800 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55192/0 (socket says 172.21.15.80:55192) 2024-04-16T15:37:13.606 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 -- 172.21.15.80:0/1951149091 learned_addr learned my addr 172.21.15.80:0/1951149091 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e45c23640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e40140860 0x7f7e4013d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46424640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c004800 0x7f7e401f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 -- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c004800 msgr2=0x7f7e401f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c004800 0x7f7e401f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 -- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e40140860 msgr2=0x7f7e4013d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e40140860 0x7f7e4013d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.598+0000 7f7e46c25640 1 -- 172.21.15.80:0/1951149091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e401f6600 con 0x7f7e401e71b0 2024-04-16T15:37:13.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e46c25640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e401562a0 tx=0x7f7e38007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800ea50 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3800ebf0 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38014430 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e401f68e0 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.599+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e40140cc0 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.600+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e401f6e00 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.600+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e380145d0 con 0x7f7e401e71b0 2024-04-16T15:37:13.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.601+0000 7f7e36ffd640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 0x7f7e2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.601+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7e3808b8f0 con 0x7f7e401e71b0 2024-04-16T15:37:13.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.601+0000 7f7e46424640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 0x7f7e2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.601+0000 7f7e46424640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 0x7f7e2406ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.605+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e401f6e00 con 0x7f7e401e71b0 2024-04-16T15:37:13.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.777+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e40068a40 con 0x7f7e2406c920 2024-04-16T15:37:13.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.783+0000 7f7e36ffd640 1 -- 172.21.15.80:0/1951149091 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251846 (secure 0 0 0) 0x7f7e40068a40 con 0x7f7e2406c920 2024-04-16T15:37:13.785 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:13.787 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:13.788 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 msgr2=0x7f7e2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 0x7f7e2406ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 msgr2=0x7f7e401e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e401562a0 tx=0x7f7e38007b50 comp rx=0 tx=0).stop 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 shutdown_connections 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7e401e71b0 0x7f7e401e7660 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e40140860 0x7f7e4013d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f7e2406c920 0x7f7e2406ede0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 --2- 172.21.15.80:0/1951149091 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f7e2c004800 0x7f7e401f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 >> 172.21.15.80:0/1951149091 conn(0x7f7e400b2940 msgr2=0x7f7e400cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 shutdown_connections 2024-04-16T15:37:13.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.786+0000 7f7e48688640 1 -- 172.21.15.80:0/1951149091 wait complete. 2024-04-16T15:37:13.797 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-16T15:37:13.175671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220920,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753800,"statfs":{"total":773094113280,"available":772867891200,"internally_reserved":0,"allocated":4857856,"data_stored":2762940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.900616"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380823+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:06.380823+0000","last_peered":"2024-04-16T15:37:06.380823+0000","last_clean":"2024-04-16T15:37:06.380823+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:06.380823+0000","last_undegraded":"2024-04-16T15:37:06.380823+0000","last_fullsized":"2024-04-16T15:37:06.380823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220953+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:06.220953+0000","last_peered":"2024-04-16T15:37:06.220953+0000","last_clean":"2024-04-16T15:37:06.220953+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:06.220953+0000","last_undegraded":"2024-04-16T15:37:06.220953+0000","last_fullsized":"2024-04-16T15:37:06.220953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380899+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:06.380899+0000","last_peered":"2024-04-16T15:37:06.380899+0000","last_clean":"2024-04-16T15:37:06.380899+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:06.380899+0000","last_undegraded":"2024-04-16T15:37:06.380899+0000","last_fullsized":"2024-04-16T15:37:06.380899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380731+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:06.380731+0000","last_peered":"2024-04-16T15:37:06.380731+0000","last_clean":"2024-04-16T15:37:06.380731+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:06.380731+0000","last_undegraded":"2024-04-16T15:37:06.380731+0000","last_fullsized":"2024-04-16T15:37:06.380731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823459+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:06.823459+0000","last_peered":"2024-04-16T15:37:06.823459+0000","last_clean":"2024-04-16T15:37:06.823459+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:06.823459+0000","last_undegraded":"2024-04-16T15:37:06.823459+0000","last_fullsized":"2024-04-16T15:37:06.823459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754686+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:05.754686+0000","last_peered":"2024-04-16T15:37:05.754686+0000","last_clean":"2024-04-16T15:37:05.754686+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:05.754686+0000","last_undegraded":"2024-04-16T15:37:05.754686+0000","last_fullsized":"2024-04-16T15:37:05.754686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755359+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:05.755359+0000","last_peered":"2024-04-16T15:37:05.755359+0000","last_clean":"2024-04-16T15:37:05.755359+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:05.755359+0000","last_undegraded":"2024-04-16T15:37:05.755359+0000","last_fullsized":"2024-04-16T15:37:05.755359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823881+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:06.823881+0000","last_peered":"2024-04-16T15:37:06.823881+0000","last_clean":"2024-04-16T15:37:06.823881+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:06.823881+0000","last_undegraded":"2024-04-16T15:37:06.823881+0000","last_fullsized":"2024-04-16T15:37:06.823881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754717+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:05.754717+0000","last_peered":"2024-04-16T15:37:05.754717+0000","last_clean":"2024-04-16T15:37:05.754717+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:05.754717+0000","last_undegraded":"2024-04-16T15:37:05.754717+0000","last_fullsized":"2024-04-16T15:37:05.754717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221170+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:06.221170+0000","last_peered":"2024-04-16T15:37:06.221170+0000","last_clean":"2024-04-16T15:37:06.221170+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:06.221170+0000","last_undegraded":"2024-04-16T15:37:06.221170+0000","last_fullsized":"2024-04-16T15:37:06.221170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754846+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:05.754846+0000","last_peered":"2024-04-16T15:37:05.754846+0000","last_clean":"2024-04-16T15:37:05.754846+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:05.754846+0000","last_undegraded":"2024-04-16T15:37:05.754846+0000","last_fullsized":"2024-04-16T15:37:05.754846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220986+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:06.220986+0000","last_peered":"2024-04-16T15:37:06.220986+0000","last_clean":"2024-04-16T15:37:06.220986+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:06.220986+0000","last_undegraded":"2024-04-16T15:37:06.220986+0000","last_fullsized":"2024-04-16T15:37:06.220986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755060+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:05.755060+0000","last_peered":"2024-04-16T15:37:05.755060+0000","last_clean":"2024-04-16T15:37:05.755060+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:05.755060+0000","last_undegraded":"2024-04-16T15:37:05.755060+0000","last_fullsized":"2024-04-16T15:37:05.755060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221200+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:06.221200+0000","last_peered":"2024-04-16T15:37:06.221200+0000","last_clean":"2024-04-16T15:37:06.221200+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:06.221200+0000","last_undegraded":"2024-04-16T15:37:06.221200+0000","last_fullsized":"2024-04-16T15:37:06.221200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380762+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:06.380762+0000","last_peered":"2024-04-16T15:37:06.380762+0000","last_clean":"2024-04-16T15:37:06.380762+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:06.380762+0000","last_undegraded":"2024-04-16T15:37:06.380762+0000","last_fullsized":"2024-04-16T15:37:06.380762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823838+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:06.823838+0000","last_peered":"2024-04-16T15:37:06.823838+0000","last_clean":"2024-04-16T15:37:06.823838+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:06.823838+0000","last_undegraded":"2024-04-16T15:37:06.823838+0000","last_fullsized":"2024-04-16T15:37:06.823838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221222+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:06.221222+0000","last_peered":"2024-04-16T15:37:06.221222+0000","last_clean":"2024-04-16T15:37:06.221222+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:06.221222+0000","last_undegraded":"2024-04-16T15:37:06.221222+0000","last_fullsized":"2024-04-16T15:37:06.221222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823655+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:06.823655+0000","last_peered":"2024-04-16T15:37:06.823655+0000","last_clean":"2024-04-16T15:37:06.823655+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:06.823655+0000","last_undegraded":"2024-04-16T15:37:06.823655+0000","last_fullsized":"2024-04-16T15:37:06.823655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380540+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:06.380540+0000","last_peered":"2024-04-16T15:37:06.380540+0000","last_clean":"2024-04-16T15:37:06.380540+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:06.380540+0000","last_undegraded":"2024-04-16T15:37:06.380540+0000","last_fullsized":"2024-04-16T15:37:06.380540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754898+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:05.754898+0000","last_peered":"2024-04-16T15:37:05.754898+0000","last_clean":"2024-04-16T15:37:05.754898+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:05.754898+0000","last_undegraded":"2024-04-16T15:37:05.754898+0000","last_fullsized":"2024-04-16T15:37:05.754898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823711+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:06.823711+0000","last_peered":"2024-04-16T15:37:06.823711+0000","last_clean":"2024-04-16T15:37:06.823711+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:06.823711+0000","last_undegraded":"2024-04-16T15:37:06.823711+0000","last_fullsized":"2024-04-16T15:37:06.823711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220901+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:06.220901+0000","last_peered":"2024-04-16T15:37:06.220901+0000","last_clean":"2024-04-16T15:37:06.220901+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:06.220901+0000","last_undegraded":"2024-04-16T15:37:06.220901+0000","last_fullsized":"2024-04-16T15:37:06.220901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823320+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:06.823320+0000","last_peered":"2024-04-16T15:37:06.823320+0000","last_clean":"2024-04-16T15:37:06.823320+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:06.823320+0000","last_undegraded":"2024-04-16T15:37:06.823320+0000","last_fullsized":"2024-04-16T15:37:06.823320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755232+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:05.755232+0000","last_peered":"2024-04-16T15:37:05.755232+0000","last_clean":"2024-04-16T15:37:05.755232+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:05.755232+0000","last_undegraded":"2024-04-16T15:37:05.755232+0000","last_fullsized":"2024-04-16T15:37:05.755232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380782+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:06.380782+0000","last_peered":"2024-04-16T15:37:06.380782+0000","last_clean":"2024-04-16T15:37:06.380782+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:06.380782+0000","last_undegraded":"2024-04-16T15:37:06.380782+0000","last_fullsized":"2024-04-16T15:37:06.380782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823831+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:06.823831+0000","last_peered":"2024-04-16T15:37:06.823831+0000","last_clean":"2024-04-16T15:37:06.823831+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:06.823831+0000","last_undegraded":"2024-04-16T15:37:06.823831+0000","last_fullsized":"2024-04-16T15:37:06.823831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380546+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:06.380546+0000","last_peered":"2024-04-16T15:37:06.380546+0000","last_clean":"2024-04-16T15:37:06.380546+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:06.380546+0000","last_undegraded":"2024-04-16T15:37:06.380546+0000","last_fullsized":"2024-04-16T15:37:06.380546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220905+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:06.220905+0000","last_peered":"2024-04-16T15:37:06.220905+0000","last_clean":"2024-04-16T15:37:06.220905+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:06.220905+0000","last_undegraded":"2024-04-16T15:37:06.220905+0000","last_fullsized":"2024-04-16T15:37:06.220905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754906+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:05.754906+0000","last_peered":"2024-04-16T15:37:05.754906+0000","last_clean":"2024-04-16T15:37:05.754906+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:05.754906+0000","last_undegraded":"2024-04-16T15:37:05.754906+0000","last_fullsized":"2024-04-16T15:37:05.754906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754713+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:05.754713+0000","last_peered":"2024-04-16T15:37:05.754713+0000","last_clean":"2024-04-16T15:37:05.754713+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:05.754713+0000","last_undegraded":"2024-04-16T15:37:05.754713+0000","last_fullsized":"2024-04-16T15:37:05.754713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:06.823967+0000","last_peered":"2024-04-16T15:37:06.823967+0000","last_clean":"2024-04-16T15:37:06.823967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:06.823967+0000","last_undegraded":"2024-04-16T15:37:06.823967+0000","last_fullsized":"2024-04-16T15:37:06.823967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823846+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:06.823846+0000","last_peered":"2024-04-16T15:37:06.823846+0000","last_clean":"2024-04-16T15:37:06.823846+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:06.823846+0000","last_undegraded":"2024-04-16T15:37:06.823846+0000","last_fullsized":"2024-04-16T15:37:06.823846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221004+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:06.221004+0000","last_peered":"2024-04-16T15:37:06.221004+0000","last_clean":"2024-04-16T15:37:06.221004+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:06.221004+0000","last_undegraded":"2024-04-16T15:37:06.221004+0000","last_fullsized":"2024-04-16T15:37:06.221004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754967+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:05.754967+0000","last_peered":"2024-04-16T15:37:05.754967+0000","last_clean":"2024-04-16T15:37:05.754967+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:05.754967+0000","last_undegraded":"2024-04-16T15:37:05.754967+0000","last_fullsized":"2024-04-16T15:37:05.754967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380639+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:06.380639+0000","last_peered":"2024-04-16T15:37:06.380639+0000","last_clean":"2024-04-16T15:37:06.380639+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:06.380639+0000","last_undegraded":"2024-04-16T15:37:06.380639+0000","last_fullsized":"2024-04-16T15:37:06.380639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754853+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:05.754853+0000","last_peered":"2024-04-16T15:37:05.754853+0000","last_clean":"2024-04-16T15:37:05.754853+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:05.754853+0000","last_undegraded":"2024-04-16T15:37:05.754853+0000","last_fullsized":"2024-04-16T15:37:05.754853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221142+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:06.221142+0000","last_peered":"2024-04-16T15:37:06.221142+0000","last_clean":"2024-04-16T15:37:06.221142+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:06.221142+0000","last_undegraded":"2024-04-16T15:37:06.221142+0000","last_fullsized":"2024-04-16T15:37:06.221142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755206+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:05.755206+0000","last_peered":"2024-04-16T15:37:05.755206+0000","last_clean":"2024-04-16T15:37:05.755206+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:05.755206+0000","last_undegraded":"2024-04-16T15:37:05.755206+0000","last_fullsized":"2024-04-16T15:37:05.755206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380705+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:06.380705+0000","last_peered":"2024-04-16T15:37:06.380705+0000","last_clean":"2024-04-16T15:37:06.380705+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:06.380705+0000","last_undegraded":"2024-04-16T15:37:06.380705+0000","last_fullsized":"2024-04-16T15:37:06.380705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380706+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:06.380706+0000","last_peered":"2024-04-16T15:37:06.380706+0000","last_clean":"2024-04-16T15:37:06.380706+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:06.380706+0000","last_undegraded":"2024-04-16T15:37:06.380706+0000","last_fullsized":"2024-04-16T15:37:06.380706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380811+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:06.380811+0000","last_peered":"2024-04-16T15:37:06.380811+0000","last_clean":"2024-04-16T15:37:06.380811+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:06.380811+0000","last_undegraded":"2024-04-16T15:37:06.380811+0000","last_fullsized":"2024-04-16T15:37:06.380811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220921+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:06.220921+0000","last_peered":"2024-04-16T15:37:06.220921+0000","last_clean":"2024-04-16T15:37:06.220921+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:06.220921+0000","last_undegraded":"2024-04-16T15:37:06.220921+0000","last_fullsized":"2024-04-16T15:37:06.220921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823486+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:06.823486+0000","last_peered":"2024-04-16T15:37:06.823486+0000","last_clean":"2024-04-16T15:37:06.823486+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:06.823486+0000","last_undegraded":"2024-04-16T15:37:06.823486+0000","last_fullsized":"2024-04-16T15:37:06.823486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823322+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:06.823322+0000","last_peered":"2024-04-16T15:37:06.823322+0000","last_clean":"2024-04-16T15:37:06.823322+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:06.823322+0000","last_undegraded":"2024-04-16T15:37:06.823322+0000","last_fullsized":"2024-04-16T15:37:06.823322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755189+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:05.755189+0000","last_peered":"2024-04-16T15:37:05.755189+0000","last_clean":"2024-04-16T15:37:05.755189+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:05.755189+0000","last_undegraded":"2024-04-16T15:37:05.755189+0000","last_fullsized":"2024-04-16T15:37:05.755189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755068+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:05.755068+0000","last_peered":"2024-04-16T15:37:05.755068+0000","last_clean":"2024-04-16T15:37:05.755068+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:05.755068+0000","last_undegraded":"2024-04-16T15:37:05.755068+0000","last_fullsized":"2024-04-16T15:37:05.755068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755094+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:05.755094+0000","last_peered":"2024-04-16T15:37:05.755094+0000","last_clean":"2024-04-16T15:37:05.755094+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:05.755094+0000","last_undegraded":"2024-04-16T15:37:05.755094+0000","last_fullsized":"2024-04-16T15:37:05.755094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:13.800 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T15:37:13.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.941+0000 7f5056329640 1 Processor -- start 2024-04-16T15:37:13.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.941+0000 7f5056329640 1 -- start start 2024-04-16T15:37:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f5056329640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b2c80 0x7f505009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f5056329640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50500b37e0 0x7f505009afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f5056329640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50500b3060 con 0x7f505009b6a0 2024-04-16T15:37:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f5056329640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f50500cdcc0 con 0x7f50500b37e0 2024-04-16T15:37:13.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f5056329640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f50500ce560 con 0x7f50500b2c80 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50500b37e0 0x7f505009afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f50500b37e0 0x7f505009afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55200/0 (socket says 172.21.15.80:55200) 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 -- 172.21.15.80:0/346596984 learned_addr learned my addr 172.21.15.80:0/346596984 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f504ffff640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b2c80 0x7f505009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 -- 172.21.15.80:0/346596984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b2c80 msgr2=0x7f505009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b2c80 0x7f505009aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 -- 172.21.15.80:0/346596984 >> v1:172.21.15.87:6789/0 conn(0x7f505009b6a0 legacy=0x7f50500d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.942+0000 7f50548c6640 1 -- 172.21.15.80:0/346596984 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500b3ce0 con 0x7f50500b37e0 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.943+0000 7f50548c6640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b37e0 0x7f505009afb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5048009e50 tx=0x7f504802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d5dcc3f5cc80de server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.943+0000 7f504effd640 1 -- 172.21.15.80:0/346596984 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504802cb00 con 0x7f50500b37e0 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.943+0000 7f504effd640 1 -- 172.21.15.80:0/346596984 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504802cca0 con 0x7f50500b37e0 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.943+0000 7f504effd640 1 -- 172.21.15.80:0/346596984 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048034610 con 0x7f50500b37e0 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 -- 172.21.15.80:0/346596984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b37e0 msgr2=0x7f505009afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b37e0 0x7f505009afb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5048009e50 tx=0x7f504802bf60 comp rx=0 tx=0).stop 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 -- 172.21.15.80:0/346596984 shutdown_connections 2024-04-16T15:37:13.945 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b37e0 0x7f505009afb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 --2- 172.21.15.80:0/346596984 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b2c80 0x7f505009aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 -- 172.21.15.80:0/346596984 >> 172.21.15.80:0/346596984 conn(0x7f50500d24f0 msgr2=0x7f50500d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:13.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 -- 172.21.15.80:0/346596984 shutdown_connections 2024-04-16T15:37:13.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.944+0000 7f5056329640 1 -- 172.21.15.80:0/346596984 wait complete. 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.945+0000 7f5056329640 1 Processor -- start 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.945+0000 7f5056329640 1 -- start start 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505009b6a0 0x7f50500708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b37e0 0x7f505014d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f50500b6540 con 0x7f50500b2c80 2024-04-16T15:37:13.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50500ce1f0 con 0x7f505009b6a0 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f50500b66c0 con 0x7f50500b37e0 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55204/0 (socket says 172.21.15.80:55204) 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 -- 172.21.15.80:0/997433995 learned_addr learned my addr 172.21.15.80:0/997433995 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f50548c6640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b37e0 0x7f505014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504ffff640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505009b6a0 0x7f50500708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 -- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b37e0 msgr2=0x7f505014d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b37e0 0x7f505014d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 -- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505009b6a0 msgr2=0x7f50500708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505009b6a0 0x7f50500708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 -- 172.21.15.80:0/997433995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500b12b0 con 0x7f50500b2c80 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504f7fe640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f504400c440 tx=0x7f5044001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50440052d0 con 0x7f50500b2c80 2024-04-16T15:37:13.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5044005470 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50500b1590 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044007260 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.946+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50500b1e30 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.947+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50500b1760 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.948+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5044007400 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.948+0000 7f504cff9640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 0x7f503c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.948+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f504408b1a0 con 0x7f50500b2c80 2024-04-16T15:37:13.952 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.948+0000 7f504ffff640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 0x7f503c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:13.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.949+0000 7f504ffff640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 0x7f503c06edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5040006fd0 tx=0x7f5040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:13.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:13.952+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50440594d0 con 0x7f50500b2c80 2024-04-16T15:37:13.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2024-04-16T15:37:14.128 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.128+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50500b2030 con 0x7f50500b2c80 2024-04-16T15:37:14.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.129+0000 7f504cff9640 1 -- 172.21.15.80:0/997433995 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16882 (secure 0 0 0) 0x7f50500b2030 con 0x7f50500b2c80 2024-04-16T15:37:14.129 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:14.129 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":39,"fsid":"a7d324ba-fc74-42df-88c0-3e8f3a7e8eab","created":"2024-04-16T15:35:23.006253+0000","modified":"2024-04-16T15:37:04.281722+0000","last_up_change":"2024-04-16T15:35:34.189714+0000","last_in_change":"2024-04-16T15:35:25.281053+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T15:35:35.178881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T15:37:01.116058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T15:37:01.579531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4807c88-87e2-4084-acbb-5a9121b644f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6825","nonce":802352542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6827","nonce":802352542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6831","nonce":802352542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":802352542},{"type":"v1","addr":"172.21.15.80:6829","nonce":802352542}]},"public_addr":"172.21.15.80:6825/802352542","cluster_addr":"172.21.15.80:6827/802352542","heartbeat_back_addr":"172.21.15.80:6831/802352542","heartbeat_front_addr":"172.21.15.80:6829/802352542","state":["exists","up"]},{"osd":1,"uuid":"44b74c98-ef92-447a-adfc-713613923d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6801","nonce":1467041108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6803","nonce":1467041108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6807","nonce":1467041108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1467041108},{"type":"v1","addr":"172.21.15.80:6805","nonce":1467041108}]},"public_addr":"172.21.15.80:6801/1467041108","cluster_addr":"172.21.15.80:6803/1467041108","heartbeat_back_addr":"172.21.15.80:6807/1467041108","heartbeat_front_addr":"172.21.15.80:6805/1467041108","state":["exists","up"]},{"osd":2,"uuid":"8f2f152c-fd74-41c3-972b-d30f44bae609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6809","nonce":2167961264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6812","nonce":2167961264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6820","nonce":2167961264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":2167961264},{"type":"v1","addr":"172.21.15.80:6816","nonce":2167961264}]},"public_addr":"172.21.15.80:6809/2167961264","cluster_addr":"172.21.15.80:6812/2167961264","heartbeat_back_addr":"172.21.15.80:6820/2167961264","heartbeat_front_addr":"172.21.15.80:6816/2167961264","state":["exists","up"]},{"osd":3,"uuid":"57d01d0a-ca41-4695-87e9-7b94c4709fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6811","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6813","nonce":1569227451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6815","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6817","nonce":1569227451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6823","nonce":1569227451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6819","nonce":1569227451},{"type":"v1","addr":"172.21.15.80:6821","nonce":1569227451}]},"public_addr":"172.21.15.80:6813/1569227451","cluster_addr":"172.21.15.80:6817/1569227451","heartbeat_back_addr":"172.21.15.80:6823/1569227451","heartbeat_front_addr":"172.21.15.80:6821/1569227451","state":["exists","up"]},{"osd":4,"uuid":"764f41d4-e1b1-4c9c-84d5-9f002b27341c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6801","nonce":1581459636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6803","nonce":1581459636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6807","nonce":1581459636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1581459636},{"type":"v1","addr":"172.21.15.87:6805","nonce":1581459636}]},"public_addr":"172.21.15.87:6801/1581459636","cluster_addr":"172.21.15.87:6803/1581459636","heartbeat_back_addr":"172.21.15.87:6807/1581459636","heartbeat_front_addr":"172.21.15.87:6805/1581459636","state":["exists","up"]},{"osd":5,"uuid":"0a487996-d362-45af-83e0-40c900f63f91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6809","nonce":968411507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6811","nonce":968411507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6815","nonce":968411507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":968411507},{"type":"v1","addr":"172.21.15.87:6813","nonce":968411507}]},"public_addr":"172.21.15.87:6809/968411507","cluster_addr":"172.21.15.87:6811/968411507","heartbeat_back_addr":"172.21.15.87:6815/968411507","heartbeat_front_addr":"172.21.15.87:6813/968411507","state":["exists","up"]},{"osd":6,"uuid":"3b3bf0fd-3800-4f62-9a67-de26c81819a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6825","nonce":2634190512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6827","nonce":2634190512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6831","nonce":2634190512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":2634190512},{"type":"v1","addr":"172.21.15.87:6829","nonce":2634190512}]},"public_addr":"172.21.15.87:6825/2634190512","cluster_addr":"172.21.15.87:6827/2634190512","heartbeat_back_addr":"172.21.15.87:6831/2634190512","heartbeat_front_addr":"172.21.15.87:6829/2634190512","state":["exists","up"]},{"osd":7,"uuid":"76d0f0d5-8411-4a4f-9f23-8cbb22fd2f35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6817","nonce":4163376620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6819","nonce":4163376620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6823","nonce":4163376620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":4163376620},{"type":"v1","addr":"172.21.15.87:6821","nonce":4163376620}]},"public_addr":"172.21.15.87:6817/4163376620","cluster_addr":"172.21.15.87:6819/4163376620","heartbeat_back_addr":"172.21.15.87:6823/4163376620","heartbeat_front_addr":"172.21.15.87:6821/4163376620","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.466924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.384178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.472645+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.483840+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.397144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.385713+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.449693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T15:35:30.435642+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T15:37:14.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 msgr2=0x7f503c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:14.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 0x7f503c06edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5040006fd0 tx=0x7f5040008040 comp rx=0 tx=0).stop 2024-04-16T15:37:14.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 msgr2=0x7f50500b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:14.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f504400c440 tx=0x7f5044001e70 comp rx=0 tx=0).stop 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 shutdown_connections 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f503c06c8f0 0x7f503c06edb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f50500b37e0 0x7f505014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50500b2c80 0x7f50500b0810 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 --2- 172.21.15.80:0/997433995 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f505009b6a0 0x7f50500708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 >> 172.21.15.80:0/997433995 conn(0x7f50500d24f0 msgr2=0x7f5050074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:14.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 shutdown_connections 2024-04-16T15:37:14.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:14.131+0000 7f5056329640 1 -- 172.21.15.80:0/997433995 wait complete. 2024-04-16T15:37:15.143 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T15:37:15.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.256+0000 7f5b934b1640 1 Processor -- start 2024-04-16T15:37:15.256 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 -- start start 2024-04-16T15:37:15.257 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8c15c8a0 0x7f5b8c0d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5b8c09b180 0x7f5b8c0af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8c0ce640 con 0x7f5b8c09b7a0 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8c0b1600 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.257+0000 7f5b934b1640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8c0b18e0 con 0x7f5b8c09b180 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b9124d640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f5b8c15c8a0 0x7f5b8c0d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b90a4c640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5b8c09b7a0 0x7f5b8c09aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53078/0 (socket says 172.21.15.80:53078) 2024-04-16T15:37:15.258 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b90a4c640 1 -- 172.21.15.80:0/3084379368 learned_addr learned my addr 172.21.15.80:0/3084379368 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b91a4e640 1 --2- 172.21.15.80:0/3084379368 >> v2:172.21.15.87:3300/0 conn(0x7f5b8c09b180 0x7f5b8c0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b9124d640 1 -- 172.21.15.80:0/3084379368 >> v2:172.21.15.87:3300/0 conn(0x7f5b8c09b180 msgr2=0x7f5b8c0af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b9124d640 1 --2- 172.21.15.80:0/3084379368 >> v2:172.21.15.87:3300/0 conn(0x7f5b8c09b180 0x7f5b8c0af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b9124d640 1 -- 172.21.15.80:0/3084379368 >> v1:172.21.15.80:6789/0 conn(0x7f5b8c09b7a0 legacy=0x7f5b8c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.259 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.258+0000 7f5b9124d640 1 -- 172.21.15.80:0/3084379368 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c0ce360 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b9124d640 1 --2- 172.21.15.80:0/3084379368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c0d10b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c073f40 tx=0x7f5b8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4fc79db637056c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.262 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b83fff640 1 -- 172.21.15.80:0/3084379368 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88035020 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b83fff640 1 -- 172.21.15.80:0/3084379368 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b88031830 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b83fff640 1 -- 172.21.15.80:0/3084379368 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88031c00 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 -- 172.21.15.80:0/3084379368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 msgr2=0x7f5b8c0d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3084379368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c0d10b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c073f40 tx=0x7f5b8802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 -- 172.21.15.80:0/3084379368 shutdown_connections 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3084379368 >> v2:172.21.15.87:3300/0 conn(0x7f5b8c09b180 0x7f5b8c0af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3084379368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c0d10b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.263 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 -- 172.21.15.80:0/3084379368 >> 172.21.15.80:0/3084379368 conn(0x7f5b8c0d2500 msgr2=0x7f5b8c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 -- 172.21.15.80:0/3084379368 shutdown_connections 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.259+0000 7f5b934b1640 1 -- 172.21.15.80:0/3084379368 wait complete. 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 Processor -- start 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 -- start start 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8c09b180 0x7f5b8c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8c09b7a0 0x7f5b8c09c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0cdf80 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.264 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c15cc80 con 0x7f5b8c09b180 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b934b1640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8c0ce100 con 0x7f5b8c09b7a0 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b91a4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b91a4e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c09ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38078/0 (socket says 172.21.15.80:38078) 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.261+0000 7f5b91a4e640 1 -- 172.21.15.80:0/3330486116 learned_addr learned my addr 172.21.15.80:0/3330486116 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b9124d640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8c09b180 0x7f5b8c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 -- 172.21.15.80:0/3330486116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8c09b7a0 msgr2=0x7f5b8c09c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f5b8c09b7a0 0x7f5b8c09c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.265 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 -- 172.21.15.80:0/3330486116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8c09b180 msgr2=0x7f5b8c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5b8c09b180 0x7f5b8c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c15ead0 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b91a4e640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c09ca20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007e30 tx=0x7f5b8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84014620 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b84019070 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c15edb0 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84014a00 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.266 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.262+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c15f370 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.267 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.263+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b8c15f750 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b84014ba0 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5b7006c8f0 0x7f5b7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5b8408c5a0 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b9124d640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5b7006c8f0 0x7f5b7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.268 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5b70075160 0x7f5b700775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b84006b90 con 0x7f5b70075160 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5b84093050 con 0x7f5b8c15c8a0 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.264+0000 7f5b90a4c640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5b70075160 0x7f5b700775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.265+0000 7f5b9124d640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5b7006c8f0 0x7f5b7006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b88036000 tx=0x7f5b88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.265+0000 7f5b90a4c640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5b70075160 0x7f5b700775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.269 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.265+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== osd.0 v2:172.21.15.80:6824/802352542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b84006b90 con 0x7f5b70075160 2024-04-16T15:37:15.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.278+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 --> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5b8c069150 con 0x7f5b70075160 2024-04-16T15:37:15.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.278+0000 7f5b81ffb640 1 -- 172.21.15.80:0/3330486116 <== osd.0 v2:172.21.15.80:6824/802352542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5b8c069150 con 0x7f5b70075160 2024-04-16T15:37:15.278 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:15.278 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:15.278 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:15.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5b70075160 msgr2=0x7f5b700775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.279 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6824/802352542,v1:172.21.15.80:6825/802352542] conn(0x7f5b70075160 0x7f5b700775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5b7006c8f0 msgr2=0x7f5b7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f5b7006c8f0 0x7f5b7006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b88036000 tx=0x7f5b88008030 comp rx=0 tx=0).stop 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 msgr2=0x7f5b8c09ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 --2- 172.21.15.80:0/3330486116 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5b8c15c8a0 0x7f5b8c09ca20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007e30 tx=0x7f5b8400e4b0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b91a4e640 1 -- 172.21.15.80:0/3330486116 reap_dead start 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 shutdown_connections 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 >> 172.21.15.80:0/3330486116 conn(0x7f5b8c0d2500 msgr2=0x7f5b8c071680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.280 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 shutdown_connections 2024-04-16T15:37:15.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.279+0000 7f5b934b1640 1 -- 172.21.15.80:0/3330486116 wait complete. 2024-04-16T15:37:15.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T15:37:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.392+0000 7ff208cd3640 1 Processor -- start 2024-04-16T15:37:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.392+0000 7ff208cd3640 1 -- start start 2024-04-16T15:37:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff208cd3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff208cd3640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20409b430 con 0x7ff2040cd310 2024-04-16T15:37:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff208cd3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20406dbb0 con 0x7ff20406cf30 2024-04-16T15:37:15.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff208cd3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff20409b6d0 con 0x7ff2040b37b0 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff202d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff2040cd310 0x7ff2040cd780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53094/0 (socket says 172.21.15.80:53094) 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.393+0000 7ff202d9d640 1 -- 172.21.15.80:0/2498786484 learned_addr learned my addr 172.21.15.80:0/2498786484 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff201d9b640 1 --2- 172.21.15.80:0/2498786484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986646320 0 0) 0x7ff20409b430 con 0x7ff2040cd310 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1f0003520 con 0x7ff2040cd310 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117339916 0 0) 0x7ff20406dbb0 con 0x7ff20406cf30 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff20409b430 con 0x7ff20406cf30 2024-04-16T15:37:15.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff201d9b640 1 -- 172.21.15.80:0/2498786484 >> v1:172.21.15.87:6789/0 conn(0x7ff20406cf30 legacy=0x7ff20406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff201d9b640 1 -- 172.21.15.80:0/2498786484 >> v1:172.21.15.80:6789/0 conn(0x7ff2040cd310 legacy=0x7ff2040cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.394+0000 7ff201d9b640 1 -- 172.21.15.80:0/2498786484 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20409b9b0 con 0x7ff2040b37b0 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff201d9b640 1 --2- 172.21.15.80:0/2498786484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040ccdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0097d0 tx=0x7ff1ec02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d6c308ade46d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec035020 con 0x7ff2040b37b0 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec031800 con 0x7ff2040b37b0 2024-04-16T15:37:15.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff20159a640 1 -- 172.21.15.80:0/2498786484 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec031bb0 con 0x7ff2040b37b0 2024-04-16T15:37:15.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff208cd3640 1 -- 172.21.15.80:0/2498786484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 msgr2=0x7ff2040ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.395+0000 7ff208cd3640 1 --2- 172.21.15.80:0/2498786484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040ccdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0097d0 tx=0x7ff1ec02b8a0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.396+0000 7ff208cd3640 1 -- 172.21.15.80:0/2498786484 shutdown_connections 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.396+0000 7ff208cd3640 1 --2- 172.21.15.80:0/2498786484 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040ccdd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.396+0000 7ff208cd3640 1 -- 172.21.15.80:0/2498786484 >> 172.21.15.80:0/2498786484 conn(0x7ff2040b4050 msgr2=0x7ff2040b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.396+0000 7ff208cd3640 1 -- 172.21.15.80:0/2498786484 shutdown_connections 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.396+0000 7ff208cd3640 1 -- 172.21.15.80:0/2498786484 wait complete. 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.397+0000 7ff208cd3640 1 Processor -- start 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.397+0000 7ff208cd3640 1 -- start start 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff20406cf30 0x7ff20415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040ce010 con 0x7ff2040cd310 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040cde90 con 0x7ff20406cf30 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff208cd3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff2040d16e0 con 0x7ff2040b37b0 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38088/0 (socket says 172.21.15.80:38088) 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 -- 172.21.15.80:0/1634105632 learned_addr learned my addr 172.21.15.80:0/1634105632 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff20259c640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff20406cf30 0x7ff20415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff201d9b640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 -- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 msgr2=0x7ff2040c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 -- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff20406cf30 msgr2=0x7ff20415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff20406cf30 0x7ff20415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 -- 172.21.15.80:0/1634105632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20415d730 con 0x7ff2040cd310 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff202d9d640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c3f0 tx=0x7ff1fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.398+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc017070 con 0x7ff2040cd310 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.399+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc005ce0 con 0x7ff2040cd310 2024-04-16T15:37:15.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.399+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2040c9bf0 con 0x7ff2040cd310 2024-04-16T15:37:15.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.399+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0072d0 con 0x7ff2040cd310 2024-04-16T15:37:15.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.399+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2040ca1b0 con 0x7ff2040cd310 2024-04-16T15:37:15.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.400+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff204069150 con 0x7ff2040cd310 2024-04-16T15:37:15.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.400+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1fc01a070 con 0x7ff2040cd310 2024-04-16T15:37:15.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.400+0000 7ff1faffd640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 0x7ff1e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.401+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff1fc08ae60 con 0x7ff2040cd310 2024-04-16T15:37:15.404 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.401+0000 7ff20259c640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 0x7ff1e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.401+0000 7ff20259c640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 0x7ff1e406ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001ea0 tx=0x7ff1f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.405 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.405+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff20415d730 con 0x7ff2040cd310 2024-04-16T15:37:15.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.580+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff2040b4b70 con 0x7ff1e406c920 2024-04-16T15:37:15.580 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.580+0000 7ff1faffd640 1 -- 172.21.15.80:0/1634105632 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff2040b4b70 con 0x7ff1e406c920 2024-04-16T15:37:15.580 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T15:37:15.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 msgr2=0x7ff1e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 0x7ff1e406ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001ea0 tx=0x7ff1f4009040 comp rx=0 tx=0).stop 2024-04-16T15:37:15.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 msgr2=0x7ff2040ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c3f0 tx=0x7ff1fc00c8b0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.582 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 shutdown_connections 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2040cd310 0x7ff2040ce190 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff1e406c920 0x7ff1e406ede0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff2040b37b0 0x7ff2040c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 --2- 172.21.15.80:0/1634105632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff20406cf30 0x7ff20415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 >> 172.21.15.80:0/1634105632 conn(0x7ff2040b4050 msgr2=0x7ff2040cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 shutdown_connections 2024-04-16T15:37:15.583 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.582+0000 7ff208cd3640 1 -- 172.21.15.80:0/1634105632 wait complete. 2024-04-16T15:37:15.593 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T15:37:15.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.700+0000 7f4ba3df4640 1 Processor -- start 2024-04-16T15:37:15.700 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 -- start start 2024-04-16T15:37:15.701 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b9c06e220 0x7f4b9c06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c15e740 0x7f4b9c15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c0d2f30 con 0x7f4b9c162a50 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c1636f0 con 0x7f4b9c06e220 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba3df4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c15f130 con 0x7f4b9c15e740 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.701+0000 7f4ba138f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b9c06e220 0x7f4b9c06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4b9c06e220 0x7f4b9c06dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38104/0 (socket says 172.21.15.80:38104) 2024-04-16T15:37:15.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 -- 172.21.15.80:0/3979928915 learned_addr learned my addr 172.21.15.80:0/3979928915 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba2391640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c15e740 0x7f4b9c15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 -- 172.21.15.80:0/3979928915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c15e740 msgr2=0x7f4b9c15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c15e740 0x7f4b9c15ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 -- 172.21.15.80:0/3979928915 >> v1:172.21.15.87:6789/0 conn(0x7f4b9c162a50 legacy=0x7f4b9c162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.702+0000 7f4ba138f640 1 -- 172.21.15.80:0/3979928915 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c0d3210 con 0x7f4b9c06e220 2024-04-16T15:37:15.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba138f640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c06e220 0x7f4b9c06dc20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009850 tx=0x7f4b8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450e9269eb239c6d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba0b8e640 1 -- 172.21.15.80:0/3979928915 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c037070 con 0x7f4b9c06e220 2024-04-16T15:37:15.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba0b8e640 1 -- 172.21.15.80:0/3979928915 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c004030 con 0x7f4b9c06e220 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba0b8e640 1 -- 172.21.15.80:0/3979928915 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c004460 con 0x7f4b9c06e220 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3979928915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c06e220 msgr2=0x7f4b9c06dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c06e220 0x7f4b9c06dc20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009850 tx=0x7f4b8c02b840 comp rx=0 tx=0).stop 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3979928915 shutdown_connections 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c15e740 0x7f4b9c15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3979928915 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c06e220 0x7f4b9c06dc20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3979928915 >> 172.21.15.80:0/3979928915 conn(0x7f4b9c08c000 msgr2=0x7f4b9c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3979928915 shutdown_connections 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.703+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3979928915 wait complete. 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 Processor -- start 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 -- start start 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c06e220 0x7f4b9c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b9c15e740 0x7f4b9c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 0x7f4b9c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c0cf7e0 con 0x7f4b9c162a50 2024-04-16T15:37:15.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c0d37d0 con 0x7f4b9c15e740 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba3df4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c0cf960 con 0x7f4b9c06e220 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba2391640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 0x7f4b9c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba2391640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 0x7f4b9c15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38112/0 (socket says 172.21.15.80:38112) 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.705+0000 7f4ba2391640 1 -- 172.21.15.80:0/3032228438 learned_addr learned my addr 172.21.15.80:0/3032228438 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba1b90640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c06e220 0x7f4b9c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba138f640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b9c15e740 0x7f4b9c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 -- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c06e220 msgr2=0x7f4b9c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4b9c06e220 0x7f4b9c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 -- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b9c15e740 msgr2=0x7f4b9c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4b9c15e740 0x7f4b9c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c0cc980 con 0x7f4b9c162a50 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba2391640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 0x7f4b9c15f2e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400d800 tx=0x7f4b9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400b6c0 con 0x7f4b9c162a50 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b94019070 con 0x7f4b9c162a50 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c0ccc60 con 0x7f4b9c162a50 2024-04-16T15:37:15.711 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400bac0 con 0x7f4b9c162a50 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.706+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c0cd220 con 0x7f4b9c162a50 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.707+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b9c0cc730 con 0x7f4b9c162a50 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.707+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b9400bc60 con 0x7f4b9c162a50 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4b927fc640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4b8006c8f0 0x7f4b8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4ba1b90640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4b8006c8f0 0x7f4b8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4b9408c150 con 0x7f4b9c162a50 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4b927fc640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f4b80075160 0x7f4b800775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.712 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b80077c70 con 0x7f4b80075160 2024-04-16T15:37:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4b94093050 con 0x7f4b9c162a50 2024-04-16T15:37:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4ba138f640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f4b80075160 0x7f4b800775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.708+0000 7f4ba1b90640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4b8006c8f0 0x7f4b8006edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b98007fd0 tx=0x7f4b98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.713 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.709+0000 7f4ba138f640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f4b80075160 0x7f4b800775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.714 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.709+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== osd.1 v2:172.21.15.80:6800/1467041108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b80077c70 con 0x7f4b80075160 2024-04-16T15:37:15.721 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.722+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 --> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b9c15fa70 con 0x7f4b80075160 2024-04-16T15:37:15.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.722+0000 7f4b927fc640 1 -- 172.21.15.80:0/3032228438 <== osd.1 v2:172.21.15.80:6800/1467041108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4b9c15fa70 con 0x7f4b80075160 2024-04-16T15:37:15.722 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:15.722 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:15.722 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:15.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f4b80075160 msgr2=0x7f4b800775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6800/1467041108,v1:172.21.15.80:6801/1467041108] conn(0x7f4b80075160 0x7f4b800775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4b8006c8f0 msgr2=0x7f4b8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4b8006c8f0 0x7f4b8006edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b98007fd0 tx=0x7f4b98009040 comp rx=0 tx=0).stop 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 msgr2=0x7f4b9c15f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 --2- 172.21.15.80:0/3032228438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4b9c162a50 0x7f4b9c15f2e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400d800 tx=0x7f4b9400dcc0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba2391640 1 -- 172.21.15.80:0/3032228438 reap_dead start 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 shutdown_connections 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 >> 172.21.15.80:0/3032228438 conn(0x7f4b9c08c000 msgr2=0x7f4b9c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 shutdown_connections 2024-04-16T15:37:15.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.723+0000 7f4ba3df4640 1 -- 172.21.15.80:0/3032228438 wait complete. 2024-04-16T15:37:15.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T15:37:15.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.836+0000 7f9c13ab3640 1 Processor -- start 2024-04-16T15:37:15.836 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.836+0000 7f9c13ab3640 1 -- start start 2024-04-16T15:37:15.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.837+0000 7f9c13ab3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c0c15f940 0x7f9c0c06c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.837+0000 7f9c13ab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c168400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.837 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.837+0000 7f9c13ab3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c1592b0 con 0x7f9c0c15ee50 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.837+0000 7f9c13ab3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9c0c06e800 con 0x7f9c0c15f940 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.837+0000 7f9c13ab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c06d230 con 0x7f9c0c06ca40 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c1104e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c0c15f940 0x7f9c0c06c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c12050640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c1184f640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9c0c15ee50 0x7f9c0c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:43960/0 (socket says 172.21.15.80:43960) 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c1184f640 1 -- 172.21.15.80:0/1256828433 learned_addr learned my addr 172.21.15.80:0/1256828433 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c12050640 1 -- 172.21.15.80:0/1256828433 >> v2:172.21.15.87:3300/0 conn(0x7f9c0c15f940 msgr2=0x7f9c0c06c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:15.838 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c12050640 1 --2- 172.21.15.80:0/1256828433 >> v2:172.21.15.87:3300/0 conn(0x7f9c0c15f940 0x7f9c0c06c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c12050640 1 -- 172.21.15.80:0/1256828433 >> v1:172.21.15.87:6789/0 conn(0x7f9c0c15ee50 legacy=0x7f9c0c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.839 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.838+0000 7f9c12050640 1 -- 172.21.15.80:0/1256828433 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c06eaa0 con 0x7f9c0c06ca40 2024-04-16T15:37:15.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c12050640 1 --2- 172.21.15.80:0/1256828433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c168400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097a0 tx=0x7f9c0402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d9b74ff9beae41 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c1084d640 1 -- 172.21.15.80:0/1256828433 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04035020 con 0x7f9c0c06ca40 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c1084d640 1 -- 172.21.15.80:0/1256828433 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c04031830 con 0x7f9c0c06ca40 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c1084d640 1 -- 172.21.15.80:0/1256828433 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04031c00 con 0x7f9c0c06ca40 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1256828433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 msgr2=0x7f9c0c168400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1256828433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c168400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097a0 tx=0x7f9c0402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1256828433 shutdown_connections 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1256828433 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c168400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.843 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1256828433 >> v2:172.21.15.87:3300/0 conn(0x7f9c0c15f940 0x7f9c0c06c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.839+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1256828433 >> 172.21.15.80:0/1256828433 conn(0x7f9c0c0d0c50 msgr2=0x7f9c0c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.840+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1256828433 shutdown_connections 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.840+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1256828433 wait complete. 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 Processor -- start 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 -- start start 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c0c15f940 0x7f9c0c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c06ce90 con 0x7f9c0c15ee50 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c06f060 con 0x7f9c0c15f940 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.841+0000 7f9c13ab3640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c06d010 con 0x7f9c0c06ca40 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38124/0 (socket says 172.21.15.80:38124) 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 -- 172.21.15.80:0/1705161646 learned_addr learned my addr 172.21.15.80:0/1705161646 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1184f640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c12050640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c0c15f940 0x7f9c0c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 -- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 msgr2=0x7f9c0c1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 -- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c0c15f940 msgr2=0x7f9c0c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c0c15f940 0x7f9c0c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 -- 172.21.15.80:0/1705161646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c15b210 con 0x7f9c0c15ee50 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c1104e640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00e8a0 tx=0x7f9bfc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc017070 con 0x7f9c0c15ee50 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00c8e0 con 0x7f9c0c15ee50 2024-04-16T15:37:15.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c1f7880 con 0x7f9c0c15ee50 2024-04-16T15:37:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00ccd0 con 0x7f9c0c15ee50 2024-04-16T15:37:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.842+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1f7e40 con 0x7f9c0c15ee50 2024-04-16T15:37:15.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.843+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c069150 con 0x7f9c0c15ee50 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.844+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bfc01a070 con 0x7f9c0c15ee50 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.844+0000 7f9c027fc640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 0x7f9bf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.844+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9bfc08b9b0 con 0x7f9c0c15ee50 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.844+0000 7f9c1184f640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 0x7f9bf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.845+0000 7f9c1184f640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 0x7f9bf006edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9c080012e0 tx=0x7f9c08001a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:15.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:15.848+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9bfc059690 con 0x7f9c0c15ee50 2024-04-16T15:37:16.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.025+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9c0c0d13b0 con 0x7f9bf006c8f0 2024-04-16T15:37:16.025 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.025+0000 7f9c027fc640 1 -- 172.21.15.80:0/1705161646 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c0c0d13b0 con 0x7f9bf006c8f0 2024-04-16T15:37:16.025 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 msgr2=0x7f9bf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 0x7f9bf006edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9c080012e0 tx=0x7f9c08001a30 comp rx=0 tx=0).stop 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 msgr2=0x7f9c0c1f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00e8a0 tx=0x7f9bfc00ed60 comp rx=0 tx=0).stop 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 shutdown_connections 2024-04-16T15:37:16.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c0c15f940 0x7f9c0c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9c0c15ee50 0x7f9c0c1f4240 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f9bf006c8f0 0x7f9bf006edb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 --2- 172.21.15.80:0/1705161646 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f9c0c06ca40 0x7f9c0c1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 >> 172.21.15.80:0/1705161646 conn(0x7f9c0c0d0c50 msgr2=0x7f9c0c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 shutdown_connections 2024-04-16T15:37:16.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.027+0000 7f9c13ab3640 1 -- 172.21.15.80:0/1705161646 wait complete. 2024-04-16T15:37:16.038 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T15:37:16.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:16.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.145+0000 7fe75f62a640 1 Processor -- start 2024-04-16T15:37:16.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.146+0000 7fe75f62a640 1 -- start start 2024-04-16T15:37:16.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.146+0000 7fe75f62a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe75815ef50 0x7fe7580b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.147 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.146+0000 7fe75f62a640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7580cd260 con 0x7fe758158750 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.146+0000 7fe75f62a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7580cf640 con 0x7fe75815f500 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.146+0000 7fe75f62a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fe7580cf920 con 0x7fe75815ef50 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75dbc7640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fe75815ef50 0x7fe7580b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75d3c6640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fe758158750 0x7fe75815e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53106/0 (socket says 172.21.15.80:53106) 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75d3c6640 1 -- 172.21.15.80:0/1669247777 learned_addr learned my addr 172.21.15.80:0/1669247777 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75dbc7640 1 -- 172.21.15.80:0/1669247777 >> v1:172.21.15.87:6789/0 conn(0x7fe75815f500 legacy=0x7fe7580b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75dbc7640 1 -- 172.21.15.80:0/1669247777 >> v1:172.21.15.80:6789/0 conn(0x7fe758158750 legacy=0x7fe75815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe75dbc7640 1 -- 172.21.15.80:0/1669247777 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7580cd540 con 0x7fe75815ef50 2024-04-16T15:37:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.147+0000 7fe74ffff640 1 -- 172.21.15.80:0/1669247777 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339741962 0 0) 0x7fe7580cd260 con 0x7fe758158750 2024-04-16T15:37:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75dbc7640 1 --2- 172.21.15.80:0/1669247777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe75815ef50 0x7fe7580b5380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe75000aea0 tx=0x7fe75002ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbef0ba0260f4bdc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe74ffff640 1 -- 172.21.15.80:0/1669247777 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75002da30 con 0x7fe75815ef50 2024-04-16T15:37:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe74ffff640 1 -- 172.21.15.80:0/1669247777 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75002dbd0 con 0x7fe75815ef50 2024-04-16T15:37:16.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe74ffff640 1 -- 172.21.15.80:0/1669247777 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750008440 con 0x7fe75815ef50 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 -- 172.21.15.80:0/1669247777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe75815ef50 msgr2=0x7fe7580b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 --2- 172.21.15.80:0/1669247777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe75815ef50 0x7fe7580b5380 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe75000aea0 tx=0x7fe75002ce90 comp rx=0 tx=0).stop 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 -- 172.21.15.80:0/1669247777 shutdown_connections 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 --2- 172.21.15.80:0/1669247777 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe75815ef50 0x7fe7580b5380 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 -- 172.21.15.80:0/1669247777 >> 172.21.15.80:0/1669247777 conn(0x7fe75806b9a0 msgr2=0x7fe75806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 -- 172.21.15.80:0/1669247777 shutdown_connections 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.148+0000 7fe75f62a640 1 -- 172.21.15.80:0/1669247777 wait complete. 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 Processor -- start 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 -- start start 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 0x7fe75814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe75815ef50 0x7fe758152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe75815f500 0x7fe7581538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580cd000 con 0x7fe758158750 2024-04-16T15:37:16.154 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7580cce80 con 0x7fe75815ef50 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75f62a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fe75806de60 con 0x7fe75815f500 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75d3c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 0x7fe75814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75d3c6640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 0x7fe75814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38132/0 (socket says 172.21.15.80:38132) 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.150+0000 7fe75d3c6640 1 -- 172.21.15.80:0/1733824085 learned_addr learned my addr 172.21.15.80:0/1733824085 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75cbc5640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe75815ef50 0x7fe758152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75dbc7640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe75815f500 0x7fe7581538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 -- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe75815f500 msgr2=0x7fe7581538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe75815f500 0x7fe7581538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 -- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe75815ef50 msgr2=0x7fe758152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe75815ef50 0x7fe758152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7581523b0 con 0x7fe758158750 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75dbc7640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fe75815f500 0x7fe7581538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75d3c6640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 0x7fe75814dfd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e960 tx=0x7fe75400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540072e0 con 0x7fe758158750 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754016020 con 0x7fe758158750 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe758152690 con 0x7fe758158750 2024-04-16T15:37:16.156 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75400c850 con 0x7fe758158750 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.151+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe758157630 con 0x7fe758158750 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.152+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe758068a40 con 0x7fe758158750 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe75400c9f0 con 0x7fe758158750 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe73c06c8f0 0x7fe73c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe75408e320 con 0x7fe758158750 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe75cbc5640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe73c06c8f0 0x7fe73c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fe73c075160 0x7fe73c0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.157 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe73c077c70 con 0x7fe73c075160 2024-04-16T15:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe754095050 con 0x7fe758158750 2024-04-16T15:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe75dbc7640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fe73c075160 0x7fe73c0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.153+0000 7fe75cbc5640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe73c06c8f0 0x7fe73c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.154+0000 7fe75dbc7640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fe73c075160 0x7fe73c0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.154+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== osd.2 v2:172.21.15.80:6808/2167961264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe73c077c70 con 0x7fe73c075160 2024-04-16T15:37:16.166 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.167+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 --> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7580730f0 con 0x7fe73c075160 2024-04-16T15:37:16.167 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.167+0000 7fe74dffb640 1 -- 172.21.15.80:0/1733824085 <== osd.2 v2:172.21.15.80:6808/2167961264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7580730f0 con 0x7fe73c075160 2024-04-16T15:37:16.167 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:16.167 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:16.167 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:16.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fe73c075160 msgr2=0x7fe73c0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6808/2167961264,v1:172.21.15.80:6809/2167961264] conn(0x7fe73c075160 0x7fe73c0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe73c06c8f0 msgr2=0x7fe73c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fe73c06c8f0 0x7fe73c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe748006fd0 tx=0x7fe748008040 comp rx=0 tx=0).stop 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 msgr2=0x7fe75814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 --2- 172.21.15.80:0/1733824085 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe758158750 0x7fe75814dfd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e960 tx=0x7fe75400ee20 comp rx=0 tx=0).stop 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75dbc7640 1 -- 172.21.15.80:0/1733824085 reap_dead start 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 shutdown_connections 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 >> 172.21.15.80:0/1733824085 conn(0x7fe75806b9a0 msgr2=0x7fe75815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.169 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 shutdown_connections 2024-04-16T15:37:16.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.168+0000 7fe75f62a640 1 -- 172.21.15.80:0/1733824085 wait complete. 2024-04-16T15:37:16.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T15:37:16.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.283+0000 7f5608dd4640 1 Processor -- start 2024-04-16T15:37:16.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.283+0000 7f5608dd4640 1 -- start start 2024-04-16T15:37:16.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5608dd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 0x7f56040cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5608dd4640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560415bd50 con 0x7f56040cd820 2024-04-16T15:37:16.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5608dd4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560415c030 con 0x7f5604145020 2024-04-16T15:37:16.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5608dd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f560415c310 con 0x7f560406f650 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5602d9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f56040cd820 0x7f560415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53116/0 (socket says 172.21.15.80:53116) 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5602d9d640 1 -- 172.21.15.80:0/2850798912 learned_addr learned my addr 172.21.15.80:0/2850798912 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.284+0000 7f5601d9b640 1 --2- 172.21.15.80:0/2850798912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 0x7f56040cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507476964 0 0) 0x7f560415bd50 con 0x7f56040cd820 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec003520 con 0x7f56040cd820 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346114982 0 0) 0x7f560415c030 con 0x7f5604145020 2024-04-16T15:37:16.293 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560415bd50 con 0x7f5604145020 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f5601d9b640 1 -- 172.21.15.80:0/2850798912 >> v1:172.21.15.87:6789/0 conn(0x7f5604145020 legacy=0x7f560406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f5601d9b640 1 -- 172.21.15.80:0/2850798912 >> v1:172.21.15.80:6789/0 conn(0x7f56040cd820 legacy=0x7f560415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.285+0000 7f5601d9b640 1 -- 172.21.15.80:0/2850798912 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560415c5f0 con 0x7f560406f650 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5601d9b640 1 --2- 172.21.15.80:0/2850798912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 0x7f56040cd2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097d0 tx=0x7f55f802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1183403639cc8539 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8035020 con 0x7f560406f650 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f8031890 con 0x7f560406f650 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f560159a640 1 -- 172.21.15.80:0/2850798912 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8031c60 con 0x7f560406f650 2024-04-16T15:37:16.294 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 -- 172.21.15.80:0/2850798912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 msgr2=0x7f56040cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 --2- 172.21.15.80:0/2850798912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 0x7f56040cd2e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097d0 tx=0x7f55f802b930 comp rx=0 tx=0).stop 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 -- 172.21.15.80:0/2850798912 shutdown_connections 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 --2- 172.21.15.80:0/2850798912 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f560406f650 0x7f56040cd2e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 -- 172.21.15.80:0/2850798912 >> 172.21.15.80:0/2850798912 conn(0x7f5604067d90 msgr2=0x7f560406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 -- 172.21.15.80:0/2850798912 shutdown_connections 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.286+0000 7f5608dd4640 1 -- 172.21.15.80:0/2850798912 wait complete. 2024-04-16T15:37:16.295 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 Processor -- start 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 -- start start 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56040cd820 0x7f560413afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604145020 0x7f560406de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f56040b3f90 con 0x7f560406f650 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f56040b3e10 con 0x7f5604145020 2024-04-16T15:37:16.296 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f5608dd4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f560415f940 con 0x7f56040cd820 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.288+0000 7f560259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38134/0 (socket says 172.21.15.80:38134) 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 -- 172.21.15.80:0/270095297 learned_addr learned my addr 172.21.15.80:0/270095297 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f5602d9d640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604145020 0x7f560406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f5601d9b640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56040cd820 0x7f560413afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 -- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56040cd820 msgr2=0x7f560413afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.297 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56040cd820 0x7f560413afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 -- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604145020 msgr2=0x7f560406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604145020 0x7f560406de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 -- 172.21.15.80:0/270095297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560415b3c0 con 0x7f560406f650 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f560259c640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c7d0 tx=0x7f55f400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4003b70 con 0x7f560406f650 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f4003d30 con 0x7f560406f650 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560413df30 con 0x7f560406f650 2024-04-16T15:37:16.298 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f400aa30 con 0x7f560406f650 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.289+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560413e4f0 con 0x7f560406f650 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.290+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5604068a40 con 0x7f560406f650 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.291+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55f400abd0 con 0x7f560406f650 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.291+0000 7f55f2ffd640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 0x7f55e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.291+0000 7f5601d9b640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 0x7f55e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.291+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f55f408bc40 con 0x7f560406f650 2024-04-16T15:37:16.299 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.292+0000 7f5601d9b640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 0x7f55e406edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55f8036000 tx=0x7f55f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.300 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.296+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f560415b3c0 con 0x7f560406f650 2024-04-16T15:37:16.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.473+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f56040753c0 con 0x7f55e406c8f0 2024-04-16T15:37:16.473 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.473+0000 7f55f2ffd640 1 -- 172.21.15.80:0/270095297 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f56040753c0 con 0x7f55e406c8f0 2024-04-16T15:37:16.473 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 msgr2=0x7f55e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 0x7f55e406edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55f8036000 tx=0x7f55f8008030 comp rx=0 tx=0).stop 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 msgr2=0x7f5604158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c7d0 tx=0x7f55f400cc90 comp rx=0 tx=0).stop 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 shutdown_connections 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5604145020 0x7f560406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f55e406c8f0 0x7f55e406edb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f56040cd820 0x7f560413afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 --2- 172.21.15.80:0/270095297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f560406f650 0x7f5604158bf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 >> 172.21.15.80:0/270095297 conn(0x7f5604067d90 msgr2=0x7f56040b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 shutdown_connections 2024-04-16T15:37:16.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.476+0000 7f5608dd4640 1 -- 172.21.15.80:0/270095297 wait complete. 2024-04-16T15:37:16.486 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T15:37:16.486 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:16.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.593+0000 7eff0c263640 1 Processor -- start 2024-04-16T15:37:16.640 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.594+0000 7eff0c263640 1 -- start start 2024-04-16T15:37:16.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0c263640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff04073490 0x7eff0406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0c263640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0406c2c0 con 0x7eff040d1ba0 2024-04-16T15:37:16.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0c263640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff040b2870 con 0x7eff0406b9a0 2024-04-16T15:37:16.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0c263640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7eff040d1710 con 0x7eff04073490 2024-04-16T15:37:16.649 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff097fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7eff04073490 0x7eff0406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0a800640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7eff040d1ba0 0x7eff0415de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53118/0 (socket says 172.21.15.80:53118) 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff0a800640 1 -- 172.21.15.80:0/825835215 learned_addr learned my addr 172.21.15.80:0/825835215 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff097fe640 1 -- 172.21.15.80:0/825835215 >> v1:172.21.15.87:6789/0 conn(0x7eff0406b9a0 legacy=0x7eff0415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff097fe640 1 -- 172.21.15.80:0/825835215 >> v1:172.21.15.80:6789/0 conn(0x7eff040d1ba0 legacy=0x7eff0415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff097fe640 1 -- 172.21.15.80:0/825835215 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040b2b50 con 0x7eff04073490 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.595+0000 7eff08ffd640 1 -- 172.21.15.80:0/825835215 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211848854 0 0) 0x7eff0406c2c0 con 0x7eff040d1ba0 2024-04-16T15:37:16.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.596+0000 7eff097fe640 1 --2- 172.21.15.80:0/825835215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff04073490 0x7eff0406bd80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efef80097a0 tx=0x7efef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00ba26137774465 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.596+0000 7eff08ffd640 1 -- 172.21.15.80:0/825835215 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8035020 con 0x7eff04073490 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.596+0000 7eff08ffd640 1 -- 172.21.15.80:0/825835215 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef8031830 con 0x7eff04073490 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.596+0000 7eff08ffd640 1 -- 172.21.15.80:0/825835215 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8031c00 con 0x7eff04073490 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 -- 172.21.15.80:0/825835215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff04073490 msgr2=0x7eff0406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 --2- 172.21.15.80:0/825835215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff04073490 0x7eff0406bd80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efef80097a0 tx=0x7efef802b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 -- 172.21.15.80:0/825835215 shutdown_connections 2024-04-16T15:37:16.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 --2- 172.21.15.80:0/825835215 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff04073490 0x7eff0406bd80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 -- 172.21.15.80:0/825835215 >> 172.21.15.80:0/825835215 conn(0x7eff040b6b30 msgr2=0x7eff0409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 -- 172.21.15.80:0/825835215 shutdown_connections 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.597+0000 7eff0c263640 1 -- 172.21.15.80:0/825835215 wait complete. 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.598+0000 7eff0c263640 1 Processor -- start 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.598+0000 7eff0c263640 1 -- start start 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0406b9a0 0x7eff04143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.652 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff04073490 0x7eff041515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 0x7eff0414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7eff040b2e30 con 0x7eff040d1ba0 2024-04-16T15:37:16.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7eff0415a610 con 0x7eff04073490 2024-04-16T15:37:16.653 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7eff040d2030 con 0x7eff0406b9a0 2024-04-16T15:37:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 0x7eff0414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 0x7eff0414f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38156/0 (socket says 172.21.15.80:38156) 2024-04-16T15:37:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 -- 172.21.15.80:0/1905269717 learned_addr learned my addr 172.21.15.80:0/1905269717 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff097fe640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff04073490 0x7eff041515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 -- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0406b9a0 msgr2=0x7eff04143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff09fff640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0406b9a0 0x7eff04143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7eff0406b9a0 0x7eff04143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 -- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff04073490 msgr2=0x7eff041515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff04073490 0x7eff041515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0415baa0 con 0x7eff040d1ba0 2024-04-16T15:37:16.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff097fe640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff04073490 0x7eff041515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0a800640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 0x7eff0414f3a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c440 tx=0x7efefc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0074e0 con 0x7eff040d1ba0 2024-04-16T15:37:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efefc0047e0 con 0x7eff040d1ba0 2024-04-16T15:37:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0415c840 con 0x7eff040d1ba0 2024-04-16T15:37:16.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc004bd0 con 0x7eff040d1ba0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.599+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0415ce00 con 0x7eff040d1ba0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.600+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff0415d1e0 con 0x7eff040d1ba0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efefc011070 con 0x7eff040d1ba0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efef006c920 0x7efef006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7efefc08b880 con 0x7eff040d1ba0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff09fff640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efef006c920 0x7efef006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.657 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7efef0075190 0x7efef00775d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efefc01ce80 con 0x7efef0075190 2024-04-16T15:37:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.601+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efefc0902c0 con 0x7eff040d1ba0 2024-04-16T15:37:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.602+0000 7eff097fe640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7efef0075190 0x7efef00775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.658 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.602+0000 7eff09fff640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efef006c920 0x7efef006ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efef4007fd0 tx=0x7efef4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.602+0000 7eff097fe640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7efef0075190 0x7efef00775d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.602+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== osd.3 v2:172.21.15.80:6811/1569227451 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efefc01ce80 con 0x7efef0075190 2024-04-16T15:37:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.615+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 --> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff04068a40 con 0x7efef0075190 2024-04-16T15:37:16.659 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff027fc640 1 -- 172.21.15.80:0/1905269717 <== osd.3 v2:172.21.15.80:6811/1569227451 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff04068a40 con 0x7efef0075190 2024-04-16T15:37:16.659 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:16.660 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:16.660 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7efef0075190 msgr2=0x7efef00775d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6811/1569227451,v1:172.21.15.80:6813/1569227451] conn(0x7efef0075190 0x7efef00775d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efef006c920 msgr2=0x7efef006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7efef006c920 0x7efef006ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efef4007fd0 tx=0x7efef4009040 comp rx=0 tx=0).stop 2024-04-16T15:37:16.662 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 msgr2=0x7eff0414f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 --2- 172.21.15.80:0/1905269717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7eff040d1ba0 0x7eff0414f3a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c440 tx=0x7efefc00c900 comp rx=0 tx=0).stop 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0a800640 1 -- 172.21.15.80:0/1905269717 reap_dead start 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 shutdown_connections 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 >> 172.21.15.80:0/1905269717 conn(0x7eff040b6b30 msgr2=0x7eff040b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 shutdown_connections 2024-04-16T15:37:16.663 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.616+0000 7eff0c263640 1 -- 172.21.15.80:0/1905269717 wait complete. 2024-04-16T15:37:16.664 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T15:37:16.768 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.769+0000 7f6a46260640 1 Processor -- start 2024-04-16T15:37:16.769 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.769+0000 7f6a46260640 1 -- start start 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a46260640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a40161f20 0x7f6a400cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a46260640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400b74e0 0x7f6a400cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a46260640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a400cfd90 con 0x7f6a400d0ff0 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a46260640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f6a400d0050 con 0x7f6a40161f20 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a46260640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6a400d0330 con 0x7f6a400b74e0 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3f7fe640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f6a40161f20 0x7f6a400cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3ffff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f6a400d0ff0 0x7f6a400d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53122/0 (socket says 172.21.15.80:53122) 2024-04-16T15:37:16.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3ffff640 1 -- 172.21.15.80:0/641463996 learned_addr learned my addr 172.21.15.80:0/641463996 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3effd640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400b74e0 0x7f6a400cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/641463996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400b74e0 msgr2=0x7f6a400cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3f7fe640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400b74e0 0x7f6a400cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/641463996 >> v1:172.21.15.80:6789/0 conn(0x7f6a400d0ff0 legacy=0x7f6a400d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/641463996 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a400d0610 con 0x7f6a40161f20 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.770+0000 7f6a3e7fc640 1 -- 172.21.15.80:0/641463996 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465740340 0 0) 0x7f6a400cfd90 con 0x7f6a400d0ff0 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.771+0000 7f6a3f7fe640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a40161f20 0x7f6a400cf230 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a300097a0 tx=0x7f6a3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec70a3e1fedb9b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.771+0000 7f6a3e7fc640 1 -- 172.21.15.80:0/641463996 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30035020 con 0x7f6a40161f20 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.771+0000 7f6a3e7fc640 1 -- 172.21.15.80:0/641463996 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a30031830 con 0x7f6a40161f20 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.771+0000 7f6a3e7fc640 1 -- 172.21.15.80:0/641463996 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a30031c00 con 0x7f6a40161f20 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 -- 172.21.15.80:0/641463996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a40161f20 msgr2=0x7f6a400cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a40161f20 0x7f6a400cf230 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a300097a0 tx=0x7f6a3002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 -- 172.21.15.80:0/641463996 shutdown_connections 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400b74e0 0x7f6a400cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 --2- 172.21.15.80:0/641463996 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a40161f20 0x7f6a400cf230 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 -- 172.21.15.80:0/641463996 >> 172.21.15.80:0/641463996 conn(0x7f6a4008c000 msgr2=0x7f6a400d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 -- 172.21.15.80:0/641463996 shutdown_connections 2024-04-16T15:37:16.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.772+0000 7f6a46260640 1 -- 172.21.15.80:0/641463996 wait complete. 2024-04-16T15:37:16.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.773+0000 7f6a46260640 1 Processor -- start 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.773+0000 7f6a46260640 1 -- start start 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400d0ff0 0x7f6a4015aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 0x7f6a4015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400d1480 con 0x7f6a400b74e0 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6a400b5730 con 0x7f6a40161f20 2024-04-16T15:37:16.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a46260640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f6a400d1600 con 0x7f6a400d0ff0 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38172/0 (socket says 172.21.15.80:38172) 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/85928716 learned_addr learned my addr 172.21.15.80:0/85928716 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3effd640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400d0ff0 0x7f6a4015aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3ffff640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 0x7f6a4015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400d0ff0 msgr2=0x7f6a4015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400d0ff0 0x7f6a4015aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 msgr2=0x7f6a4015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 0x7f6a4015e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 -- 172.21.15.80:0/85928716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a40157470 con 0x7f6a400b74e0 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3ffff640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 0x7f6a4015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.774+0000 7f6a3f7fe640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a300097a0 tx=0x7f6a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.775+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3003a9f0 con 0x7f6a400b74e0 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.775+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3003ab90 con 0x7f6a400b74e0 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.775+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a40157750 con 0x7f6a400b74e0 2024-04-16T15:37:16.781 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.775+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a300443f0 con 0x7f6a400b74e0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.775+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4015e260 con 0x7f6a400b74e0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.776+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40157c70 con 0x7f6a400b74e0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.776+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a3004b060 con 0x7f6a400b74e0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.777+0000 7f6a27fff640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.777+0000 7f6a3effd640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.777+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6a300ad880 con 0x7f6a400b74e0 2024-04-16T15:37:16.782 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.777+0000 7f6a3effd640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a401f8260 tx=0x7f6a34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:16.783 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.781+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a3003f070 con 0x7f6a400b74e0 2024-04-16T15:37:16.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.958+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6a40068a40 con 0x7f6a2c06c8f0 2024-04-16T15:37:16.958 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.959+0000 7f6a27fff640 1 -- 172.21.15.80:0/85928716 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6a40068a40 con 0x7f6a2c06c8f0 2024-04-16T15:37:16.958 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T15:37:16.960 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 msgr2=0x7f6a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a401f8260 tx=0x7f6a34008040 comp rx=0 tx=0).stop 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 msgr2=0x7f6a401531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a300097a0 tx=0x7f6a300046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 shutdown_connections 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a40161f20 0x7f6a4015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f6a2c06c8f0 0x7f6a2c06edb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6a400d0ff0 0x7f6a4015aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 --2- 172.21.15.80:0/85928716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6a400b74e0 0x7f6a401531d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 >> 172.21.15.80:0/85928716 conn(0x7f6a4008c000 msgr2=0x7f6a400b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 shutdown_connections 2024-04-16T15:37:16.962 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:16.961+0000 7f6a46260640 1 -- 172.21.15.80:0/85928716 wait complete. 2024-04-16T15:37:16.971 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T15:37:16.971 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:17.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.079+0000 7f694ebf4640 1 Processor -- start 2024-04-16T15:37:17.078 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.079+0000 7f694ebf4640 1 -- start start 2024-04-16T15:37:17.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694ebf4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f694815f500 0x7f69480b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694ebf4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f694815ef50 0x7f69480b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.080 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694ebf4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480cd260 con 0x7f6948158750 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694ebf4640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f69480cf640 con 0x7f694815f500 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694ebf4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f69480cf920 con 0x7f694815ef50 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f694815f500 0x7f69480b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f694815f500 0x7f69480b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38186/0 (socket says 172.21.15.80:38186) 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 -- 172.21.15.80:0/588244548 learned_addr learned my addr 172.21.15.80:0/588244548 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f694d191640 1 --2- 172.21.15.80:0/588244548 >> v2:172.21.15.87:3300/0 conn(0x7f694815ef50 0x7f69480b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 -- 172.21.15.80:0/588244548 >> v2:172.21.15.87:3300/0 conn(0x7f694815ef50 msgr2=0x7f69480b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:17.081 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 --2- 172.21.15.80:0/588244548 >> v2:172.21.15.87:3300/0 conn(0x7f694815ef50 0x7f69480b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 -- 172.21.15.80:0/588244548 >> v1:172.21.15.87:6789/0 conn(0x7f6948158750 legacy=0x7f694815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.080+0000 7f6947fff640 1 -- 172.21.15.80:0/588244548 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480cd540 con 0x7f694815f500 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f6947fff640 1 --2- 172.21.15.80:0/588244548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815f500 0x7f69480b5380 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f69480d0390 tx=0x7f693402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5b4aeed3bfbbb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f69477fe640 1 -- 172.21.15.80:0/588244548 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693402e070 con 0x7f694815f500 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f69477fe640 1 -- 172.21.15.80:0/588244548 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934037070 con 0x7f694815f500 2024-04-16T15:37:17.082 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f69477fe640 1 -- 172.21.15.80:0/588244548 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934031a00 con 0x7f694815f500 2024-04-16T15:37:17.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f694ebf4640 1 -- 172.21.15.80:0/588244548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815f500 msgr2=0x7f69480b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.081+0000 7f694ebf4640 1 --2- 172.21.15.80:0/588244548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815f500 0x7f69480b5380 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f69480d0390 tx=0x7f693402b880 comp rx=0 tx=0).stop 2024-04-16T15:37:17.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 -- 172.21.15.80:0/588244548 shutdown_connections 2024-04-16T15:37:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 --2- 172.21.15.80:0/588244548 >> v2:172.21.15.87:3300/0 conn(0x7f694815ef50 0x7f69480b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 --2- 172.21.15.80:0/588244548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815f500 0x7f69480b5380 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 -- 172.21.15.80:0/588244548 >> 172.21.15.80:0/588244548 conn(0x7f694806b9a0 msgr2=0x7f694806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 -- 172.21.15.80:0/588244548 shutdown_connections 2024-04-16T15:37:17.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.082+0000 7f694ebf4640 1 -- 172.21.15.80:0/588244548 wait complete. 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.083+0000 7f694ebf4640 1 Processor -- start 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.083+0000 7f694ebf4640 1 -- start start 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6948158750 0x7f69481444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 0x7f69481e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f694815f500 0x7f69481f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f69480cd000 con 0x7f694815ef50 2024-04-16T15:37:17.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f69480cce80 con 0x7f694815f500 2024-04-16T15:37:17.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f694806de60 con 0x7f6948158750 2024-04-16T15:37:17.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 0x7f69481e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 0x7f69481e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38190/0 (socket says 172.21.15.80:38190) 2024-04-16T15:37:17.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 -- 172.21.15.80:0/3671769793 learned_addr learned my addr 172.21.15.80:0/3671769793 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694c990640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6948158750 0x7f69481444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694d191640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f694815f500 0x7f69481f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 -- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6948158750 msgr2=0x7f69481444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6948158750 0x7f69481444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 -- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f694815f500 msgr2=0x7f69481f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f694815f500 0x7f69481f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480a9600 con 0x7f694815ef50 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694c990640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f6948158750 0x7f69481444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694d191640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f694815f500 0x7f69481f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f6947fff640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 0x7f69481e7770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f693402b8c0 tx=0x7f69340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032670 con 0x7f694815ef50 2024-04-16T15:37:17.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934032830 con 0x7f694815ef50 2024-04-16T15:37:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69480a98e0 con 0x7f694815ef50 2024-04-16T15:37:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032c20 con 0x7f694815ef50 2024-04-16T15:37:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.084+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69480a9ea0 con 0x7f694815ef50 2024-04-16T15:37:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.085+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6948068a40 con 0x7f694815ef50 2024-04-16T15:37:17.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.086+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f693404c060 con 0x7f694815ef50 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.086+0000 7f69457fa640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f692c06c8f0 0x7f692c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.086+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f69340ad690 con 0x7f694815ef50 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.086+0000 7f694c990640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f692c06c8f0 0x7f692c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.086+0000 7f69457fa640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7f692c075160 0x7f692c0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.087+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6934033e90 con 0x7f692c075160 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.087+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f69340b4050 con 0x7f694815ef50 2024-04-16T15:37:17.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.087+0000 7f694c990640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f692c06c8f0 0x7f692c06edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69480cd8c0 tx=0x7f693c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.087+0000 7f694d191640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7f692c075160 0x7f692c0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.087+0000 7f694d191640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7f692c075160 0x7f692c0775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.088+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== osd.4 v2:172.21.15.87:6800/1581459636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6934033e90 con 0x7f692c075160 2024-04-16T15:37:17.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.101+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 --> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69480af9f0 con 0x7f692c075160 2024-04-16T15:37:17.101 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.101+0000 7f69457fa640 1 -- 172.21.15.80:0/3671769793 <== osd.4 v2:172.21.15.87:6800/1581459636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69480af9f0 con 0x7f692c075160 2024-04-16T15:37:17.101 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:17.101 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:17.102 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:17.102 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7f692c075160 msgr2=0x7f692c0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.87:6800/1581459636,v1:172.21.15.87:6801/1581459636] conn(0x7f692c075160 0x7f692c0775a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f692c06c8f0 msgr2=0x7f692c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f692c06c8f0 0x7f692c06edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69480cd8c0 tx=0x7f693c009040 comp rx=0 tx=0).stop 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 msgr2=0x7f69481e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 --2- 172.21.15.80:0/3671769793 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f694815ef50 0x7f69481e7770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f693402b8c0 tx=0x7f69340046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694d191640 1 -- 172.21.15.80:0/3671769793 reap_dead start 2024-04-16T15:37:17.103 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 shutdown_connections 2024-04-16T15:37:17.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 >> 172.21.15.80:0/3671769793 conn(0x7f694806b9a0 msgr2=0x7f694806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 shutdown_connections 2024-04-16T15:37:17.104 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.102+0000 7f694ebf4640 1 -- 172.21.15.80:0/3671769793 wait complete. 2024-04-16T15:37:17.112 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T15:37:17.177 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:17.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:17.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.219+0000 7f59f6566640 1 Processor -- start 2024-04-16T15:37:17.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.219+0000 7f59f6566640 1 -- start start 2024-04-16T15:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.219+0000 7f59f6566640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f00d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f6566640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59f00d1530 0x7f59f00d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f6566640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f00cfd90 con 0x7f59f0161f20 2024-04-16T15:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f6566640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f59f00d0050 con 0x7f59f00d1530 2024-04-16T15:37:17.221 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f6566640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00d0330 con 0x7f59f00b74e0 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f4b03640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f59f00d1530 0x7f59f00d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59effff640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f59f0161f20 0x7f59f00cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53132/0 (socket says 172.21.15.80:53132) 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59effff640 1 -- 172.21.15.80:0/1339981232 learned_addr learned my addr 172.21.15.80:0/1339981232 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f4b03640 1 -- 172.21.15.80:0/1339981232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 msgr2=0x7f59f00d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f4b03640 1 --2- 172.21.15.80:0/1339981232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f00d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f4b03640 1 -- 172.21.15.80:0/1339981232 >> v1:172.21.15.80:6789/0 conn(0x7f59f0161f20 legacy=0x7f59f00cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59eeffd640 1 -- 172.21.15.80:0/1339981232 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561281361 0 0) 0x7f59f00cfd90 con 0x7f59f0161f20 2024-04-16T15:37:17.222 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.220+0000 7f59f4b03640 1 -- 172.21.15.80:0/1339981232 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00d0610 con 0x7f59f00d1530 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f4b03640 1 --2- 172.21.15.80:0/1339981232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f00d1530 0x7f59f00d27e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009d90 tx=0x7f59e802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292f519d9e71dd92 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59eeffd640 1 -- 172.21.15.80:0/1339981232 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8039070 con 0x7f59f00d1530 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59eeffd640 1 -- 172.21.15.80:0/1339981232 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e802cc50 con 0x7f59f00d1530 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59eeffd640 1 -- 172.21.15.80:0/1339981232 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8034440 con 0x7f59f00d1530 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 -- 172.21.15.80:0/1339981232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f00d1530 msgr2=0x7f59f00d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 --2- 172.21.15.80:0/1339981232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f00d1530 0x7f59f00d27e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009d90 tx=0x7f59e802bea0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 -- 172.21.15.80:0/1339981232 shutdown_connections 2024-04-16T15:37:17.223 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 --2- 172.21.15.80:0/1339981232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f00d1530 0x7f59f00d27e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 --2- 172.21.15.80:0/1339981232 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f00d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 -- 172.21.15.80:0/1339981232 >> 172.21.15.80:0/1339981232 conn(0x7f59f008c000 msgr2=0x7f59f00d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 -- 172.21.15.80:0/1339981232 shutdown_connections 2024-04-16T15:37:17.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.221+0000 7f59f6566640 1 -- 172.21.15.80:0/1339981232 wait complete. 2024-04-16T15:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 Processor -- start 2024-04-16T15:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 -- start start 2024-04-16T15:37:17.227 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59f00d1530 0x7f59f00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00cf940 con 0x7f59f0161f20 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00b5730 con 0x7f59f00d1530 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.223+0000 7f59f6566640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00cfac0 con 0x7f59f00b74e0 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38206/0 (socket says 172.21.15.80:38206) 2024-04-16T15:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 -- 172.21.15.80:0/2591105970 learned_addr learned my addr 172.21.15.80:0/2591105970 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59effff640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59ef7fe640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59f00d1530 0x7f59f00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 -- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 msgr2=0x7f59f0153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f0153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 -- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59f00d1530 msgr2=0x7f59f00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59f00d1530 0x7f59f00ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 -- 172.21.15.80:0/2591105970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f01539a0 con 0x7f59f0161f20 2024-04-16T15:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f4b03640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f59e8037040 tx=0x7f59e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8044030 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e802ca50 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8039040 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f015a420 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.224+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f015a9e0 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.225+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f0068a40 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.226+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59e8047070 con 0x7f59f0161f20 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.226+0000 7f59ecff9640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 0x7f59dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.226+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f59e80ae370 con 0x7f59f0161f20 2024-04-16T15:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.226+0000 7f59effff640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 0x7f59dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.227+0000 7f59effff640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 0x7f59dc06edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000f60 tx=0x7f59e0007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.232 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.230+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59e804e070 con 0x7f59f0161f20 2024-04-16T15:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.408+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f59f006e2a0 con 0x7f59dc06c8f0 2024-04-16T15:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.409+0000 7f59ecff9640 1 -- 172.21.15.80:0/2591105970 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59f006e2a0 con 0x7f59dc06c8f0 2024-04-16T15:37:17.408 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T15:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 msgr2=0x7f59dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 0x7f59dc06edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59e0000f60 tx=0x7f59e0007b50 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 msgr2=0x7f59f00ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f59e8037040 tx=0x7f59e8004a40 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 shutdown_connections 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.410+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f59f0161f20 0x7f59f00ce7f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59f00d1530 0x7f59f00ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f59dc06c8f0 0x7f59dc06edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 --2- 172.21.15.80:0/2591105970 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f59f00b74e0 0x7f59f0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.411 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 >> 172.21.15.80:0/2591105970 conn(0x7f59f008c000 msgr2=0x7f59f00d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 shutdown_connections 2024-04-16T15:37:17.412 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.411+0000 7f59f6566640 1 -- 172.21.15.80:0/2591105970 wait complete. 2024-04-16T15:37:17.421 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T15:37:17.421 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:17.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.529+0000 7f91b0ceb640 1 Processor -- start 2024-04-16T15:37:17.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.529+0000 7f91b0ceb640 1 -- start start 2024-04-16T15:37:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.529+0000 7f91b0ceb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.529+0000 7f91b0ceb640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91ac0b55c0 0x7f91ac0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.529+0000 7f91b0ceb640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac0b35d0 con 0x7f91ac15b780 2024-04-16T15:37:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91b0ceb640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac0b38b0 con 0x7f91ac0b55c0 2024-04-16T15:37:17.530 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91b0ceb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac0b3b90 con 0x7f91ac06f800 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91a3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91ac0b55c0 0x7f91ac0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3301/0 says I am v2:172.21.15.80:42208/0 (socket says 172.21.15.80:42208) 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91aa59c640 1 -- 172.21.15.80:0/518078370 learned_addr learned my addr 172.21.15.80:0/518078370 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91a3fff640 1 -- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 msgr2=0x7f91ac06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91a3fff640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91a3fff640 1 -- 172.21.15.80:0/518078370 >> v1:172.21.15.87:6789/0 conn(0x7f91ac15b780 legacy=0x7f91ac15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91a3fff640 1 -- 172.21.15.80:0/518078370 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0b3e70 con 0x7f91ac0b55c0 2024-04-16T15:37:17.531 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.530+0000 7f91aa59c640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T15:37:17.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.531+0000 7f91a3fff640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac0b55c0 0x7f91ac0cd6e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b6e3943752ac7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.531+0000 7f91a9d9b640 1 -- 172.21.15.80:0/518078370 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91940315a0 con 0x7f91ac0b55c0 2024-04-16T15:37:17.535 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.531+0000 7f91a9d9b640 1 -- 172.21.15.80:0/518078370 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9194037070 con 0x7f91ac0b55c0 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.531+0000 7f91a9d9b640 1 -- 172.21.15.80:0/518078370 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194031960 con 0x7f91ac0b55c0 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 -- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac0b55c0 msgr2=0x7f91ac0cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac0b55c0 0x7f91ac0cd6e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402b840 comp rx=0 tx=0).stop 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 -- 172.21.15.80:0/518078370 shutdown_connections 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac0b55c0 0x7f91ac0cd6e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/518078370 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac06f800 0x7f91ac06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.536 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 -- 172.21.15.80:0/518078370 >> 172.21.15.80:0/518078370 conn(0x7f91ac06b9a0 msgr2=0x7f91ac06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 -- 172.21.15.80:0/518078370 shutdown_connections 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.532+0000 7f91b0ceb640 1 -- 172.21.15.80:0/518078370 wait complete. 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.533+0000 7f91b0ceb640 1 Processor -- start 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.533+0000 7f91b0ceb640 1 -- start start 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac06f800 0x7f91ac14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac0b55c0 0x7f91ac1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 0x7f91ac154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.537 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0cdc20 con 0x7f91ac15b780 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac070120 con 0x7f91ac06f800 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91b0ceb640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac0cdda0 con 0x7f91ac0b55c0 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91aad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 0x7f91ac154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91aad9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 0x7f91ac154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38214/0 (socket says 172.21.15.80:38214) 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91aad9d640 1 -- 172.21.15.80:0/1901982762 learned_addr learned my addr 172.21.15.80:0/1901982762 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91aa59c640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac06f800 0x7f91ac14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.534+0000 7f91a3fff640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac0b55c0 0x7f91ac1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 -- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac0b55c0 msgr2=0x7f91ac1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f91ac0b55c0 0x7f91ac1450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 -- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac06f800 msgr2=0x7f91ac14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac06f800 0x7f91ac14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac15ab60 con 0x7f91ac15b780 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aa59c640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91ac06f800 0x7f91ac14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91aad9d640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 0x7f91ac154290 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c7d0 tx=0x7f91a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4003b70 con 0x7f91ac15b780 2024-04-16T15:37:17.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a4003d30 con 0x7f91ac15b780 2024-04-16T15:37:17.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac15ae40 con 0x7f91ac15b780 2024-04-16T15:37:17.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a400aa90 con 0x7f91ac15b780 2024-04-16T15:37:17.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.535+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac168c80 con 0x7f91ac15b780 2024-04-16T15:37:17.540 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.536+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91ac071950 con 0x7f91ac15b780 2024-04-16T15:37:17.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.536+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91a400ac30 con 0x7f91ac15b780 2024-04-16T15:37:17.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a2ffd640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f918c06c8f0 0x7f918c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f91a408bbb0 con 0x7f91ac15b780 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91aa59c640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f918c06c8f0 0x7f918c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a2ffd640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f918c075160 0x7f918c0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91a4004ec0 con 0x7f918c075160 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f91a408e2b0 con 0x7f91ac15b780 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91a3fff640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f918c075160 0x7f918c0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.542 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.537+0000 7f91aa59c640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f918c06c8f0 0x7f918c06edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91ac168930 tx=0x7f919c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.538+0000 7f91a3fff640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f918c075160 0x7f918c0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.543 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.538+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== osd.5 v2:172.21.15.87:6808/968411507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91a4004ec0 con 0x7f918c075160 2024-04-16T15:37:17.550 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.551+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 --> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f91ac068a40 con 0x7f918c075160 2024-04-16T15:37:17.551 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91a2ffd640 1 -- 172.21.15.80:0/1901982762 <== osd.5 v2:172.21.15.87:6808/968411507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f91ac068a40 con 0x7f918c075160 2024-04-16T15:37:17.551 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:17.551 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:17.552 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f918c075160 msgr2=0x7f918c0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.87:6808/968411507,v1:172.21.15.87:6809/968411507] conn(0x7f918c075160 0x7f918c0775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f918c06c8f0 msgr2=0x7f918c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f918c06c8f0 0x7f918c06edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91ac168930 tx=0x7f919c008040 comp rx=0 tx=0).stop 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 msgr2=0x7f91ac154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 --2- 172.21.15.80:0/1901982762 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f91ac15b780 0x7f91ac154290 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c7d0 tx=0x7f91a400cc90 comp rx=0 tx=0).stop 2024-04-16T15:37:17.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91aad9d640 1 -- 172.21.15.80:0/1901982762 reap_dead start 2024-04-16T15:37:17.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 shutdown_connections 2024-04-16T15:37:17.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.552+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 >> 172.21.15.80:0/1901982762 conn(0x7f91ac06b9a0 msgr2=0x7f91ac0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.553+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 shutdown_connections 2024-04-16T15:37:17.554 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.553+0000 7f91b0ceb640 1 -- 172.21.15.80:0/1901982762 wait complete. 2024-04-16T15:37:17.563 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T15:37:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.668+0000 7ff0a7515640 1 Processor -- start 2024-04-16T15:37:17.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.668+0000 7ff0a7515640 1 -- start start 2024-04-16T15:37:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a7515640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff0a0145eb0 0x7ff0a015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a7515640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a00ce870 0x7ff0a00d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.670 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a7515640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a00ceea0 con 0x7ff0a00d18f0 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a7515640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00cf180 con 0x7ff0a00ce870 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a7515640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00cf460 con 0x7ff0a0145eb0 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a4ab0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7ff0a00ce870 0x7ff0a00d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a5ab2640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7ff0a00d18f0 0x7ff0a00cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53142/0 (socket says 172.21.15.80:53142) 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a5ab2640 1 -- 172.21.15.80:0/1783749717 learned_addr learned my addr 172.21.15.80:0/1783749717 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a52b1640 1 --2- 172.21.15.80:0/1783749717 >> v2:172.21.15.87:3300/0 conn(0x7ff0a0145eb0 0x7ff0a015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a4ab0640 1 -- 172.21.15.80:0/1783749717 >> v2:172.21.15.87:3300/0 conn(0x7ff0a0145eb0 msgr2=0x7ff0a015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a4ab0640 1 --2- 172.21.15.80:0/1783749717 >> v2:172.21.15.87:3300/0 conn(0x7ff0a0145eb0 0x7ff0a015cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a4ab0640 1 -- 172.21.15.80:0/1783749717 >> v1:172.21.15.80:6789/0 conn(0x7ff0a00d18f0 legacy=0x7ff0a00cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff097fff640 1 -- 172.21.15.80:0/1783749717 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309676429 0 0) 0x7ff0a00ceea0 con 0x7ff0a00d18f0 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.669+0000 7ff0a4ab0640 1 -- 172.21.15.80:0/1783749717 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a00cf740 con 0x7ff0a00ce870 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.670+0000 7ff0a4ab0640 1 --2- 172.21.15.80:0/1783749717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00d13b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0071660 tx=0x7ff09002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee7b508209e1fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.670+0000 7ff097fff640 1 -- 172.21.15.80:0/1783749717 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090035020 con 0x7ff0a00ce870 2024-04-16T15:37:17.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.670+0000 7ff097fff640 1 -- 172.21.15.80:0/1783749717 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090031830 con 0x7ff0a00ce870 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.670+0000 7ff097fff640 1 -- 172.21.15.80:0/1783749717 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090031c00 con 0x7ff0a00ce870 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 -- 172.21.15.80:0/1783749717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 msgr2=0x7ff0a00d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 --2- 172.21.15.80:0/1783749717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00d13b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0071660 tx=0x7ff09002b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 -- 172.21.15.80:0/1783749717 shutdown_connections 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 --2- 172.21.15.80:0/1783749717 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00d13b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 --2- 172.21.15.80:0/1783749717 >> v2:172.21.15.87:3300/0 conn(0x7ff0a0145eb0 0x7ff0a015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 -- 172.21.15.80:0/1783749717 >> 172.21.15.80:0/1783749717 conn(0x7ff0a00b6ba0 msgr2=0x7ff0a009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 -- 172.21.15.80:0/1783749717 shutdown_connections 2024-04-16T15:37:17.674 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.671+0000 7ff0a7515640 1 -- 172.21.15.80:0/1783749717 wait complete. 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.672+0000 7ff0a7515640 1 Processor -- start 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.672+0000 7ff0a7515640 1 -- start start 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0a00d18f0 0x7ff0a013d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 0x7ff0a00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0146410 con 0x7ff0a00ce870 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0146290 con 0x7ff0a00d18f0 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a00d1d40 con 0x7ff0a0145eb0 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38220/0 (socket says 172.21.15.80:38220) 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 -- 172.21.15.80:0/681666715 learned_addr learned my addr 172.21.15.80:0/681666715 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a4ab0640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0a00d18f0 0x7ff0a013d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a5ab2640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 0x7ff0a00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 -- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 msgr2=0x7ff0a00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 0x7ff0a00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 -- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0a00d18f0 msgr2=0x7ff0a013d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0a00d18f0 0x7ff0a013d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 -- 172.21.15.80:0/681666715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a013d820 con 0x7ff0a00ce870 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a5ab2640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 0x7ff0a00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a52b1640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e8a0 tx=0x7ff09c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.679 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c017070 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c00c940 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a00affb0 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00cd30 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.673+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a00b0570 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.675+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a0068a40 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.675+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff09c01a070 con 0x7ff0a00ce870 2024-04-16T15:37:17.680 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.675+0000 7ff095ffb640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.675+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff09c08be70 con 0x7ff0a00ce870 2024-04-16T15:37:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.675+0000 7ff0a4ab0640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.676+0000 7ff0a4ab0640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff090036000 tx=0x7ff090008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.679+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0a013d820 con 0x7ff0a00ce870 2024-04-16T15:37:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.856+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff0a00ae7f0 con 0x7ff08406c8f0 2024-04-16T15:37:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.856+0000 7ff095ffb640 1 -- 172.21.15.80:0/681666715 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0a00ae7f0 con 0x7ff08406c8f0 2024-04-16T15:37:17.856 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T15:37:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 msgr2=0x7ff08406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 0x7ff08406edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff090036000 tx=0x7ff090008030 comp rx=0 tx=0).stop 2024-04-16T15:37:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 msgr2=0x7ff0a00b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e8a0 tx=0x7ff09c00ed60 comp rx=0 tx=0).stop 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 shutdown_connections 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7ff08406c8f0 0x7ff08406edb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7ff0a0145eb0 0x7ff0a00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.858+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff0a00d18f0 0x7ff0a013d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.859+0000 7ff0a7515640 1 --2- 172.21.15.80:0/681666715 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0a00ce870 0x7ff0a00b3380 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.859+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 >> 172.21.15.80:0/681666715 conn(0x7ff0a00b6ba0 msgr2=0x7ff0a015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.859+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 shutdown_connections 2024-04-16T15:37:17.859 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.859+0000 7ff0a7515640 1 -- 172.21.15.80:0/681666715 wait complete. 2024-04-16T15:37:17.869 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T15:37:17.869 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:17.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.977+0000 7f52d7bbd640 1 Processor -- start 2024-04-16T15:37:17.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.977+0000 7f52d7bbd640 1 -- start start 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d7bbd640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52d00b31d0 0x7f52d009b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d7bbd640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d00b4b50 con 0x7f52d00d0860 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d7bbd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d00b4e30 con 0x7f52d0161ef0 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d7bbd640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f52d006db10 con 0x7f52d00b31d0 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d5158640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f52d00b31d0 0x7f52d009b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d615a640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f52d00d0860 0x7f52d00d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53152/0 (socket says 172.21.15.80:53152) 2024-04-16T15:37:17.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d615a640 1 -- 172.21.15.80:0/3011977210 learned_addr learned my addr 172.21.15.80:0/3011977210 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:17.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d5158640 1 -- 172.21.15.80:0/3011977210 >> v1:172.21.15.87:6789/0 conn(0x7f52d0161ef0 legacy=0x7f52d009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d5158640 1 -- 172.21.15.80:0/3011977210 >> v1:172.21.15.80:6789/0 conn(0x7f52d00d0860 legacy=0x7f52d00d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d5158640 1 -- 172.21.15.80:0/3011977210 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d006d4c0 con 0x7f52d00b31d0 2024-04-16T15:37:17.979 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.978+0000 7f52d4957640 1 -- 172.21.15.80:0/3011977210 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753661351 0 0) 0x7f52d00b4b50 con 0x7f52d00d0860 2024-04-16T15:37:17.980 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.979+0000 7f52d5158640 1 --2- 172.21.15.80:0/3011977210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d009b180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097a0 tx=0x7f52c002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde122da17edb937 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.979+0000 7f52d4957640 1 -- 172.21.15.80:0/3011977210 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c0034070 con 0x7f52d00b31d0 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.979+0000 7f52d4957640 1 -- 172.21.15.80:0/3011977210 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c0030610 con 0x7f52d00b31d0 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.979+0000 7f52d4957640 1 -- 172.21.15.80:0/3011977210 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00309e0 con 0x7f52d00b31d0 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 -- 172.21.15.80:0/3011977210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 msgr2=0x7f52d009b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 --2- 172.21.15.80:0/3011977210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d009b180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f52c00097a0 tx=0x7f52c002b960 comp rx=0 tx=0).stop 2024-04-16T15:37:17.981 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 -- 172.21.15.80:0/3011977210 shutdown_connections 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 --2- 172.21.15.80:0/3011977210 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d009b180 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 -- 172.21.15.80:0/3011977210 >> 172.21.15.80:0/3011977210 conn(0x7f52d00b4030 msgr2=0x7f52d00b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 -- 172.21.15.80:0/3011977210 shutdown_connections 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.980+0000 7f52d7bbd640 1 -- 172.21.15.80:0/3011977210 wait complete. 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.981+0000 7f52d7bbd640 1 Processor -- start 2024-04-16T15:37:17.982 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.981+0000 7f52d7bbd640 1 -- start start 2024-04-16T15:37:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00d0860 0x7f52d01f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.985 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d0161ef0 0x7f52d01f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f52d0162450 con 0x7f52d00b31d0 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52d01622d0 con 0x7f52d00d0860 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f52d00d2120 con 0x7f52d0161ef0 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d00c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38228/0 (socket says 172.21.15.80:38228) 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 -- 172.21.15.80:0/4020234179 learned_addr learned my addr 172.21.15.80:0/4020234179 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5158640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00d0860 0x7f52d01f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.986 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d615a640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d0161ef0 0x7f52d01f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 -- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d0161ef0 msgr2=0x7f52d01f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f52d0161ef0 0x7f52d01f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 -- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00d0860 msgr2=0x7f52d01f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00d0860 0x7f52d01f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d00c8eb0 con 0x7f52d00b31d0 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5158640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52d00d0860 0x7f52d01f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d5959640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d00c8970 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c430 tx=0x7f52cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc017070 con 0x7f52d00b31d0 2024-04-16T15:37:17.987 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc0052d0 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003830 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d01f8530 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.982+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d01f8af0 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.983+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52d0068a40 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52cc01a070 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f52b406c920 0x7f52b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f52cc08b020 con 0x7f52d00b31d0 2024-04-16T15:37:17.988 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52d5158640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f52b406c920 0x7f52b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f52b4075190 0x7f52b40775d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52b4077ca0 con 0x7f52b4075190 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.984+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f52cc092050 con 0x7f52d00b31d0 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.985+0000 7f52d615a640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f52b4075190 0x7f52b40775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.985+0000 7f52d5158640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f52b406c920 0x7f52b406ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52c0036000 tx=0x7f52c0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.985+0000 7f52d615a640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f52b4075190 0x7f52b40775d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:17.989 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.986+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== osd.6 v2:172.21.15.87:6824/2634190512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52b4077ca0 con 0x7f52b4075190 2024-04-16T15:37:17.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.999+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 --> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52d015d110 con 0x7f52b4075190 2024-04-16T15:37:17.998 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.999+0000 7f52c67fc640 1 -- 172.21.15.80:0/4020234179 <== osd.6 v2:172.21.15.87:6824/2634190512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52d015d110 con 0x7f52b4075190 2024-04-16T15:37:17.999 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:17.999 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:17.999 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:18.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.999+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f52b4075190 msgr2=0x7f52b40775d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:17.999+0000 7f52d7bbd640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.87:6824/2634190512,v1:172.21.15.87:6825/2634190512] conn(0x7f52b4075190 0x7f52b40775d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f52b406c920 msgr2=0x7f52b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f52b406c920 0x7f52b406ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52c0036000 tx=0x7f52c0008030 comp rx=0 tx=0).stop 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 msgr2=0x7f52d00c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 --2- 172.21.15.80:0/4020234179 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f52d00b31d0 0x7f52d00c8970 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c430 tx=0x7f52cc00c8f0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d615a640 1 -- 172.21.15.80:0/4020234179 reap_dead start 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 shutdown_connections 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 >> 172.21.15.80:0/4020234179 conn(0x7f52d00b4030 msgr2=0x7f52d009b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 shutdown_connections 2024-04-16T15:37:18.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.000+0000 7f52d7bbd640 1 -- 172.21.15.80:0/4020234179 wait complete. 2024-04-16T15:37:18.009 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T15:37:18.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.113+0000 7faf885c8640 1 Processor -- start 2024-04-16T15:37:18.113 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.113+0000 7faf885c8640 1 -- start start 2024-04-16T15:37:18.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf885c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 0x7faf80071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf885c8640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf80161120 con 0x7faf80145ea0 2024-04-16T15:37:18.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf885c8640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf80160b60 con 0x7faf80072310 2024-04-16T15:37:18.116 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf885c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7faf80072760 con 0x7faf8015ccf0 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf86364640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7faf80145ea0 0x7faf801601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53156/0 (socket says 172.21.15.80:53156) 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.114+0000 7faf86364640 1 -- 172.21.15.80:0/2411773280 learned_addr learned my addr 172.21.15.80:0/2411773280 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85b63640 1 --2- 172.21.15.80:0/2411773280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 0x7faf80071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558475792 0 0) 0x7faf80161120 con 0x7faf80145ea0 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6c003520 con 0x7faf80145ea0 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15504876 0 0) 0x7faf80160b60 con 0x7faf80072310 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf80161120 con 0x7faf80072310 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85b63640 1 -- 172.21.15.80:0/2411773280 >> v1:172.21.15.87:6789/0 conn(0x7faf80072310 legacy=0x7faf8015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.0 v1:172.21.15.80:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1777084443 0 0) 0x7faf6c003520 con 0x7faf80145ea0 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85b63640 1 -- 172.21.15.80:0/2411773280 >> v1:172.21.15.80:6789/0 conn(0x7faf80145ea0 legacy=0x7faf801601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.115+0000 7faf85b63640 1 -- 172.21.15.80:0/2411773280 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf80160e40 con 0x7faf8015ccf0 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf85b63640 1 --2- 172.21.15.80:0/2411773280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 0x7faf80071dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf700097d0 tx=0x7faf7002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1acb6c6b5748b6b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70037070 con 0x7faf8015ccf0 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf70030510 con 0x7faf8015ccf0 2024-04-16T15:37:18.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf85362640 1 -- 172.21.15.80:0/2411773280 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0019f0 con 0x7faf8015ccf0 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 -- 172.21.15.80:0/2411773280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 msgr2=0x7faf80071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 --2- 172.21.15.80:0/2411773280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 0x7faf80071dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf700097d0 tx=0x7faf7002b770 comp rx=0 tx=0).stop 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 -- 172.21.15.80:0/2411773280 shutdown_connections 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 --2- 172.21.15.80:0/2411773280 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf8015ccf0 0x7faf80071dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 -- 172.21.15.80:0/2411773280 >> 172.21.15.80:0/2411773280 conn(0x7faf80067d90 msgr2=0x7faf8006b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.116+0000 7faf885c8640 1 -- 172.21.15.80:0/2411773280 shutdown_connections 2024-04-16T15:37:18.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.117+0000 7faf885c8640 1 -- 172.21.15.80:0/2411773280 wait complete. 2024-04-16T15:37:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 Processor -- start 2024-04-16T15:37:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 -- start start 2024-04-16T15:37:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf80145ea0 0x7faf800aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf8015ccf0 0x7faf8013ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7faf80146280 con 0x7faf80072310 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7faf80160900 con 0x7faf8015ccf0 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf885c8640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7faf8015ed70 con 0x7faf80145ea0 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf86364640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf86364640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38240/0 (socket says 172.21.15.80:38240) 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf86364640 1 -- 172.21.15.80:0/2161517100 learned_addr learned my addr 172.21.15.80:0/2161517100 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.118+0000 7faf85b63640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf80145ea0 0x7faf800aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86b65640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf8015ccf0 0x7faf8013ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 -- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf80145ea0 msgr2=0x7faf800aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf80145ea0 0x7faf800aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 -- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf8015ccf0 msgr2=0x7faf8013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf8015ccf0 0x7faf8013ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 -- 172.21.15.80:0/2161517100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800ab4b0 con 0x7faf80072310 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf86364640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faf7c001f30 tx=0x7faf7c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c017070 con 0x7faf80072310 2024-04-16T15:37:18.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c012400 con 0x7faf80072310 2024-04-16T15:37:18.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf800ab790 con 0x7faf80072310 2024-04-16T15:37:18.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c012870 con 0x7faf80072310 2024-04-16T15:37:18.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.119+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf800abd50 con 0x7faf80072310 2024-04-16T15:37:18.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.120+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf80068a40 con 0x7faf80072310 2024-04-16T15:37:18.126 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.121+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf7c01a070 con 0x7faf80072310 2024-04-16T15:37:18.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.121+0000 7faf76ffd640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 0x7faf6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.121+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7faf7c08bcd0 con 0x7faf80072310 2024-04-16T15:37:18.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.121+0000 7faf85b63640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 0x7faf6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.121+0000 7faf85b63640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 0x7faf6406edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf70034000 tx=0x7faf70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.127 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.125+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf7c0598a0 con 0x7faf80072310 2024-04-16T15:37:18.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.302+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7faf80072e80 con 0x7faf6406c8f0 2024-04-16T15:37:18.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.302+0000 7faf76ffd640 1 -- 172.21.15.80:0/2161517100 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf80072e80 con 0x7faf6406c8f0 2024-04-16T15:37:18.302 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T15:37:18.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.304+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 msgr2=0x7faf6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.304 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.304+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 0x7faf6406edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf70034000 tx=0x7faf70008030 comp rx=0 tx=0).stop 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.304+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 msgr2=0x7faf8015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.304+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7faf7c001f30 tx=0x7faf7c00a430 comp rx=0 tx=0).stop 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 shutdown_connections 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faf8015ccf0 0x7faf8013ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7faf6406c8f0 0x7faf6406edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7faf80145ea0 0x7faf800aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 --2- 172.21.15.80:0/2161517100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7faf80072310 0x7faf8015bf40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 >> 172.21.15.80:0/2161517100 conn(0x7faf80067d90 msgr2=0x7faf801451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 shutdown_connections 2024-04-16T15:37:18.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.305+0000 7faf885c8640 1 -- 172.21.15.80:0/2161517100 wait complete. 2024-04-16T15:37:18.315 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T15:37:18.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T15:37:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 Processor -- start 2024-04-16T15:37:18.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 -- start start 2024-04-16T15:37:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 0x7f87300d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f87300cf270 0x7f87300cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f873015ffe0 con 0x7f873015fc00 2024-04-16T15:37:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f87300d1a60 con 0x7f87300cf270 2024-04-16T15:37:18.424 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.423+0000 7f8735242640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f87300d31e0 con 0x7f87300d10c0 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872ed9d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f873015fc00 0x7f87300d5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53164/0 (socket says 172.21.15.80:53164) 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872ed9d640 1 -- 172.21.15.80:0/2168366081 learned_addr learned my addr 172.21.15.80:0/2168366081 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872f59e640 1 --2- 172.21.15.80:0/2168366081 >> v2:172.21.15.87:3300/0 conn(0x7f87300cf270 0x7f87300cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872e59c640 1 --2- 172.21.15.80:0/2168366081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 0x7f87300d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872dd9b640 1 -- 172.21.15.80:0/2168366081 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266720390 0 0) 0x7f8720001110 con 0x7f873015fc00 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872dd9b640 1 -- 172.21.15.80:0/2168366081 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8718003520 con 0x7f873015fc00 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872e59c640 1 -- 172.21.15.80:0/2168366081 >> v2:172.21.15.87:3300/0 conn(0x7f87300cf270 msgr2=0x7f87300cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:18.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872e59c640 1 --2- 172.21.15.80:0/2168366081 >> v2:172.21.15.87:3300/0 conn(0x7f87300cf270 0x7f87300cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872e59c640 1 -- 172.21.15.80:0/2168366081 >> v1:172.21.15.80:6789/0 conn(0x7f873015fc00 legacy=0x7f87300d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.424+0000 7f872e59c640 1 -- 172.21.15.80:0/2168366081 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300d3670 con 0x7f87300d10c0 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f872e59c640 1 --2- 172.21.15.80:0/2168366081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 0x7f87300d1520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87240097a0 tx=0x7f872402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41d429ce98f12dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f872dd9b640 1 -- 172.21.15.80:0/2168366081 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724035020 con 0x7f87300d10c0 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f872dd9b640 1 -- 172.21.15.80:0/2168366081 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8724031830 con 0x7f87300d10c0 2024-04-16T15:37:18.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f872dd9b640 1 -- 172.21.15.80:0/2168366081 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724031c00 con 0x7f87300d10c0 2024-04-16T15:37:18.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 -- 172.21.15.80:0/2168366081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 msgr2=0x7f87300d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 --2- 172.21.15.80:0/2168366081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 0x7f87300d1520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87240097a0 tx=0x7f872402b8d0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 -- 172.21.15.80:0/2168366081 shutdown_connections 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 --2- 172.21.15.80:0/2168366081 >> v2:172.21.15.87:3300/0 conn(0x7f87300cf270 0x7f87300cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 --2- 172.21.15.80:0/2168366081 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300d10c0 0x7f87300d1520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.425+0000 7f8735242640 1 -- 172.21.15.80:0/2168366081 >> 172.21.15.80:0/2168366081 conn(0x7f873008c000 msgr2=0x7f87300d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.426+0000 7f8735242640 1 -- 172.21.15.80:0/2168366081 shutdown_connections 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.426+0000 7f8735242640 1 -- 172.21.15.80:0/2168366081 wait complete. 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.427+0000 7f8735242640 1 Processor -- start 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.427+0000 7f8735242640 1 -- start start 2024-04-16T15:37:18.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300cf270 0x7f8730154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87300d10c0 0x7f87300b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 0x7f8730153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f87300d28b0 con 0x7f873015fc00 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f87300d2330 con 0x7f87300d10c0 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f87300d2b90 con 0x7f87300cf270 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 0x7f8730153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 0x7f8730153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38244/0 (socket says 172.21.15.80:38244) 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 -- 172.21.15.80:0/1583027428 learned_addr learned my addr 172.21.15.80:0/1583027428 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:18.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872ed9d640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300cf270 0x7f8730154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872e59c640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87300d10c0 0x7f87300b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 -- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300cf270 msgr2=0x7f8730154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f87300cf270 0x7f8730154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 -- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87300d10c0 msgr2=0x7f87300b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87300d10c0 0x7f87300b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300cb960 con 0x7f873015fc00 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f872f59e640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 0x7f8730153740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f872800efc0 tx=0x7f872800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728018020 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8728014480 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87300cbc40 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.428+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728014870 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.429+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87300cc200 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.430+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87301f8dd0 con 0x7f873015fc00 2024-04-16T15:37:18.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.430+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8728005d10 con 0x7f873015fc00 2024-04-16T15:37:18.434 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f87177fe640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871c06c8f0 0x7f871c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f872808c6f0 con 0x7f873015fc00 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f872ed9d640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871c06c8f0 0x7f871c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f87177fe640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7f871c0750e0 0x7f871c077520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f872800be50 con 0x7f871c0750e0 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8728093050 con 0x7f873015fc00 2024-04-16T15:37:18.435 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f872e59c640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7f871c0750e0 0x7f871c077520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f872ed9d640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871c06c8f0 0x7f871c06edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8720005880 tx=0x7f8720009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.431+0000 7f872e59c640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7f871c0750e0 0x7f871c077520 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.436 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.432+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== osd.7 v2:172.21.15.87:6816/4163376620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f872800be50 con 0x7f871c0750e0 2024-04-16T15:37:18.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.445+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 --> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8730068a40 con 0x7f871c0750e0 2024-04-16T15:37:18.445 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f87177fe640 1 -- 172.21.15.80:0/1583027428 <== osd.7 v2:172.21.15.87:6816/4163376620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8730068a40 con 0x7f871c0750e0 2024-04-16T15:37:18.445 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-04-16T15:37:18.446 INFO:teuthology.orchestra.run.smithi080.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T15:37:18.446 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7f871c0750e0 msgr2=0x7f871c077520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.87:6816/4163376620,v1:172.21.15.87:6817/4163376620] conn(0x7f871c0750e0 0x7f871c077520 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871c06c8f0 msgr2=0x7f871c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f871c06c8f0 0x7f871c06edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8720005880 tx=0x7f8720009040 comp rx=0 tx=0).stop 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 msgr2=0x7f8730153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.447 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 --2- 172.21.15.80:0/1583027428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f873015fc00 0x7f8730153740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f872800efc0 tx=0x7f872800c490 comp rx=0 tx=0).stop 2024-04-16T15:37:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f872f59e640 1 -- 172.21.15.80:0/1583027428 reap_dead start 2024-04-16T15:37:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 shutdown_connections 2024-04-16T15:37:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 >> 172.21.15.80:0/1583027428 conn(0x7f873008c000 msgr2=0x7f87300b9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 shutdown_connections 2024-04-16T15:37:18.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.446+0000 7f8735242640 1 -- 172.21.15.80:0/1583027428 wait complete. 2024-04-16T15:37:18.456 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T15:37:18.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.561+0000 7f5549488640 1 Processor -- start 2024-04-16T15:37:18.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.561+0000 7f5549488640 1 -- start start 2024-04-16T15:37:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5549488640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55440d1700 0x7f55440d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.563 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5549488640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55440cfd90 con 0x7f5544161f20 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5549488640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55440d0050 con 0x7f55440b74e0 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5549488640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55440d0330 con 0x7f55440d1700 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5542ffd640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f5544161f20 0x7f55440cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53174/0 (socket says 172.21.15.80:53174) 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5542ffd640 1 -- 172.21.15.80:0/2385180811 learned_addr learned my addr 172.21.15.80:0/2385180811 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f55437fe640 1 --2- 172.21.15.80:0/2385180811 >> v2:172.21.15.87:3300/0 conn(0x7f55440d1700 0x7f55440d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038643447 0 0) 0x7f55440cfd90 con 0x7f5544161f20 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 --> v1:172.21.15.80:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5530003520 con 0x7f5544161f20 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950359696 0 0) 0x7f55440d0050 con 0x7f55440b74e0 2024-04-16T15:37:18.564 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55440cfd90 con 0x7f55440b74e0 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f55437fe640 1 -- 172.21.15.80:0/2385180811 >> v1:172.21.15.87:6789/0 conn(0x7f55440b74e0 legacy=0x7f55440d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f55437fe640 1 -- 172.21.15.80:0/2385180811 >> v1:172.21.15.80:6789/0 conn(0x7f5544161f20 legacy=0x7f55440cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.562+0000 7f55437fe640 1 -- 172.21.15.80:0/2385180811 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55440d0610 con 0x7f55440d1700 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.563+0000 7f55437fe640 1 --2- 172.21.15.80:0/2385180811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55440d1700 0x7f55440d27e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f553c0097a0 tx=0x7f553c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b21f595f89f175 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.563+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 <== mon.1 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c034070 con 0x7f55440d1700 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.563+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 <== mon.1 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c030610 con 0x7f55440d1700 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.563+0000 7f5541ffb640 1 -- 172.21.15.80:0/2385180811 <== mon.1 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0309e0 con 0x7f55440d1700 2024-04-16T15:37:18.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 -- 172.21.15.80:0/2385180811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55440d1700 msgr2=0x7f55440d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 --2- 172.21.15.80:0/2385180811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55440d1700 0x7f55440d27e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f553c0097a0 tx=0x7f553c02b960 comp rx=0 tx=0).stop 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 -- 172.21.15.80:0/2385180811 shutdown_connections 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 --2- 172.21.15.80:0/2385180811 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55440d1700 0x7f55440d27e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 -- 172.21.15.80:0/2385180811 >> 172.21.15.80:0/2385180811 conn(0x7f554408c000 msgr2=0x7f55440d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 -- 172.21.15.80:0/2385180811 shutdown_connections 2024-04-16T15:37:18.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.564+0000 7f5549488640 1 -- 172.21.15.80:0/2385180811 wait complete. 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.565+0000 7f5549488640 1 Processor -- start 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.565+0000 7f5549488640 1 -- start start 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440b74e0 0x7f5544149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544161f20 0x7f55440ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f55440cf940 con 0x7f55440d1700 2024-04-16T15:37:18.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55440b5730 con 0x7f5544161f20 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5549488640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f55440cfac0 con 0x7f55440b74e0 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38256/0 (socket says 172.21.15.80:38256) 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 -- 172.21.15.80:0/1932366776 learned_addr learned my addr 172.21.15.80:0/1932366776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55437fe640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544161f20 0x7f55440ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f5542ffd640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440b74e0 0x7f5544149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 -- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440b74e0 msgr2=0x7f5544149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440b74e0 0x7f5544149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 -- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544161f20 msgr2=0x7f55440ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544161f20 0x7f55440ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.566+0000 7f55427fc640 1 -- 172.21.15.80:0/1932366776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55440c9850 con 0x7f55440d1700 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f55427fc640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c430 tx=0x7f552c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c017070 con 0x7f55440d1700 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0052f0 con 0x7f55440d1700 2024-04-16T15:37:18.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55440c9b30 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c003830 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.567+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55440ca0f0 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.568+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5544068a40 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.568+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f552c01a070 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.569+0000 7f553b7fe640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 0x7f552406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.569+0000 7f5542ffd640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 0x7f552406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.569+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f552c08af10 con 0x7f55440d1700 2024-04-16T15:37:18.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.569+0000 7f5542ffd640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 0x7f552406edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f55340012e0 tx=0x7f5534001a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.573+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f552c058bf0 con 0x7f55440d1700 2024-04-16T15:37:18.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.747+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f55440d1d10 con 0x7f552406c8f0 2024-04-16T15:37:18.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.748+0000 7f553b7fe640 1 -- 172.21.15.80:0/1932366776 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55440d1d10 con 0x7f552406c8f0 2024-04-16T15:37:18.748 INFO:teuthology.orchestra.run.smithi080.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 msgr2=0x7f552406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 0x7f552406edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f55340012e0 tx=0x7f5534001a90 comp rx=0 tx=0).stop 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 msgr2=0x7f554415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c430 tx=0x7f552c00c8f0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 shutdown_connections 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5544161f20 0x7f55440ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55440d1700 0x7f554415a900 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f552406c8f0 0x7f552406edb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 --2- 172.21.15.80:0/1932366776 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f55440b74e0 0x7f5544149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 >> 172.21.15.80:0/1932366776 conn(0x7f554408c000 msgr2=0x7f554406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 shutdown_connections 2024-04-16T15:37:18.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.750+0000 7f5549488640 1 -- 172.21.15.80:0/1932366776 wait complete. 2024-04-16T15:37:18.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:18.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.863+0000 7f4e70437640 1 Processor -- start 2024-04-16T15:37:18.863 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.863+0000 7f4e70437640 1 -- start start 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.864+0000 7f4e70437640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680d1170 0x7f4e680ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.864+0000 7f4e70437640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e680cd090 0x7f4e68162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.864+0000 7f4e70437640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e680d1910 con 0x7f4e6815e930 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.864+0000 7f4e70437640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6806cab0 con 0x7f4e680cd090 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.864+0000 7f4e70437640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6806cd00 con 0x7f4e680d1170 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e680cd090 0x7f4e68162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e1d3640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7f4e6815e930 0x7f4e6806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:53188/0 (socket says 172.21.15.80:53188) 2024-04-16T15:37:18.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e1d3640 1 -- 172.21.15.80:0/1923814583 learned_addr learned my addr 172.21.15.80:0/1923814583 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f4e680cd090 0x7f4e68162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38268/0 (socket says 172.21.15.80:38268) 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/1923814583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680d1170 msgr2=0x7f4e680ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6d9d2640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680d1170 0x7f4e680ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6d1d1640 1 -- 172.21.15.80:0/1923814583 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477586601 0 0) 0x7f4e680d1910 con 0x7f4e6815e930 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680d1170 0x7f4e680ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/1923814583 >> v1:172.21.15.80:6789/0 conn(0x7f4e6815e930 legacy=0x7f4e6806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.865+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/1923814583 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6806cfe0 con 0x7f4e680cd090 2024-04-16T15:37:18.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e6e9d4640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680cd090 0x7f4e68162490 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba4a8fc40158047 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e6d1d1640 1 -- 172.21.15.80:0/1923814583 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60039070 con 0x7f4e680cd090 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e6d1d1640 1 -- 172.21.15.80:0/1923814583 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6002cc50 con 0x7f4e680cd090 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e6d1d1640 1 -- 172.21.15.80:0/1923814583 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60034440 con 0x7f4e680cd090 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 -- 172.21.15.80:0/1923814583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680cd090 msgr2=0x7f4e68162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680cd090 0x7f4e68162490 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009d90 tx=0x7f4e6002bea0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 -- 172.21.15.80:0/1923814583 shutdown_connections 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e680cd090 0x7f4e68162490 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 --2- 172.21.15.80:0/1923814583 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680d1170 0x7f4e680ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 -- 172.21.15.80:0/1923814583 >> 172.21.15.80:0/1923814583 conn(0x7f4e680d2500 msgr2=0x7f4e680d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:18.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 -- 172.21.15.80:0/1923814583 shutdown_connections 2024-04-16T15:37:18.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.866+0000 7f4e70437640 1 -- 172.21.15.80:0/1923814583 wait complete. 2024-04-16T15:37:18.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 Processor -- start 2024-04-16T15:37:18.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 -- start start 2024-04-16T15:37:18.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680cd090 0x7f4e6814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e680d1170 0x7f4e680b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d15d0 con 0x7f4e6815e930 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6815ed10 con 0x7f4e680d1170 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e70437640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680cd520 con 0x7f4e680cd090 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e6e9d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e6e9d4640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38280/0 (socket says 172.21.15.80:38280) 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.868+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/3359528849 learned_addr learned my addr 172.21.15.80:0/3359528849 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6d9d2640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e680d1170 0x7f4e680b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e1d3640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680cd090 0x7f4e6814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680cd090 msgr2=0x7f4e6814c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680cd090 0x7f4e6814c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e680d1170 msgr2=0x7f4e680b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e680d1170 0x7f4e680b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 -- 172.21.15.80:0/3359528849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680c8c70 con 0x7f4e6815e930 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e6e9d4640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009eb0 tx=0x7f4e60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60039050 con 0x7f4e6815e930 2024-04-16T15:37:18.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60045070 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e680b5b00 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6003e610 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.869+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e680b63a0 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.870+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68069150 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.871+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e6003e7b0 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.871+0000 7f4e5effd640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 0x7f4e4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.871+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4e600ae810 con 0x7f4e6815e930 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.871+0000 7f4e6e1d3640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 0x7f4e4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:18.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.872+0000 7f4e6e1d3640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 0x7f4e4c06edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e64000f60 tx=0x7f4e64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:18.876 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:18.875+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e60032e20 con 0x7f4e6815e930 2024-04-16T15:37:19.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.046+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e680cec70 con 0x7f4e4c06c8f0 2024-04-16T15:37:19.051 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.052+0000 7f4e5effd640 1 -- 172.21.15.80:0/3359528849 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251846 (secure 0 0 0) 0x7f4e680cec70 con 0x7f4e4c06c8f0 2024-04-16T15:37:19.054 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:19.055 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 msgr2=0x7f4e4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 0x7f4e4c06edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e64000f60 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 msgr2=0x7f4e680b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009eb0 tx=0x7f4e60004a40 comp rx=0 tx=0).stop 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 shutdown_connections 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4e6815e930 0x7f4e680b54d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:19.057 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e680d1170 0x7f4e680b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:19.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f4e4c06c8f0 0x7f4e4c06edb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:19.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 --2- 172.21.15.80:0/3359528849 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4e680cd090 0x7f4e6814c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:19.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 >> 172.21.15.80:0/3359528849 conn(0x7f4e680d2500 msgr2=0x7f4e680ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:19.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 shutdown_connections 2024-04-16T15:37:19.058 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:19.055+0000 7f4e70437640 1 -- 172.21.15.80:0/3359528849 wait complete. 2024-04-16T15:37:19.065 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-16T15:37:17.176306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220920,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753800,"statfs":{"total":773094113280,"available":772867891200,"internally_reserved":0,"allocated":4857856,"data_stored":2762940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002132"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290963+0000","last_change":"2024-04-16T15:37:03.293821+0000","last_active":"2024-04-16T15:37:04.290963+0000","last_peered":"2024-04-16T15:37:04.290963+0000","last_clean":"2024-04-16T15:37:04.290963+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:04.290963+0000","last_undegraded":"2024-04-16T15:37:04.290963+0000","last_fullsized":"2024-04-16T15:37:04.290963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:19.578231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290815+0000","last_change":"2024-04-16T15:37:03.287484+0000","last_active":"2024-04-16T15:37:04.290815+0000","last_peered":"2024-04-16T15:37:04.290815+0000","last_clean":"2024-04-16T15:37:04.290815+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:04.290815+0000","last_undegraded":"2024-04-16T15:37:04.290815+0000","last_fullsized":"2024-04-16T15:37:04.290815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:17:54.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380823+0000","last_change":"2024-04-16T15:37:03.302525+0000","last_active":"2024-04-16T15:37:06.380823+0000","last_peered":"2024-04-16T15:37:06.380823+0000","last_clean":"2024-04-16T15:37:06.380823+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:06.380823+0000","last_undegraded":"2024-04-16T15:37:06.380823+0000","last_fullsized":"2024-04-16T15:37:06.380823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779368+0000","last_change":"2024-04-16T15:37:03.290842+0000","last_active":"2024-04-16T15:37:04.779368+0000","last_peered":"2024-04-16T15:37:04.779368+0000","last_clean":"2024-04-16T15:37:04.779368+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:04.779368+0000","last_undegraded":"2024-04-16T15:37:04.779368+0000","last_fullsized":"2024-04-16T15:37:04.779368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:52.243002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779245+0000","last_change":"2024-04-16T15:37:03.292283+0000","last_active":"2024-04-16T15:37:04.779245+0000","last_peered":"2024-04-16T15:37:04.779245+0000","last_clean":"2024-04-16T15:37:04.779245+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:04.779245+0000","last_undegraded":"2024-04-16T15:37:04.779245+0000","last_fullsized":"2024-04-16T15:37:04.779245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:39.053823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220953+0000","last_change":"2024-04-16T15:37:03.287839+0000","last_active":"2024-04-16T15:37:06.220953+0000","last_peered":"2024-04-16T15:37:06.220953+0000","last_clean":"2024-04-16T15:37:06.220953+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:06.220953+0000","last_undegraded":"2024-04-16T15:37:06.220953+0000","last_fullsized":"2024-04-16T15:37:06.220953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292255+0000","last_change":"2024-04-16T15:37:03.296515+0000","last_active":"2024-04-16T15:37:04.292255+0000","last_peered":"2024-04-16T15:37:04.292255+0000","last_clean":"2024-04-16T15:37:04.292255+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:04.292255+0000","last_undegraded":"2024-04-16T15:37:04.292255+0000","last_fullsized":"2024-04-16T15:37:04.292255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290449+0000","last_change":"2024-04-16T15:37:03.291041+0000","last_active":"2024-04-16T15:37:04.290449+0000","last_peered":"2024-04-16T15:37:04.290449+0000","last_clean":"2024-04-16T15:37:04.290449+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:04.290449+0000","last_undegraded":"2024-04-16T15:37:04.290449+0000","last_fullsized":"2024-04-16T15:37:04.290449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:08:44.988154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380899+0000","last_change":"2024-04-16T15:37:03.301582+0000","last_active":"2024-04-16T15:37:06.380899+0000","last_peered":"2024-04-16T15:37:06.380899+0000","last_clean":"2024-04-16T15:37:06.380899+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:06.380899+0000","last_undegraded":"2024-04-16T15:37:06.380899+0000","last_fullsized":"2024-04-16T15:37:06.380899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293148+0000","last_change":"2024-04-16T15:37:03.297049+0000","last_active":"2024-04-16T15:37:04.293148+0000","last_peered":"2024-04-16T15:37:04.293148+0000","last_clean":"2024-04-16T15:37:04.293148+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:04.293148+0000","last_undegraded":"2024-04-16T15:37:04.293148+0000","last_fullsized":"2024-04-16T15:37:04.293148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:02.257006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293101+0000","last_change":"2024-04-16T15:37:03.295818+0000","last_active":"2024-04-16T15:37:04.293101+0000","last_peered":"2024-04-16T15:37:04.293101+0000","last_clean":"2024-04-16T15:37:04.293101+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:04.293101+0000","last_undegraded":"2024-04-16T15:37:04.293101+0000","last_fullsized":"2024-04-16T15:37:04.293101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:38.884525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380731+0000","last_change":"2024-04-16T15:37:03.292731+0000","last_active":"2024-04-16T15:37:06.380731+0000","last_peered":"2024-04-16T15:37:06.380731+0000","last_clean":"2024-04-16T15:37:06.380731+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:06.380731+0000","last_undegraded":"2024-04-16T15:37:06.380731+0000","last_fullsized":"2024-04-16T15:37:06.380731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292603+0000","last_change":"2024-04-16T15:37:03.299005+0000","last_active":"2024-04-16T15:37:04.292603+0000","last_peered":"2024-04-16T15:37:04.292603+0000","last_clean":"2024-04-16T15:37:04.292603+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:04.292603+0000","last_undegraded":"2024-04-16T15:37:04.292603+0000","last_fullsized":"2024-04-16T15:37:04.292603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823459+0000","last_change":"2024-04-16T15:37:03.295274+0000","last_active":"2024-04-16T15:37:06.823459+0000","last_peered":"2024-04-16T15:37:06.823459+0000","last_clean":"2024-04-16T15:37:06.823459+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:06.823459+0000","last_undegraded":"2024-04-16T15:37:06.823459+0000","last_fullsized":"2024-04-16T15:37:06.823459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292439+0000","last_change":"2024-04-16T15:37:03.290847+0000","last_active":"2024-04-16T15:37:04.292439+0000","last_peered":"2024-04-16T15:37:04.292439+0000","last_clean":"2024-04-16T15:37:04.292439+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:04.292439+0000","last_undegraded":"2024-04-16T15:37:04.292439+0000","last_fullsized":"2024-04-16T15:37:04.292439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754686+0000","last_change":"2024-04-16T15:37:03.288425+0000","last_active":"2024-04-16T15:37:05.754686+0000","last_peered":"2024-04-16T15:37:05.754686+0000","last_clean":"2024-04-16T15:37:05.754686+0000","last_became_active":"2024-04-16T15:37:03.288144+0000","last_became_peered":"2024-04-16T15:37:03.288144+0000","last_unstale":"2024-04-16T15:37:05.754686+0000","last_undegraded":"2024-04-16T15:37:05.754686+0000","last_fullsized":"2024-04-16T15:37:05.754686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755359+0000","last_change":"2024-04-16T15:37:03.295187+0000","last_active":"2024-04-16T15:37:05.755359+0000","last_peered":"2024-04-16T15:37:05.755359+0000","last_clean":"2024-04-16T15:37:05.755359+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:05.755359+0000","last_undegraded":"2024-04-16T15:37:05.755359+0000","last_fullsized":"2024-04-16T15:37:05.755359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:35:56.226799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292163+0000","last_change":"2024-04-16T15:37:03.290252+0000","last_active":"2024-04-16T15:37:04.292163+0000","last_peered":"2024-04-16T15:37:04.292163+0000","last_clean":"2024-04-16T15:37:04.292163+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:04.292163+0000","last_undegraded":"2024-04-16T15:37:04.292163+0000","last_fullsized":"2024-04-16T15:37:04.292163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:12.911256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779403+0000","last_change":"2024-04-16T15:37:03.288369+0000","last_active":"2024-04-16T15:37:04.779403+0000","last_peered":"2024-04-16T15:37:04.779403+0000","last_clean":"2024-04-16T15:37:04.779403+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:04.779403+0000","last_undegraded":"2024-04-16T15:37:04.779403+0000","last_fullsized":"2024-04-16T15:37:04.779403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:29.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292203+0000","last_change":"2024-04-16T15:37:03.293776+0000","last_active":"2024-04-16T15:37:04.292203+0000","last_peered":"2024-04-16T15:37:04.292203+0000","last_clean":"2024-04-16T15:37:04.292203+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:04.292203+0000","last_undegraded":"2024-04-16T15:37:04.292203+0000","last_fullsized":"2024-04-16T15:37:04.292203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:11.794716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292663+0000","last_change":"2024-04-16T15:37:03.295966+0000","last_active":"2024-04-16T15:37:04.292663+0000","last_peered":"2024-04-16T15:37:04.292663+0000","last_clean":"2024-04-16T15:37:04.292663+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:04.292663+0000","last_undegraded":"2024-04-16T15:37:04.292663+0000","last_fullsized":"2024-04-16T15:37:04.292663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:40.982004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823881+0000","last_change":"2024-04-16T15:37:03.293530+0000","last_active":"2024-04-16T15:37:06.823881+0000","last_peered":"2024-04-16T15:37:06.823881+0000","last_clean":"2024-04-16T15:37:06.823881+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:06.823881+0000","last_undegraded":"2024-04-16T15:37:06.823881+0000","last_fullsized":"2024-04-16T15:37:06.823881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754717+0000","last_change":"2024-04-16T15:37:03.291860+0000","last_active":"2024-04-16T15:37:05.754717+0000","last_peered":"2024-04-16T15:37:05.754717+0000","last_clean":"2024-04-16T15:37:05.754717+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:05.754717+0000","last_undegraded":"2024-04-16T15:37:05.754717+0000","last_fullsized":"2024-04-16T15:37:05.754717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779196+0000","last_change":"2024-04-16T15:37:03.294974+0000","last_active":"2024-04-16T15:37:04.779196+0000","last_peered":"2024-04-16T15:37:04.779196+0000","last_clean":"2024-04-16T15:37:04.779196+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:04.779196+0000","last_undegraded":"2024-04-16T15:37:04.779196+0000","last_fullsized":"2024-04-16T15:37:04.779196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:39.564398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292532+0000","last_change":"2024-04-16T15:37:03.294386+0000","last_active":"2024-04-16T15:37:04.292532+0000","last_peered":"2024-04-16T15:37:04.292532+0000","last_clean":"2024-04-16T15:37:04.292532+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:04.292532+0000","last_undegraded":"2024-04-16T15:37:04.292532+0000","last_fullsized":"2024-04-16T15:37:04.292532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:58.640671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221170+0000","last_change":"2024-04-16T15:37:03.296098+0000","last_active":"2024-04-16T15:37:06.221170+0000","last_peered":"2024-04-16T15:37:06.221170+0000","last_clean":"2024-04-16T15:37:06.221170+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:06.221170+0000","last_undegraded":"2024-04-16T15:37:06.221170+0000","last_fullsized":"2024-04-16T15:37:06.221170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292445+0000","last_change":"2024-04-16T15:37:03.283503+0000","last_active":"2024-04-16T15:37:04.292445+0000","last_peered":"2024-04-16T15:37:04.292445+0000","last_clean":"2024-04-16T15:37:04.292445+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:04.292445+0000","last_undegraded":"2024-04-16T15:37:04.292445+0000","last_fullsized":"2024-04-16T15:37:04.292445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:35.010222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292958+0000","last_change":"2024-04-16T15:37:03.297335+0000","last_active":"2024-04-16T15:37:04.292958+0000","last_peered":"2024-04-16T15:37:04.292958+0000","last_clean":"2024-04-16T15:37:04.292958+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:04.292958+0000","last_undegraded":"2024-04-16T15:37:04.292958+0000","last_fullsized":"2024-04-16T15:37:04.292958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:12.271216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292150+0000","last_change":"2024-04-16T15:37:03.287117+0000","last_active":"2024-04-16T15:37:04.292150+0000","last_peered":"2024-04-16T15:37:04.292150+0000","last_clean":"2024-04-16T15:37:04.292150+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:04.292150+0000","last_undegraded":"2024-04-16T15:37:04.292150+0000","last_fullsized":"2024-04-16T15:37:04.292150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:57.263286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291919+0000","last_change":"2024-04-16T15:37:03.284514+0000","last_active":"2024-04-16T15:37:04.291919+0000","last_peered":"2024-04-16T15:37:04.291919+0000","last_clean":"2024-04-16T15:37:04.291919+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:04.291919+0000","last_undegraded":"2024-04-16T15:37:04.291919+0000","last_fullsized":"2024-04-16T15:37:04.291919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:48.403857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754846+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:05.754846+0000","last_peered":"2024-04-16T15:37:05.754846+0000","last_clean":"2024-04-16T15:37:05.754846+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:05.754846+0000","last_undegraded":"2024-04-16T15:37:05.754846+0000","last_fullsized":"2024-04-16T15:37:05.754846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220986+0000","last_change":"2024-04-16T15:37:03.295120+0000","last_active":"2024-04-16T15:37:06.220986+0000","last_peered":"2024-04-16T15:37:06.220986+0000","last_clean":"2024-04-16T15:37:06.220986+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:06.220986+0000","last_undegraded":"2024-04-16T15:37:06.220986+0000","last_fullsized":"2024-04-16T15:37:06.220986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755060+0000","last_change":"2024-04-16T15:37:03.295227+0000","last_active":"2024-04-16T15:37:05.755060+0000","last_peered":"2024-04-16T15:37:05.755060+0000","last_clean":"2024-04-16T15:37:05.755060+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:05.755060+0000","last_undegraded":"2024-04-16T15:37:05.755060+0000","last_fullsized":"2024-04-16T15:37:05.755060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292642+0000","last_change":"2024-04-16T15:37:02.278874+0000","last_active":"2024-04-16T15:37:04.292642+0000","last_peered":"2024-04-16T15:37:04.292642+0000","last_clean":"2024-04-16T15:37:04.292642+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:04.292642+0000","last_undegraded":"2024-04-16T15:37:04.292642+0000","last_fullsized":"2024-04-16T15:37:04.292642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221200+0000","last_change":"2024-04-16T15:37:03.300508+0000","last_active":"2024-04-16T15:37:06.221200+0000","last_peered":"2024-04-16T15:37:06.221200+0000","last_clean":"2024-04-16T15:37:06.221200+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:06.221200+0000","last_undegraded":"2024-04-16T15:37:06.221200+0000","last_fullsized":"2024-04-16T15:37:06.221200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380762+0000","last_change":"2024-04-16T15:37:02.281446+0000","last_active":"2024-04-16T15:37:06.380762+0000","last_peered":"2024-04-16T15:37:06.380762+0000","last_clean":"2024-04-16T15:37:06.380762+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:06.380762+0000","last_undegraded":"2024-04-16T15:37:06.380762+0000","last_fullsized":"2024-04-16T15:37:06.380762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823838+0000","last_change":"2024-04-16T15:37:03.295791+0000","last_active":"2024-04-16T15:37:06.823838+0000","last_peered":"2024-04-16T15:37:06.823838+0000","last_clean":"2024-04-16T15:37:06.823838+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:06.823838+0000","last_undegraded":"2024-04-16T15:37:06.823838+0000","last_fullsized":"2024-04-16T15:37:06.823838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221222+0000","last_change":"2024-04-16T15:37:02.281596+0000","last_active":"2024-04-16T15:37:06.221222+0000","last_peered":"2024-04-16T15:37:06.221222+0000","last_clean":"2024-04-16T15:37:06.221222+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:06.221222+0000","last_undegraded":"2024-04-16T15:37:06.221222+0000","last_fullsized":"2024-04-16T15:37:06.221222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290915+0000","last_change":"2024-04-16T15:37:03.288926+0000","last_active":"2024-04-16T15:37:04.290915+0000","last_peered":"2024-04-16T15:37:04.290915+0000","last_clean":"2024-04-16T15:37:04.290915+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:04.290915+0000","last_undegraded":"2024-04-16T15:37:04.290915+0000","last_fullsized":"2024-04-16T15:37:04.290915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:33.450281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823655+0000","last_change":"2024-04-16T15:37:02.279895+0000","last_active":"2024-04-16T15:37:06.823655+0000","last_peered":"2024-04-16T15:37:06.823655+0000","last_clean":"2024-04-16T15:37:06.823655+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:06.823655+0000","last_undegraded":"2024-04-16T15:37:06.823655+0000","last_fullsized":"2024-04-16T15:37:06.823655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380540+0000","last_change":"2024-04-16T15:37:03.299462+0000","last_active":"2024-04-16T15:37:06.380540+0000","last_peered":"2024-04-16T15:37:06.380540+0000","last_clean":"2024-04-16T15:37:06.380540+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:06.380540+0000","last_undegraded":"2024-04-16T15:37:06.380540+0000","last_fullsized":"2024-04-16T15:37:06.380540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:21.332128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292726+0000","last_change":"2024-04-16T15:37:02.277997+0000","last_active":"2024-04-16T15:37:04.292726+0000","last_peered":"2024-04-16T15:37:04.292726+0000","last_clean":"2024-04-16T15:37:04.292726+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:04.292726+0000","last_undegraded":"2024-04-16T15:37:04.292726+0000","last_fullsized":"2024-04-16T15:37:04.292726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292607+0000","last_change":"2024-04-16T15:37:03.291256+0000","last_active":"2024-04-16T15:37:04.292607+0000","last_peered":"2024-04-16T15:37:04.292607+0000","last_clean":"2024-04-16T15:37:04.292607+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:04.292607+0000","last_undegraded":"2024-04-16T15:37:04.292607+0000","last_fullsized":"2024-04-16T15:37:04.292607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:52.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754898+0000","last_change":"2024-04-16T15:37:02.281149+0000","last_active":"2024-04-16T15:37:05.754898+0000","last_peered":"2024-04-16T15:37:05.754898+0000","last_clean":"2024-04-16T15:37:05.754898+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:05.754898+0000","last_undegraded":"2024-04-16T15:37:05.754898+0000","last_fullsized":"2024-04-16T15:37:05.754898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823711+0000","last_change":"2024-04-16T15:37:03.299167+0000","last_active":"2024-04-16T15:37:06.823711+0000","last_peered":"2024-04-16T15:37:06.823711+0000","last_clean":"2024-04-16T15:37:06.823711+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:06.823711+0000","last_undegraded":"2024-04-16T15:37:06.823711+0000","last_fullsized":"2024-04-16T15:37:06.823711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220901+0000","last_change":"2024-04-16T15:37:02.281900+0000","last_active":"2024-04-16T15:37:06.220901+0000","last_peered":"2024-04-16T15:37:06.220901+0000","last_clean":"2024-04-16T15:37:06.220901+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:06.220901+0000","last_undegraded":"2024-04-16T15:37:06.220901+0000","last_fullsized":"2024-04-16T15:37:06.220901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290755+0000","last_change":"2024-04-16T15:37:03.294071+0000","last_active":"2024-04-16T15:37:04.290755+0000","last_peered":"2024-04-16T15:37:04.290755+0000","last_clean":"2024-04-16T15:37:04.290755+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:04.290755+0000","last_undegraded":"2024-04-16T15:37:04.290755+0000","last_fullsized":"2024-04-16T15:37:04.290755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:23.894101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823320+0000","last_change":"2024-04-16T15:37:02.278148+0000","last_active":"2024-04-16T15:37:06.823320+0000","last_peered":"2024-04-16T15:37:06.823320+0000","last_clean":"2024-04-16T15:37:06.823320+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:06.823320+0000","last_undegraded":"2024-04-16T15:37:06.823320+0000","last_fullsized":"2024-04-16T15:37:06.823320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779373+0000","last_change":"2024-04-16T15:37:03.290531+0000","last_active":"2024-04-16T15:37:04.779373+0000","last_peered":"2024-04-16T15:37:04.779373+0000","last_clean":"2024-04-16T15:37:04.779373+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:04.779373+0000","last_undegraded":"2024-04-16T15:37:04.779373+0000","last_fullsized":"2024-04-16T15:37:04.779373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:43.866256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290992+0000","last_change":"2024-04-16T15:37:02.286105+0000","last_active":"2024-04-16T15:37:04.290992+0000","last_peered":"2024-04-16T15:37:04.290992+0000","last_clean":"2024-04-16T15:37:04.290992+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:04.290992+0000","last_undegraded":"2024-04-16T15:37:04.290992+0000","last_fullsized":"2024-04-16T15:37:04.290992+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:49.552468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755232+0000","last_change":"2024-04-16T15:37:03.291289+0000","last_active":"2024-04-16T15:37:05.755232+0000","last_peered":"2024-04-16T15:37:05.755232+0000","last_clean":"2024-04-16T15:37:05.755232+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:05.755232+0000","last_undegraded":"2024-04-16T15:37:05.755232+0000","last_fullsized":"2024-04-16T15:37:05.755232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:35.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293285+0000","last_change":"2024-04-16T15:37:02.274779+0000","last_active":"2024-04-16T15:37:04.293285+0000","last_peered":"2024-04-16T15:37:04.293285+0000","last_clean":"2024-04-16T15:37:04.293285+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:04.293285+0000","last_undegraded":"2024-04-16T15:37:04.293285+0000","last_fullsized":"2024-04-16T15:37:04.293285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:51.753193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380782+0000","last_change":"2024-04-16T15:37:03.293472+0000","last_active":"2024-04-16T15:37:06.380782+0000","last_peered":"2024-04-16T15:37:06.380782+0000","last_clean":"2024-04-16T15:37:06.380782+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:06.380782+0000","last_undegraded":"2024-04-16T15:37:06.380782+0000","last_fullsized":"2024-04-16T15:37:06.380782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293242+0000","last_change":"2024-04-16T15:37:02.285892+0000","last_active":"2024-04-16T15:37:04.293242+0000","last_peered":"2024-04-16T15:37:04.293242+0000","last_clean":"2024-04-16T15:37:04.293242+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:04.293242+0000","last_undegraded":"2024-04-16T15:37:04.293242+0000","last_fullsized":"2024-04-16T15:37:04.293242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823831+0000","last_change":"2024-04-16T15:37:03.292907+0000","last_active":"2024-04-16T15:37:06.823831+0000","last_peered":"2024-04-16T15:37:06.823831+0000","last_clean":"2024-04-16T15:37:06.823831+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:06.823831+0000","last_undegraded":"2024-04-16T15:37:06.823831+0000","last_fullsized":"2024-04-16T15:37:06.823831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290921+0000","last_change":"2024-04-16T15:37:02.282598+0000","last_active":"2024-04-16T15:37:04.290921+0000","last_peered":"2024-04-16T15:37:04.290921+0000","last_clean":"2024-04-16T15:37:04.290921+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:04.290921+0000","last_undegraded":"2024-04-16T15:37:04.290921+0000","last_fullsized":"2024-04-16T15:37:04.290921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:30.387266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380546+0000","last_change":"2024-04-16T15:37:03.302340+0000","last_active":"2024-04-16T15:37:06.380546+0000","last_peered":"2024-04-16T15:37:06.380546+0000","last_clean":"2024-04-16T15:37:06.380546+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:06.380546+0000","last_undegraded":"2024-04-16T15:37:06.380546+0000","last_fullsized":"2024-04-16T15:37:06.380546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290984+0000","last_change":"2024-04-16T15:37:02.279679+0000","last_active":"2024-04-16T15:37:04.290984+0000","last_peered":"2024-04-16T15:37:04.290984+0000","last_clean":"2024-04-16T15:37:04.290984+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:04.290984+0000","last_undegraded":"2024-04-16T15:37:04.290984+0000","last_fullsized":"2024-04-16T15:37:04.290984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:42.339075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290517+0000","last_change":"2024-04-16T15:37:03.294103+0000","last_active":"2024-04-16T15:37:04.290517+0000","last_peered":"2024-04-16T15:37:04.290517+0000","last_clean":"2024-04-16T15:37:04.290517+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:04.290517+0000","last_undegraded":"2024-04-16T15:37:04.290517+0000","last_fullsized":"2024-04-16T15:37:04.290517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:34.705636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220905+0000","last_change":"2024-04-16T15:37:02.282716+0000","last_active":"2024-04-16T15:37:06.220905+0000","last_peered":"2024-04-16T15:37:06.220905+0000","last_clean":"2024-04-16T15:37:06.220905+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:06.220905+0000","last_undegraded":"2024-04-16T15:37:06.220905+0000","last_fullsized":"2024-04-16T15:37:06.220905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:47.400033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754906+0000","last_change":"2024-04-16T15:37:03.290945+0000","last_active":"2024-04-16T15:37:05.754906+0000","last_peered":"2024-04-16T15:37:05.754906+0000","last_clean":"2024-04-16T15:37:05.754906+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:05.754906+0000","last_undegraded":"2024-04-16T15:37:05.754906+0000","last_fullsized":"2024-04-16T15:37:05.754906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291740+0000","last_change":"2024-04-16T15:37:02.277471+0000","last_active":"2024-04-16T15:37:04.291740+0000","last_peered":"2024-04-16T15:37:04.291740+0000","last_clean":"2024-04-16T15:37:04.291740+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:04.291740+0000","last_undegraded":"2024-04-16T15:37:04.291740+0000","last_fullsized":"2024-04-16T15:37:04.291740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:40:38.560575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290756+0000","last_change":"2024-04-16T15:37:03.293314+0000","last_active":"2024-04-16T15:37:04.290756+0000","last_peered":"2024-04-16T15:37:04.290756+0000","last_clean":"2024-04-16T15:37:04.290756+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:04.290756+0000","last_undegraded":"2024-04-16T15:37:04.290756+0000","last_fullsized":"2024-04-16T15:37:04.290756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:32.296432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754713+0000","last_change":"2024-04-16T15:37:02.280773+0000","last_active":"2024-04-16T15:37:05.754713+0000","last_peered":"2024-04-16T15:37:05.754713+0000","last_clean":"2024-04-16T15:37:05.754713+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:05.754713+0000","last_undegraded":"2024-04-16T15:37:05.754713+0000","last_fullsized":"2024-04-16T15:37:05.754713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:10:42.862433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290817+0000","last_change":"2024-04-16T15:37:03.291530+0000","last_active":"2024-04-16T15:37:04.290817+0000","last_peered":"2024-04-16T15:37:04.290817+0000","last_clean":"2024-04-16T15:37:04.290817+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:04.290817+0000","last_undegraded":"2024-04-16T15:37:04.290817+0000","last_fullsized":"2024-04-16T15:37:04.290817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:22.796236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293195+0000","last_change":"2024-04-16T15:37:02.274550+0000","last_active":"2024-04-16T15:37:04.293195+0000","last_peered":"2024-04-16T15:37:04.293195+0000","last_clean":"2024-04-16T15:37:04.293195+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:04.293195+0000","last_undegraded":"2024-04-16T15:37:04.293195+0000","last_fullsized":"2024-04-16T15:37:04.293195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:39:56.259463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293264+0000","last_change":"2024-04-16T15:37:03.297313+0000","last_active":"2024-04-16T15:37:04.293264+0000","last_peered":"2024-04-16T15:37:04.293264+0000","last_clean":"2024-04-16T15:37:04.293264+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:04.293264+0000","last_undegraded":"2024-04-16T15:37:04.293264+0000","last_fullsized":"2024-04-16T15:37:04.293264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:20.493591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823967+0000","last_change":"2024-04-16T15:37:02.278848+0000","last_active":"2024-04-16T15:37:06.823967+0000","last_peered":"2024-04-16T15:37:06.823967+0000","last_clean":"2024-04-16T15:37:06.823967+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:06.823967+0000","last_undegraded":"2024-04-16T15:37:06.823967+0000","last_fullsized":"2024-04-16T15:37:06.823967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823846+0000","last_change":"2024-04-16T15:37:03.298435+0000","last_active":"2024-04-16T15:37:06.823846+0000","last_peered":"2024-04-16T15:37:06.823846+0000","last_clean":"2024-04-16T15:37:06.823846+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:06.823846+0000","last_undegraded":"2024-04-16T15:37:06.823846+0000","last_fullsized":"2024-04-16T15:37:06.823846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779417+0000","last_change":"2024-04-16T15:37:02.281750+0000","last_active":"2024-04-16T15:37:04.779417+0000","last_peered":"2024-04-16T15:37:04.779417+0000","last_clean":"2024-04-16T15:37:04.779417+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:04.779417+0000","last_undegraded":"2024-04-16T15:37:04.779417+0000","last_fullsized":"2024-04-16T15:37:04.779417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:07:15.373439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779484+0000","last_change":"2024-04-16T15:37:03.283290+0000","last_active":"2024-04-16T15:37:04.779484+0000","last_peered":"2024-04-16T15:37:04.779484+0000","last_clean":"2024-04-16T15:37:04.779484+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:04.779484+0000","last_undegraded":"2024-04-16T15:37:04.779484+0000","last_fullsized":"2024-04-16T15:37:04.779484+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:34.705861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221004+0000","last_change":"2024-04-16T15:37:02.280780+0000","last_active":"2024-04-16T15:37:06.221004+0000","last_peered":"2024-04-16T15:37:06.221004+0000","last_clean":"2024-04-16T15:37:06.221004+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:06.221004+0000","last_undegraded":"2024-04-16T15:37:06.221004+0000","last_fullsized":"2024-04-16T15:37:06.221004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:00:21.283792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754967+0000","last_change":"2024-04-16T15:37:03.292776+0000","last_active":"2024-04-16T15:37:05.754967+0000","last_peered":"2024-04-16T15:37:05.754967+0000","last_clean":"2024-04-16T15:37:05.754967+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:05.754967+0000","last_undegraded":"2024-04-16T15:37:05.754967+0000","last_fullsized":"2024-04-16T15:37:05.754967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:43.342898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779264+0000","last_change":"2024-04-16T15:37:02.278054+0000","last_active":"2024-04-16T15:37:04.779264+0000","last_peered":"2024-04-16T15:37:04.779264+0000","last_clean":"2024-04-16T15:37:04.779264+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:04.779264+0000","last_undegraded":"2024-04-16T15:37:04.779264+0000","last_fullsized":"2024-04-16T15:37:04.779264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:35:36.707684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380639+0000","last_change":"2024-04-16T15:37:03.300456+0000","last_active":"2024-04-16T15:37:06.380639+0000","last_peered":"2024-04-16T15:37:06.380639+0000","last_clean":"2024-04-16T15:37:06.380639+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:06.380639+0000","last_undegraded":"2024-04-16T15:37:06.380639+0000","last_fullsized":"2024-04-16T15:37:06.380639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779206+0000","last_change":"2024-04-16T15:37:02.280683+0000","last_active":"2024-04-16T15:37:04.779206+0000","last_peered":"2024-04-16T15:37:04.779206+0000","last_clean":"2024-04-16T15:37:04.779206+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:04.779206+0000","last_undegraded":"2024-04-16T15:37:04.779206+0000","last_fullsized":"2024-04-16T15:37:04.779206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:23.264159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.292615+0000","last_change":"2024-04-16T15:37:03.292345+0000","last_active":"2024-04-16T15:37:04.292615+0000","last_peered":"2024-04-16T15:37:04.292615+0000","last_clean":"2024-04-16T15:37:04.292615+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:04.292615+0000","last_undegraded":"2024-04-16T15:37:04.292615+0000","last_fullsized":"2024-04-16T15:37:04.292615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:01.577359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.754853+0000","last_change":"2024-04-16T15:37:02.280021+0000","last_active":"2024-04-16T15:37:05.754853+0000","last_peered":"2024-04-16T15:37:05.754853+0000","last_clean":"2024-04-16T15:37:05.754853+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:05.754853+0000","last_undegraded":"2024-04-16T15:37:05.754853+0000","last_fullsized":"2024-04-16T15:37:05.754853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:32:51.239179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290901+0000","last_change":"2024-04-16T15:37:03.293862+0000","last_active":"2024-04-16T15:37:04.290901+0000","last_peered":"2024-04-16T15:37:04.290901+0000","last_clean":"2024-04-16T15:37:04.290901+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:04.290901+0000","last_undegraded":"2024-04-16T15:37:04.290901+0000","last_fullsized":"2024-04-16T15:37:04.290901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:49.742114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779185+0000","last_change":"2024-04-16T15:37:02.277806+0000","last_active":"2024-04-16T15:37:04.779185+0000","last_peered":"2024-04-16T15:37:04.779185+0000","last_clean":"2024-04-16T15:37:04.779185+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:04.779185+0000","last_undegraded":"2024-04-16T15:37:04.779185+0000","last_fullsized":"2024-04-16T15:37:04.779185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:14:55.285460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.221142+0000","last_change":"2024-04-16T15:37:03.295518+0000","last_active":"2024-04-16T15:37:06.221142+0000","last_peered":"2024-04-16T15:37:06.221142+0000","last_clean":"2024-04-16T15:37:06.221142+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:06.221142+0000","last_undegraded":"2024-04-16T15:37:06.221142+0000","last_fullsized":"2024-04-16T15:37:06.221142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:26:50.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293302+0000","last_change":"2024-04-16T15:37:02.277573+0000","last_active":"2024-04-16T15:37:04.293302+0000","last_peered":"2024-04-16T15:37:04.293302+0000","last_clean":"2024-04-16T15:37:04.293302+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:04.293302+0000","last_undegraded":"2024-04-16T15:37:04.293302+0000","last_fullsized":"2024-04-16T15:37:04.293302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:11:11.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755206+0000","last_change":"2024-04-16T15:37:03.291058+0000","last_active":"2024-04-16T15:37:05.755206+0000","last_peered":"2024-04-16T15:37:05.755206+0000","last_clean":"2024-04-16T15:37:05.755206+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:05.755206+0000","last_undegraded":"2024-04-16T15:37:05.755206+0000","last_fullsized":"2024-04-16T15:37:05.755206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:40.793352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.779394+0000","last_change":"2024-04-16T15:37:02.275466+0000","last_active":"2024-04-16T15:37:04.779394+0000","last_peered":"2024-04-16T15:37:04.779394+0000","last_clean":"2024-04-16T15:37:04.779394+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:04.779394+0000","last_undegraded":"2024-04-16T15:37:04.779394+0000","last_fullsized":"2024-04-16T15:37:04.779394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:56:03.277745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290880+0000","last_change":"2024-04-16T15:37:03.290946+0000","last_active":"2024-04-16T15:37:04.290880+0000","last_peered":"2024-04-16T15:37:04.290880+0000","last_clean":"2024-04-16T15:37:04.290880+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:04.290880+0000","last_undegraded":"2024-04-16T15:37:04.290880+0000","last_fullsized":"2024-04-16T15:37:04.290880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:10.040747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380705+0000","last_change":"2024-04-16T15:37:02.286112+0000","last_active":"2024-04-16T15:37:06.380705+0000","last_peered":"2024-04-16T15:37:06.380705+0000","last_clean":"2024-04-16T15:37:06.380705+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:06.380705+0000","last_undegraded":"2024-04-16T15:37:06.380705+0000","last_fullsized":"2024-04-16T15:37:06.380705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:40.159335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380706+0000","last_change":"2024-04-16T15:37:03.294824+0000","last_active":"2024-04-16T15:37:06.380706+0000","last_peered":"2024-04-16T15:37:06.380706+0000","last_clean":"2024-04-16T15:37:06.380706+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:06.380706+0000","last_undegraded":"2024-04-16T15:37:06.380706+0000","last_fullsized":"2024-04-16T15:37:06.380706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:31.391089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.380811+0000","last_change":"2024-04-16T15:37:02.278160+0000","last_active":"2024-04-16T15:37:06.380811+0000","last_peered":"2024-04-16T15:37:06.380811+0000","last_clean":"2024-04-16T15:37:06.380811+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:06.380811+0000","last_undegraded":"2024-04-16T15:37:06.380811+0000","last_fullsized":"2024-04-16T15:37:06.380811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:33.702037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.220921+0000","last_change":"2024-04-16T15:37:03.289805+0000","last_active":"2024-04-16T15:37:06.220921+0000","last_peered":"2024-04-16T15:37:06.220921+0000","last_clean":"2024-04-16T15:37:06.220921+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:06.220921+0000","last_undegraded":"2024-04-16T15:37:06.220921+0000","last_fullsized":"2024-04-16T15:37:06.220921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:15.101995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.291887+0000","last_change":"2024-04-16T15:37:02.275748+0000","last_active":"2024-04-16T15:37:04.291887+0000","last_peered":"2024-04-16T15:37:04.291887+0000","last_clean":"2024-04-16T15:37:04.291887+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:04.291887+0000","last_undegraded":"2024-04-16T15:37:04.291887+0000","last_fullsized":"2024-04-16T15:37:04.291887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:56:38.050000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823486+0000","last_change":"2024-04-16T15:37:03.292487+0000","last_active":"2024-04-16T15:37:06.823486+0000","last_peered":"2024-04-16T15:37:06.823486+0000","last_clean":"2024-04-16T15:37:06.823486+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:06.823486+0000","last_undegraded":"2024-04-16T15:37:06.823486+0000","last_fullsized":"2024-04-16T15:37:06.823486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:29.366733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:06.823322+0000","last_change":"2024-04-16T15:37:02.279240+0000","last_active":"2024-04-16T15:37:06.823322+0000","last_peered":"2024-04-16T15:37:06.823322+0000","last_clean":"2024-04-16T15:37:06.823322+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:06.823322+0000","last_undegraded":"2024-04-16T15:37:06.823322+0000","last_fullsized":"2024-04-16T15:37:06.823322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:46:13.056229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755189+0000","last_change":"2024-04-16T15:37:03.288638+0000","last_active":"2024-04-16T15:37:05.755189+0000","last_peered":"2024-04-16T15:37:05.755189+0000","last_clean":"2024-04-16T15:37:05.755189+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:05.755189+0000","last_undegraded":"2024-04-16T15:37:05.755189+0000","last_fullsized":"2024-04-16T15:37:05.755189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:57.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.290460+0000","last_change":"2024-04-16T15:37:02.285191+0000","last_active":"2024-04-16T15:37:04.290460+0000","last_peered":"2024-04-16T15:37:04.290460+0000","last_clean":"2024-04-16T15:37:04.290460+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:04.290460+0000","last_undegraded":"2024-04-16T15:37:04.290460+0000","last_fullsized":"2024-04-16T15:37:04.290460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:59:56.459106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:04.293134+0000","last_change":"2024-04-16T15:37:03.297459+0000","last_active":"2024-04-16T15:37:04.293134+0000","last_peered":"2024-04-16T15:37:04.293134+0000","last_clean":"2024-04-16T15:37:04.293134+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:04.293134+0000","last_undegraded":"2024-04-16T15:37:04.293134+0000","last_fullsized":"2024-04-16T15:37:04.293134+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:02.257211+0000","last_clean_scrub_stamp":"2024-04-16T15:37:02.257211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:17.778615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755068+0000","last_change":"2024-04-16T15:37:02.284965+0000","last_active":"2024-04-16T15:37:05.755068+0000","last_peered":"2024-04-16T15:37:05.755068+0000","last_clean":"2024-04-16T15:37:05.755068+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:05.755068+0000","last_undegraded":"2024-04-16T15:37:05.755068+0000","last_fullsized":"2024-04-16T15:37:05.755068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:01.253388+0000","last_clean_scrub_stamp":"2024-04-16T15:37:01.253388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:42:28.462927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-16T15:37:05.755094+0000","last_change":"2024-04-16T15:35:36.322728+0000","last_active":"2024-04-16T15:37:05.755094+0000","last_peered":"2024-04-16T15:37:05.755094+0000","last_clean":"2024-04-16T15:37:05.755094+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:05.755094+0000","last_undegraded":"2024-04-16T15:37:05.755094+0000","last_fullsized":"2024-04-16T15:37:05.755094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:35:35.191398+0000","last_clean_scrub_stamp":"2024-04-16T15:35:35.191398+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:58.716218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":789223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":197285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":198819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":197243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":197263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":787575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:19.072 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.072 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.073 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.074 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.075 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.076 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.077 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.078 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.079 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.080 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.081 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.081 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.081 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.081 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.082 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.083 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.084 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.085 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.086 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.087 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T15:37:02.257211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=2, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.088 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T15:37:01.253388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.088 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T15:35:35.191398+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=35, tm_sec=35, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=14, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T15:37:19.088 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T15:37:20.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-04-16T15:37:22.816 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-16T15:37:22.818+0000 7f5d54c2e640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T15:37:27.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-04-16T15:37:28.255 INFO:tasks.ceph.mds.c.smithi080.stderr:2024-04-16T15:37:28.257+0000 7f5d58c36640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T15:37:33.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2024-04-16T15:37:39.089 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T15:37:39.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.204+0000 7fd9cc2e0640 1 Processor -- start 2024-04-16T15:37:39.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.205+0000 7fd9cc2e0640 1 -- start start 2024-04-16T15:37:39.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9cc2e0640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9c40d1450 0x7fd9c415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9cc2e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9cc2e0640 1 -- --> v1:172.21.15.80:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c40cfeb0 con 0x7fd9c4163350 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9cc2e0640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c4162900 con 0x7fd9c40d1450 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9cc2e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c4162ec0 con 0x7fd9c415ef80 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca07c640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7fd9c40d1450 0x7fd9c415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca87d640 1 --1- >> v1:172.21.15.80:6789/0 conn(0x7fd9c4163350 0x7fd9c40d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.80:6789/0 says I am v1:172.21.15.80:59690/0 (socket says 172.21.15.80:59690) 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca87d640 1 -- 172.21.15.80:0/3806803428 learned_addr learned my addr 172.21.15.80:0/3806803428 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:39.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca07c640 1 -- 172.21.15.80:0/3806803428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 msgr2=0x7fd9c40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca07c640 1 --2- 172.21.15.80:0/3806803428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca07c640 1 -- 172.21.15.80:0/3806803428 >> v1:172.21.15.80:6789/0 conn(0x7fd9c4163350 legacy=0x7fd9c40d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9ca07c640 1 -- 172.21.15.80:0/3806803428 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c40d0190 con 0x7fd9c40d1450 2024-04-16T15:37:39.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.206+0000 7fd9c907a640 1 -- 172.21.15.80:0/3806803428 <== mon.0 v1:172.21.15.80:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634489707 0 0) 0x7fd9c40cfeb0 con 0x7fd9c4163350 2024-04-16T15:37:39.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9ca07c640 1 --2- 172.21.15.80:0/3806803428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c40d1450 0x7fd9c415fe60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40097a0 tx=0x7fd9b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9237c031cb7985fb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9c907a640 1 -- 172.21.15.80:0/3806803428 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40315a0 con 0x7fd9c40d1450 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9c907a640 1 -- 172.21.15.80:0/3806803428 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b4037070 con 0x7fd9c40d1450 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9c907a640 1 -- 172.21.15.80:0/3806803428 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4031960 con 0x7fd9c40d1450 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3806803428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c40d1450 msgr2=0x7fd9c415fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.207+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3806803428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c40d1450 0x7fd9c415fe60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40097a0 tx=0x7fd9b402b840 comp rx=0 tx=0).stop 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3806803428 shutdown_connections 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3806803428 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3806803428 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c40d1450 0x7fd9c415fe60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3806803428 >> 172.21.15.80:0/3806803428 conn(0x7fd9c406ce20 msgr2=0x7fd9c406d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3806803428 shutdown_connections 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.208+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3806803428 wait complete. 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.209+0000 7fd9cc2e0640 1 Processor -- start 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.209+0000 7fd9cc2e0640 1 -- start start 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9c40d1450 0x7fd9c41eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c4145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.211 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c40d2ff0 con 0x7fd9c4163350 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c41637c0 con 0x7fd9c40d1450 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c40d3170 con 0x7fd9c415ef80 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40276/0 (socket says 172.21.15.80:40276) 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 -- 172.21.15.80:0/3772612067 learned_addr learned my addr 172.21.15.80:0/3772612067 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca07c640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9c40d1450 0x7fd9c41eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9c987b640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c4145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 -- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 msgr2=0x7fd9c4145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c4145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 -- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9c40d1450 msgr2=0x7fd9c41eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9c40d1450 0x7fd9c41eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 -- 172.21.15.80:0/3772612067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c40cbcf0 con 0x7fd9c4163350 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9ca87d640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c730 tx=0x7fd9bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc018070 con 0x7fd9c4163350 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc00ce40 con 0x7fd9c4163350 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c40c9cb0 con 0x7fd9c4163350 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc00a860 con 0x7fd9c4163350 2024-04-16T15:37:39.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.210+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c40ca270 con 0x7fd9c4163350 2024-04-16T15:37:39.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.211+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c41eb690 con 0x7fd9c4163350 2024-04-16T15:37:39.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.212+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9bc01b070 con 0x7fd9c4163350 2024-04-16T15:37:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.212+0000 7fd9baffd640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 0x7fd9a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.212+0000 7fd9ca07c640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 0x7fd9a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.213+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fd9bc08b350 con 0x7fd9c4163350 2024-04-16T15:37:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.213+0000 7fd9ca07c640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 0x7fd9a806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4036000 tx=0x7fd9b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.217+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9bc059580 con 0x7fd9c4163350 2024-04-16T15:37:39.389 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.391+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 --> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9c4068a40 con 0x7fd9a806c8f0 2024-04-16T15:37:39.395 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.396+0000 7fd9baffd640 1 -- 172.21.15.80:0/3772612067 <== mgr.4107 v2:172.21.15.80:6832/1620343397 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251894 (secure 0 0 0) 0x7fd9c4068a40 con 0x7fd9a806c8f0 2024-04-16T15:37:39.398 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:39.399 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-04-16T15:37:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 msgr2=0x7fd9a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 0x7fd9a806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4036000 tx=0x7fd9b4008030 comp rx=0 tx=0).stop 2024-04-16T15:37:39.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 msgr2=0x7fd9c4145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c730 tx=0x7fd9bc00cbf0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 shutdown_connections 2024-04-16T15:37:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.399+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9c4163350 0x7fd9c4145fb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7fd9a806c8f0 0x7fd9a806edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7fd9c415ef80 0x7fd9c4145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 --2- 172.21.15.80:0/3772612067 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9c40d1450 0x7fd9c41eb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 >> 172.21.15.80:0/3772612067 conn(0x7fd9c406ce20 msgr2=0x7fd9c40b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 shutdown_connections 2024-04-16T15:37:39.403 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.400+0000 7fd9cc2e0640 1 -- 172.21.15.80:0/3772612067 wait complete. 2024-04-16T15:37:39.409 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-16T15:37:39.181856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221188,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753532,"statfs":{"total":773094113280,"available":772867616768,"internally_reserved":0,"allocated":5152768,"data_stored":2917676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":70,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002578"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.582008+0000","last_change":"2024-04-16T15:37:27.337220+0000","last_active":"2024-04-16T15:37:29.582008+0000","last_peered":"2024-04-16T15:37:29.582008+0000","last_clean":"2024-04-16T15:37:29.582008+0000","last_became_active":"2024-04-16T15:37:03.293532+0000","last_became_peered":"2024-04-16T15:37:03.293532+0000","last_unstale":"2024-04-16T15:37:29.582008+0000","last_undegraded":"2024-04-16T15:37:29.582008+0000","last_fullsized":"2024-04-16T15:37:29.582008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:27.337069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:27.337069+0000","last_clean_scrub_stamp":"2024-04-16T15:37:27.337069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:47.720556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581797+0000","last_change":"2024-04-16T15:37:21.446284+0000","last_active":"2024-04-16T15:37:29.581797+0000","last_peered":"2024-04-16T15:37:29.581797+0000","last_clean":"2024-04-16T15:37:29.581797+0000","last_became_active":"2024-04-16T15:37:03.287223+0000","last_became_peered":"2024-04-16T15:37:03.287223+0000","last_unstale":"2024-04-16T15:37:29.581797+0000","last_undegraded":"2024-04-16T15:37:29.581797+0000","last_fullsized":"2024-04-16T15:37:29.581797+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:21.446176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:21.446176+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.446176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:52:40.696837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580846+0000","last_change":"2024-04-16T15:37:25.807083+0000","last_active":"2024-04-16T15:37:29.580846+0000","last_peered":"2024-04-16T15:37:29.580846+0000","last_clean":"2024-04-16T15:37:29.580846+0000","last_became_active":"2024-04-16T15:37:03.302002+0000","last_became_peered":"2024-04-16T15:37:03.302002+0000","last_unstale":"2024-04-16T15:37:29.580846+0000","last_undegraded":"2024-04-16T15:37:29.580846+0000","last_fullsized":"2024-04-16T15:37:29.580846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.806945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.806945+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.806945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:12.448793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580905+0000","last_change":"2024-04-16T15:37:25.438436+0000","last_active":"2024-04-16T15:37:29.580905+0000","last_peered":"2024-04-16T15:37:29.580905+0000","last_clean":"2024-04-16T15:37:29.580905+0000","last_became_active":"2024-04-16T15:37:03.290299+0000","last_became_peered":"2024-04-16T15:37:03.290299+0000","last_unstale":"2024-04-16T15:37:29.580905+0000","last_undegraded":"2024-04-16T15:37:29.580905+0000","last_fullsized":"2024-04-16T15:37:29.580905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.438326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.438326+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.438326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:24.758474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580428+0000","last_change":"2024-04-16T15:37:26.393356+0000","last_active":"2024-04-16T15:37:29.580428+0000","last_peered":"2024-04-16T15:37:29.580428+0000","last_clean":"2024-04-16T15:37:29.580428+0000","last_became_active":"2024-04-16T15:37:03.292009+0000","last_became_peered":"2024-04-16T15:37:03.292009+0000","last_unstale":"2024-04-16T15:37:29.580428+0000","last_undegraded":"2024-04-16T15:37:29.580428+0000","last_fullsized":"2024-04-16T15:37:29.580428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.393219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.393219+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.393219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:05:03.020533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363039+0000","last_change":"2024-04-16T15:37:20.593113+0000","last_active":"2024-04-16T15:37:29.363039+0000","last_peered":"2024-04-16T15:37:29.363039+0000","last_clean":"2024-04-16T15:37:29.363039+0000","last_became_active":"2024-04-16T15:37:03.287540+0000","last_became_peered":"2024-04-16T15:37:03.287540+0000","last_unstale":"2024-04-16T15:37:29.363039+0000","last_undegraded":"2024-04-16T15:37:29.363039+0000","last_fullsized":"2024-04-16T15:37:29.363039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.592968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.592968+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.592968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:42.229858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363732+0000","last_change":"2024-04-16T15:37:28.378072+0000","last_active":"2024-04-16T15:37:29.363732+0000","last_peered":"2024-04-16T15:37:29.363732+0000","last_clean":"2024-04-16T15:37:29.363732+0000","last_became_active":"2024-04-16T15:37:03.296199+0000","last_became_peered":"2024-04-16T15:37:03.296199+0000","last_unstale":"2024-04-16T15:37:29.363732+0000","last_undegraded":"2024-04-16T15:37:29.363732+0000","last_fullsized":"2024-04-16T15:37:29.363732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:28.377925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:28.377925+0000","last_clean_scrub_stamp":"2024-04-16T15:37:28.377925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:32.197904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580346+0000","last_change":"2024-04-16T15:37:24.415755+0000","last_active":"2024-04-16T15:37:29.580346+0000","last_peered":"2024-04-16T15:37:29.580346+0000","last_clean":"2024-04-16T15:37:29.580346+0000","last_became_active":"2024-04-16T15:37:03.290780+0000","last_became_peered":"2024-04-16T15:37:03.290780+0000","last_unstale":"2024-04-16T15:37:29.580346+0000","last_undegraded":"2024-04-16T15:37:29.580346+0000","last_fullsized":"2024-04-16T15:37:29.580346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.415642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.415642+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.415642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:10.966584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581630+0000","last_change":"2024-04-16T15:37:23.823742+0000","last_active":"2024-04-16T15:37:29.581630+0000","last_peered":"2024-04-16T15:37:29.581630+0000","last_clean":"2024-04-16T15:37:29.581630+0000","last_became_active":"2024-04-16T15:37:03.301327+0000","last_became_peered":"2024-04-16T15:37:03.301327+0000","last_unstale":"2024-04-16T15:37:29.581630+0000","last_undegraded":"2024-04-16T15:37:29.581630+0000","last_fullsized":"2024-04-16T15:37:29.581630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.823625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.823625+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.823625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:03.136455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364186+0000","last_change":"2024-04-16T15:37:29.360844+0000","last_active":"2024-04-16T15:37:29.364186+0000","last_peered":"2024-04-16T15:37:29.364186+0000","last_clean":"2024-04-16T15:37:29.364186+0000","last_became_active":"2024-04-16T15:37:03.296707+0000","last_became_peered":"2024-04-16T15:37:03.296707+0000","last_unstale":"2024-04-16T15:37:29.364186+0000","last_undegraded":"2024-04-16T15:37:29.364186+0000","last_fullsized":"2024-04-16T15:37:29.364186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:29.360720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:29.360720+0000","last_clean_scrub_stamp":"2024-04-16T15:37:29.360720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:15.911662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364243+0000","last_change":"2024-04-16T15:37:26.439657+0000","last_active":"2024-04-16T15:37:29.364243+0000","last_peered":"2024-04-16T15:37:29.364243+0000","last_clean":"2024-04-16T15:37:29.364243+0000","last_became_active":"2024-04-16T15:37:03.295522+0000","last_became_peered":"2024-04-16T15:37:03.295522+0000","last_unstale":"2024-04-16T15:37:29.364243+0000","last_undegraded":"2024-04-16T15:37:29.364243+0000","last_fullsized":"2024-04-16T15:37:29.364243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.439532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.439532+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.439532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:52:45.690192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580903+0000","last_change":"2024-04-16T15:37:18.790478+0000","last_active":"2024-04-16T15:37:29.580903+0000","last_peered":"2024-04-16T15:37:29.580903+0000","last_clean":"2024-04-16T15:37:29.580903+0000","last_became_active":"2024-04-16T15:37:03.292421+0000","last_became_peered":"2024-04-16T15:37:03.292421+0000","last_unstale":"2024-04-16T15:37:29.580903+0000","last_undegraded":"2024-04-16T15:37:29.580903+0000","last_fullsized":"2024-04-16T15:37:29.580903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:18.790341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:18.790341+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.790341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:09:01.521285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:33.468403+0000","last_change":"2024-04-16T15:37:33.468438+0000","last_active":"2024-04-16T15:37:33.468403+0000","last_peered":"2024-04-16T15:37:33.468403+0000","last_clean":"2024-04-16T15:37:33.468403+0000","last_became_active":"2024-04-16T15:37:03.298726+0000","last_became_peered":"2024-04-16T15:37:03.298726+0000","last_unstale":"2024-04-16T15:37:33.468403+0000","last_undegraded":"2024-04-16T15:37:33.468403+0000","last_fullsized":"2024-04-16T15:37:33.468403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:33.468314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:33.468314+0000","last_clean_scrub_stamp":"2024-04-16T15:37:33.468314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:06.760681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580085+0000","last_change":"2024-04-16T15:37:25.385610+0000","last_active":"2024-04-16T15:37:29.580085+0000","last_peered":"2024-04-16T15:37:29.580085+0000","last_clean":"2024-04-16T15:37:29.580085+0000","last_became_active":"2024-04-16T15:37:03.294926+0000","last_became_peered":"2024-04-16T15:37:03.294926+0000","last_unstale":"2024-04-16T15:37:29.580085+0000","last_undegraded":"2024-04-16T15:37:29.580085+0000","last_fullsized":"2024-04-16T15:37:29.580085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.385500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.385500+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.385500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:04.698330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363776+0000","last_change":"2024-04-16T15:37:23.353004+0000","last_active":"2024-04-16T15:37:29.363776+0000","last_peered":"2024-04-16T15:37:29.363776+0000","last_clean":"2024-04-16T15:37:29.363776+0000","last_became_active":"2024-04-16T15:37:03.290579+0000","last_became_peered":"2024-04-16T15:37:03.290579+0000","last_unstale":"2024-04-16T15:37:29.363776+0000","last_undegraded":"2024-04-16T15:37:29.363776+0000","last_fullsized":"2024-04-16T15:37:29.363776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.352887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.352887+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.352887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:09.994735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.583036+0000","last_change":"2024-04-16T15:37:29.583036+0000","last_active":"2024-04-16T15:37:29.583036+0000","last_peered":"2024-04-16T15:37:29.583036+0000","last_clean":"2024-04-16T15:37:29.583036+0000","last_became_active":"2024-04-16T15:37:29.582718+0000","last_became_peered":"2024-04-16T15:37:29.582718+0000","last_unstale":"2024-04-16T15:37:29.583036+0000","last_undegraded":"2024-04-16T15:37:29.583036+0000","last_fullsized":"2024-04-16T15:37:29.583036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.404642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.404642+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.404642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:11.046490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:32.233059+0000","last_change":"2024-04-16T15:37:32.233102+0000","last_active":"2024-04-16T15:37:32.233059+0000","last_peered":"2024-04-16T15:37:32.233059+0000","last_clean":"2024-04-16T15:37:32.233059+0000","last_became_active":"2024-04-16T15:37:03.294888+0000","last_became_peered":"2024-04-16T15:37:03.294888+0000","last_unstale":"2024-04-16T15:37:32.233059+0000","last_undegraded":"2024-04-16T15:37:32.233059+0000","last_fullsized":"2024-04-16T15:37:32.233059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:32.232938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:32.232938+0000","last_clean_scrub_stamp":"2024-04-16T15:37:32.232938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:27:20.531533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364612+0000","last_change":"2024-04-16T15:37:24.451345+0000","last_active":"2024-04-16T15:37:29.364612+0000","last_peered":"2024-04-16T15:37:29.364612+0000","last_clean":"2024-04-16T15:37:29.364612+0000","last_became_active":"2024-04-16T15:37:03.289904+0000","last_became_peered":"2024-04-16T15:37:03.289904+0000","last_unstale":"2024-04-16T15:37:29.364612+0000","last_undegraded":"2024-04-16T15:37:29.364612+0000","last_fullsized":"2024-04-16T15:37:29.364612+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.451239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.451239+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.451239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:42.687618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580761+0000","last_change":"2024-04-16T15:37:23.473210+0000","last_active":"2024-04-16T15:37:29.580761+0000","last_peered":"2024-04-16T15:37:29.580761+0000","last_clean":"2024-04-16T15:37:29.580761+0000","last_became_active":"2024-04-16T15:37:03.288103+0000","last_became_peered":"2024-04-16T15:37:03.288103+0000","last_unstale":"2024-04-16T15:37:29.580761+0000","last_undegraded":"2024-04-16T15:37:29.580761+0000","last_fullsized":"2024-04-16T15:37:29.580761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.473093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.473093+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.473093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:27:02.009234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364239+0000","last_change":"2024-04-16T15:37:25.460010+0000","last_active":"2024-04-16T15:37:29.364239+0000","last_peered":"2024-04-16T15:37:29.364239+0000","last_clean":"2024-04-16T15:37:29.364239+0000","last_became_active":"2024-04-16T15:37:03.293438+0000","last_became_peered":"2024-04-16T15:37:03.293438+0000","last_unstale":"2024-04-16T15:37:29.364239+0000","last_undegraded":"2024-04-16T15:37:29.364239+0000","last_fullsized":"2024-04-16T15:37:29.364239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.459882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.459882+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.459882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:57.908307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363952+0000","last_change":"2024-04-16T15:37:27.405111+0000","last_active":"2024-04-16T15:37:29.363952+0000","last_peered":"2024-04-16T15:37:29.363952+0000","last_clean":"2024-04-16T15:37:29.363952+0000","last_became_active":"2024-04-16T15:37:03.291948+0000","last_became_peered":"2024-04-16T15:37:03.291948+0000","last_unstale":"2024-04-16T15:37:29.363952+0000","last_undegraded":"2024-04-16T15:37:29.363952+0000","last_fullsized":"2024-04-16T15:37:29.363952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:27.404991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:27.404991+0000","last_clean_scrub_stamp":"2024-04-16T15:37:27.404991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:05:35.376548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580532+0000","last_change":"2024-04-16T15:37:24.359164+0000","last_active":"2024-04-16T15:37:29.580532+0000","last_peered":"2024-04-16T15:37:29.580532+0000","last_clean":"2024-04-16T15:37:29.580532+0000","last_became_active":"2024-04-16T15:37:03.293283+0000","last_became_peered":"2024-04-16T15:37:03.293283+0000","last_unstale":"2024-04-16T15:37:29.580532+0000","last_undegraded":"2024-04-16T15:37:29.580532+0000","last_fullsized":"2024-04-16T15:37:29.580532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.359048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.359048+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.359048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:44.596962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.365974+0000","last_change":"2024-04-16T15:37:29.242043+0000","last_active":"2024-04-16T15:37:29.365974+0000","last_peered":"2024-04-16T15:37:29.365974+0000","last_clean":"2024-04-16T15:37:29.365974+0000","last_became_active":"2024-04-16T15:37:03.291587+0000","last_became_peered":"2024-04-16T15:37:03.291587+0000","last_unstale":"2024-04-16T15:37:29.365974+0000","last_undegraded":"2024-04-16T15:37:29.365974+0000","last_fullsized":"2024-04-16T15:37:29.365974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:29.241924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:29.241924+0000","last_clean_scrub_stamp":"2024-04-16T15:37:29.241924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:57.962296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580369+0000","last_change":"2024-04-16T15:37:27.423992+0000","last_active":"2024-04-16T15:37:29.580369+0000","last_peered":"2024-04-16T15:37:29.580369+0000","last_clean":"2024-04-16T15:37:29.580369+0000","last_became_active":"2024-04-16T15:37:03.294526+0000","last_became_peered":"2024-04-16T15:37:03.294526+0000","last_unstale":"2024-04-16T15:37:29.580369+0000","last_undegraded":"2024-04-16T15:37:29.580369+0000","last_fullsized":"2024-04-16T15:37:29.580369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:27.423802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:27.423802+0000","last_clean_scrub_stamp":"2024-04-16T15:37:27.423802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:27.423597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364638+0000","last_change":"2024-04-16T15:37:26.509149+0000","last_active":"2024-04-16T15:37:29.364638+0000","last_peered":"2024-04-16T15:37:29.364638+0000","last_clean":"2024-04-16T15:37:29.364638+0000","last_became_active":"2024-04-16T15:37:03.294109+0000","last_became_peered":"2024-04-16T15:37:03.294109+0000","last_unstale":"2024-04-16T15:37:29.364638+0000","last_undegraded":"2024-04-16T15:37:29.364638+0000","last_fullsized":"2024-04-16T15:37:29.364638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.509045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.509045+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.509045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:48.145935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363374+0000","last_change":"2024-04-16T15:37:24.623922+0000","last_active":"2024-04-16T15:37:29.363374+0000","last_peered":"2024-04-16T15:37:29.363374+0000","last_clean":"2024-04-16T15:37:29.363374+0000","last_became_active":"2024-04-16T15:37:03.295830+0000","last_became_peered":"2024-04-16T15:37:03.295830+0000","last_unstale":"2024-04-16T15:37:29.363374+0000","last_undegraded":"2024-04-16T15:37:29.363374+0000","last_fullsized":"2024-04-16T15:37:29.363374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.623782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.623782+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.623782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:42.131752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364464+0000","last_change":"2024-04-16T15:37:21.483354+0000","last_active":"2024-04-16T15:37:29.364464+0000","last_peered":"2024-04-16T15:37:29.364464+0000","last_clean":"2024-04-16T15:37:29.364464+0000","last_became_active":"2024-04-16T15:37:03.283190+0000","last_became_peered":"2024-04-16T15:37:03.283190+0000","last_unstale":"2024-04-16T15:37:29.364464+0000","last_undegraded":"2024-04-16T15:37:29.364464+0000","last_fullsized":"2024-04-16T15:37:29.364464+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:21.483260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:21.483260+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.483260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:20:12.184319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:31.393276+0000","last_change":"2024-04-16T15:37:31.393317+0000","last_active":"2024-04-16T15:37:31.393276+0000","last_peered":"2024-04-16T15:37:31.393276+0000","last_clean":"2024-04-16T15:37:31.393276+0000","last_became_active":"2024-04-16T15:37:03.297031+0000","last_became_peered":"2024-04-16T15:37:03.297031+0000","last_unstale":"2024-04-16T15:37:31.393276+0000","last_undegraded":"2024-04-16T15:37:31.393276+0000","last_fullsized":"2024-04-16T15:37:31.393276+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:31.393174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:31.393174+0000","last_clean_scrub_stamp":"2024-04-16T15:37:31.393174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:18:36.085753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364064+0000","last_change":"2024-04-16T15:37:23.462544+0000","last_active":"2024-04-16T15:37:29.364064+0000","last_peered":"2024-04-16T15:37:29.364064+0000","last_clean":"2024-04-16T15:37:29.364064+0000","last_became_active":"2024-04-16T15:37:03.286848+0000","last_became_peered":"2024-04-16T15:37:03.286848+0000","last_unstale":"2024-04-16T15:37:29.364064+0000","last_undegraded":"2024-04-16T15:37:29.364064+0000","last_fullsized":"2024-04-16T15:37:29.364064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.462437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.462437+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.462437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:05:00.089751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363703+0000","last_change":"2024-04-16T15:37:22.439123+0000","last_active":"2024-04-16T15:37:29.363703+0000","last_peered":"2024-04-16T15:37:29.363703+0000","last_clean":"2024-04-16T15:37:29.363703+0000","last_became_active":"2024-04-16T15:37:03.284198+0000","last_became_peered":"2024-04-16T15:37:03.284198+0000","last_unstale":"2024-04-16T15:37:29.363703+0000","last_undegraded":"2024-04-16T15:37:29.363703+0000","last_fullsized":"2024-04-16T15:37:29.363703+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.439022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.439022+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.439022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:01.163814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:30.240517+0000","last_change":"2024-04-16T15:37:30.240540+0000","last_active":"2024-04-16T15:37:30.240517+0000","last_peered":"2024-04-16T15:37:30.240517+0000","last_clean":"2024-04-16T15:37:30.240517+0000","last_became_active":"2024-04-16T15:37:03.292075+0000","last_became_peered":"2024-04-16T15:37:03.292075+0000","last_unstale":"2024-04-16T15:37:30.240517+0000","last_undegraded":"2024-04-16T15:37:30.240517+0000","last_fullsized":"2024-04-16T15:37:30.240517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:30.240435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:30.240435+0000","last_clean_scrub_stamp":"2024-04-16T15:37:30.240435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:28:50.170968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363044+0000","last_change":"2024-04-16T15:37:22.553473+0000","last_active":"2024-04-16T15:37:29.363044+0000","last_peered":"2024-04-16T15:37:29.363044+0000","last_clean":"2024-04-16T15:37:29.363044+0000","last_became_active":"2024-04-16T15:37:03.294860+0000","last_became_peered":"2024-04-16T15:37:03.294860+0000","last_unstale":"2024-04-16T15:37:29.363044+0000","last_undegraded":"2024-04-16T15:37:29.363044+0000","last_fullsized":"2024-04-16T15:37:29.363044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.553367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.553367+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.553367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:42.791281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:33.211275+0000","last_change":"2024-04-16T15:37:33.211299+0000","last_active":"2024-04-16T15:37:33.211275+0000","last_peered":"2024-04-16T15:37:33.211275+0000","last_clean":"2024-04-16T15:37:33.211275+0000","last_became_active":"2024-04-16T15:37:03.294933+0000","last_became_peered":"2024-04-16T15:37:03.294933+0000","last_unstale":"2024-04-16T15:37:33.211275+0000","last_undegraded":"2024-04-16T15:37:33.211275+0000","last_fullsized":"2024-04-16T15:37:33.211275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:33.211167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:33.211167+0000","last_clean_scrub_stamp":"2024-04-16T15:37:33.211167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:20:29.089141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'5","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364746+0000","last_change":"2024-04-16T15:37:20.474048+0000","last_active":"2024-04-16T15:37:29.364746+0000","last_peered":"2024-04-16T15:37:29.364746+0000","last_clean":"2024-04-16T15:37:29.364746+0000","last_became_active":"2024-04-16T15:37:02.278576+0000","last_became_peered":"2024-04-16T15:37:02.278576+0000","last_unstale":"2024-04-16T15:37:29.364746+0000","last_undegraded":"2024-04-16T15:37:29.364746+0000","last_fullsized":"2024-04-16T15:37:29.364746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-16T15:37:20.473917+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-16T15:37:20.473917+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.473917+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:27:53.762602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363334+0000","last_change":"2024-04-16T15:37:25.593030+0000","last_active":"2024-04-16T15:37:29.363334+0000","last_peered":"2024-04-16T15:37:29.363334+0000","last_clean":"2024-04-16T15:37:29.363334+0000","last_became_active":"2024-04-16T15:37:03.300054+0000","last_became_peered":"2024-04-16T15:37:03.300054+0000","last_unstale":"2024-04-16T15:37:29.363334+0000","last_undegraded":"2024-04-16T15:37:29.363334+0000","last_fullsized":"2024-04-16T15:37:29.363334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.592882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.592882+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.592882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:54.313254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581504+0000","last_change":"2024-04-16T15:37:16.851792+0000","last_active":"2024-04-16T15:37:29.581504+0000","last_peered":"2024-04-16T15:37:29.581504+0000","last_clean":"2024-04-16T15:37:29.581504+0000","last_became_active":"2024-04-16T15:37:02.281184+0000","last_became_peered":"2024-04-16T15:37:02.281184+0000","last_unstale":"2024-04-16T15:37:29.581504+0000","last_undegraded":"2024-04-16T15:37:29.581504+0000","last_fullsized":"2024-04-16T15:37:29.581504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T15:37:16.851699+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T15:37:16.851699+0000","last_clean_scrub_stamp":"2024-04-16T15:37:16.851699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:04:53.479013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580455+0000","last_change":"2024-04-16T15:37:26.428552+0000","last_active":"2024-04-16T15:37:29.580455+0000","last_peered":"2024-04-16T15:37:29.580455+0000","last_clean":"2024-04-16T15:37:29.580455+0000","last_became_active":"2024-04-16T15:37:03.295472+0000","last_became_peered":"2024-04-16T15:37:03.295472+0000","last_unstale":"2024-04-16T15:37:29.580455+0000","last_undegraded":"2024-04-16T15:37:29.580455+0000","last_fullsized":"2024-04-16T15:37:29.580455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.428447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.428447+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.428447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:43.936417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363445+0000","last_change":"2024-04-16T15:37:17.628440+0000","last_active":"2024-04-16T15:37:29.363445+0000","last_peered":"2024-04-16T15:37:29.363445+0000","last_clean":"2024-04-16T15:37:29.363445+0000","last_became_active":"2024-04-16T15:37:02.281270+0000","last_became_peered":"2024-04-16T15:37:02.281270+0000","last_unstale":"2024-04-16T15:37:29.363445+0000","last_undegraded":"2024-04-16T15:37:29.363445+0000","last_fullsized":"2024-04-16T15:37:29.363445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:17.628297+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:17.628297+0000","last_clean_scrub_stamp":"2024-04-16T15:37:17.628297+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:33.149701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581998+0000","last_change":"2024-04-16T15:37:22.404042+0000","last_active":"2024-04-16T15:37:29.581998+0000","last_peered":"2024-04-16T15:37:29.581998+0000","last_clean":"2024-04-16T15:37:29.581998+0000","last_became_active":"2024-04-16T15:37:03.288681+0000","last_became_peered":"2024-04-16T15:37:03.288681+0000","last_unstale":"2024-04-16T15:37:29.581998+0000","last_undegraded":"2024-04-16T15:37:29.581998+0000","last_fullsized":"2024-04-16T15:37:29.581998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.403928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.403928+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.403928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:05:30.375484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580403+0000","last_change":"2024-04-16T15:37:21.337725+0000","last_active":"2024-04-16T15:37:29.580403+0000","last_peered":"2024-04-16T15:37:29.580403+0000","last_clean":"2024-04-16T15:37:29.580403+0000","last_became_active":"2024-04-16T15:37:02.279614+0000","last_became_peered":"2024-04-16T15:37:02.279614+0000","last_unstale":"2024-04-16T15:37:29.580403+0000","last_undegraded":"2024-04-16T15:37:29.580403+0000","last_fullsized":"2024-04-16T15:37:29.580403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:21.337599+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:21.337599+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.337599+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:53.786023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580834+0000","last_change":"2024-04-16T15:37:21.802443+0000","last_active":"2024-04-16T15:37:29.580834+0000","last_peered":"2024-04-16T15:37:29.580834+0000","last_clean":"2024-04-16T15:37:29.580834+0000","last_became_active":"2024-04-16T15:37:03.299196+0000","last_became_peered":"2024-04-16T15:37:03.299196+0000","last_unstale":"2024-04-16T15:37:29.580834+0000","last_undegraded":"2024-04-16T15:37:29.580834+0000","last_fullsized":"2024-04-16T15:37:29.580834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:21.802290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:21.802290+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.802290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:57:52.995360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364068+0000","last_change":"2024-04-16T15:37:21.379260+0000","last_active":"2024-04-16T15:37:29.364068+0000","last_peered":"2024-04-16T15:37:29.364068+0000","last_clean":"2024-04-16T15:37:29.364068+0000","last_became_active":"2024-04-16T15:37:02.277292+0000","last_became_peered":"2024-04-16T15:37:02.277292+0000","last_unstale":"2024-04-16T15:37:29.364068+0000","last_undegraded":"2024-04-16T15:37:29.364068+0000","last_fullsized":"2024-04-16T15:37:29.364068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T15:37:21.379107+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T15:37:21.379107+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.379107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:00.691937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364408+0000","last_change":"2024-04-16T15:37:24.392161+0000","last_active":"2024-04-16T15:37:29.364408+0000","last_peered":"2024-04-16T15:37:29.364408+0000","last_clean":"2024-04-16T15:37:29.364408+0000","last_became_active":"2024-04-16T15:37:03.290081+0000","last_became_peered":"2024-04-16T15:37:03.290081+0000","last_unstale":"2024-04-16T15:37:29.364408+0000","last_undegraded":"2024-04-16T15:37:29.364408+0000","last_fullsized":"2024-04-16T15:37:29.364408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.392059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.392059+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.392059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:31.648551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366123+0000","last_change":"2024-04-16T15:37:22.329205+0000","last_active":"2024-04-16T15:37:29.366123+0000","last_peered":"2024-04-16T15:37:29.366123+0000","last_clean":"2024-04-16T15:37:29.366123+0000","last_became_active":"2024-04-16T15:37:02.280828+0000","last_became_peered":"2024-04-16T15:37:02.280828+0000","last_unstale":"2024-04-16T15:37:29.366123+0000","last_undegraded":"2024-04-16T15:37:29.366123+0000","last_fullsized":"2024-04-16T15:37:29.366123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T15:37:22.329090+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T15:37:22.329090+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.329090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:52.368310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580210+0000","last_change":"2024-04-16T15:37:28.473672+0000","last_active":"2024-04-16T15:37:29.580210+0000","last_peered":"2024-04-16T15:37:29.580210+0000","last_clean":"2024-04-16T15:37:29.580210+0000","last_became_active":"2024-04-16T15:37:03.298900+0000","last_became_peered":"2024-04-16T15:37:03.298900+0000","last_unstale":"2024-04-16T15:37:29.580210+0000","last_undegraded":"2024-04-16T15:37:29.580210+0000","last_fullsized":"2024-04-16T15:37:29.580210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:28.473573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:28.473573+0000","last_clean_scrub_stamp":"2024-04-16T15:37:28.473573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:28:48.404106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363216+0000","last_change":"2024-04-16T15:37:18.578797+0000","last_active":"2024-04-16T15:37:29.363216+0000","last_peered":"2024-04-16T15:37:29.363216+0000","last_clean":"2024-04-16T15:37:29.363216+0000","last_became_active":"2024-04-16T15:37:02.281625+0000","last_became_peered":"2024-04-16T15:37:02.281625+0000","last_unstale":"2024-04-16T15:37:29.363216+0000","last_undegraded":"2024-04-16T15:37:29.363216+0000","last_fullsized":"2024-04-16T15:37:29.363216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:18.578708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:18.578708+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.578708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:36.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580367+0000","last_change":"2024-04-16T15:37:29.332561+0000","last_active":"2024-04-16T15:37:29.580367+0000","last_peered":"2024-04-16T15:37:29.580367+0000","last_clean":"2024-04-16T15:37:29.580367+0000","last_became_active":"2024-04-16T15:37:03.293609+0000","last_became_peered":"2024-04-16T15:37:03.293609+0000","last_unstale":"2024-04-16T15:37:29.580367+0000","last_undegraded":"2024-04-16T15:37:29.580367+0000","last_fullsized":"2024-04-16T15:37:29.580367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:29.332375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:29.332375+0000","last_clean_scrub_stamp":"2024-04-16T15:37:29.332375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:12:32.794531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580037+0000","last_change":"2024-04-16T15:37:18.372657+0000","last_active":"2024-04-16T15:37:29.580037+0000","last_peered":"2024-04-16T15:37:29.580037+0000","last_clean":"2024-04-16T15:37:29.580037+0000","last_became_active":"2024-04-16T15:37:02.276922+0000","last_became_peered":"2024-04-16T15:37:02.276922+0000","last_unstale":"2024-04-16T15:37:29.580037+0000","last_undegraded":"2024-04-16T15:37:29.580037+0000","last_fullsized":"2024-04-16T15:37:29.580037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:18.372535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:18.372535+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.372535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:28.386540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581013+0000","last_change":"2024-04-16T15:37:24.436655+0000","last_active":"2024-04-16T15:37:29.581013+0000","last_peered":"2024-04-16T15:37:29.581013+0000","last_clean":"2024-04-16T15:37:29.581013+0000","last_became_active":"2024-04-16T15:37:03.290204+0000","last_became_peered":"2024-04-16T15:37:03.290204+0000","last_unstale":"2024-04-16T15:37:29.581013+0000","last_undegraded":"2024-04-16T15:37:29.581013+0000","last_fullsized":"2024-04-16T15:37:29.581013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.436539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.436539+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.436539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:36:18.406127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.582059+0000","last_change":"2024-04-16T15:37:20.487312+0000","last_active":"2024-04-16T15:37:29.582059+0000","last_peered":"2024-04-16T15:37:29.582059+0000","last_clean":"2024-04-16T15:37:29.582059+0000","last_became_active":"2024-04-16T15:37:02.285796+0000","last_became_peered":"2024-04-16T15:37:02.285796+0000","last_unstale":"2024-04-16T15:37:29.582059+0000","last_undegraded":"2024-04-16T15:37:29.582059+0000","last_fullsized":"2024-04-16T15:37:29.582059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.487205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.487205+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.487205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:30.061028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366289+0000","last_change":"2024-04-16T15:37:28.281838+0000","last_active":"2024-04-16T15:37:29.366289+0000","last_peered":"2024-04-16T15:37:29.366289+0000","last_clean":"2024-04-16T15:37:29.366289+0000","last_became_active":"2024-04-16T15:37:03.290335+0000","last_became_peered":"2024-04-16T15:37:03.290335+0000","last_unstale":"2024-04-16T15:37:29.366289+0000","last_undegraded":"2024-04-16T15:37:29.366289+0000","last_fullsized":"2024-04-16T15:37:29.366289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:28.281726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:28.281726+0000","last_clean_scrub_stamp":"2024-04-16T15:37:28.281726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:45.789696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364340+0000","last_change":"2024-04-16T15:37:19.356851+0000","last_active":"2024-04-16T15:37:29.364340+0000","last_peered":"2024-04-16T15:37:29.364340+0000","last_clean":"2024-04-16T15:37:29.364340+0000","last_became_active":"2024-04-16T15:37:02.274449+0000","last_became_peered":"2024-04-16T15:37:02.274449+0000","last_unstale":"2024-04-16T15:37:29.364340+0000","last_undegraded":"2024-04-16T15:37:29.364340+0000","last_fullsized":"2024-04-16T15:37:29.364340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:19.356768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:19.356768+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.356768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:06.841671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581614+0000","last_change":"2024-04-16T15:37:19.788473+0000","last_active":"2024-04-16T15:37:29.581614+0000","last_peered":"2024-04-16T15:37:29.581614+0000","last_clean":"2024-04-16T15:37:29.581614+0000","last_became_active":"2024-04-16T15:37:03.293176+0000","last_became_peered":"2024-04-16T15:37:03.293176+0000","last_unstale":"2024-04-16T15:37:29.581614+0000","last_undegraded":"2024-04-16T15:37:29.581614+0000","last_fullsized":"2024-04-16T15:37:29.581614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:19.788390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:19.788390+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.788390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:47:49.827610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364452+0000","last_change":"2024-04-16T15:37:22.362378+0000","last_active":"2024-04-16T15:37:29.364452+0000","last_peered":"2024-04-16T15:37:29.364452+0000","last_clean":"2024-04-16T15:37:29.364452+0000","last_became_active":"2024-04-16T15:37:02.285679+0000","last_became_peered":"2024-04-16T15:37:02.285679+0000","last_unstale":"2024-04-16T15:37:29.364452+0000","last_undegraded":"2024-04-16T15:37:29.364452+0000","last_fullsized":"2024-04-16T15:37:29.364452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-16T15:37:22.362261+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-16T15:37:22.362261+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.362261+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:39.870231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580433+0000","last_change":"2024-04-16T15:37:23.370901+0000","last_active":"2024-04-16T15:37:29.580433+0000","last_peered":"2024-04-16T15:37:29.580433+0000","last_clean":"2024-04-16T15:37:29.580433+0000","last_became_active":"2024-04-16T15:37:03.292663+0000","last_became_peered":"2024-04-16T15:37:03.292663+0000","last_unstale":"2024-04-16T15:37:29.580433+0000","last_undegraded":"2024-04-16T15:37:29.580433+0000","last_fullsized":"2024-04-16T15:37:29.580433+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.370793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.370793+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.370793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:10.855696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'7","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581771+0000","last_change":"2024-04-16T15:37:18.509167+0000","last_active":"2024-04-16T15:37:29.581771+0000","last_peered":"2024-04-16T15:37:29.581771+0000","last_clean":"2024-04-16T15:37:29.581771+0000","last_became_active":"2024-04-16T15:37:02.282296+0000","last_became_peered":"2024-04-16T15:37:02.282296+0000","last_unstale":"2024-04-16T15:37:29.581771+0000","last_undegraded":"2024-04-16T15:37:29.581771+0000","last_fullsized":"2024-04-16T15:37:29.581771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'6","last_scrub_stamp":"2024-04-16T15:37:18.509077+0000","last_deep_scrub":"38'6","last_deep_scrub_stamp":"2024-04-16T15:37:18.509077+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.509077+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:38:05.150925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581311+0000","last_change":"2024-04-16T15:37:24.850432+0000","last_active":"2024-04-16T15:37:29.581311+0000","last_peered":"2024-04-16T15:37:29.581311+0000","last_clean":"2024-04-16T15:37:29.581311+0000","last_became_active":"2024-04-16T15:37:03.301969+0000","last_became_peered":"2024-04-16T15:37:03.301969+0000","last_unstale":"2024-04-16T15:37:29.581311+0000","last_undegraded":"2024-04-16T15:37:29.581311+0000","last_fullsized":"2024-04-16T15:37:29.581311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:24.850277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:24.850277+0000","last_clean_scrub_stamp":"2024-04-16T15:37:24.850277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:47:42.358247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580954+0000","last_change":"2024-04-16T15:37:17.535501+0000","last_active":"2024-04-16T15:37:29.580954+0000","last_peered":"2024-04-16T15:37:29.580954+0000","last_clean":"2024-04-16T15:37:29.580954+0000","last_became_active":"2024-04-16T15:37:02.279394+0000","last_became_peered":"2024-04-16T15:37:02.279394+0000","last_unstale":"2024-04-16T15:37:29.580954+0000","last_undegraded":"2024-04-16T15:37:29.580954+0000","last_fullsized":"2024-04-16T15:37:29.580954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:17.535358+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:17.535358+0000","last_clean_scrub_stamp":"2024-04-16T15:37:17.535358+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:57.956671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:30.294720+0000","last_change":"2024-04-16T15:37:30.294747+0000","last_active":"2024-04-16T15:37:30.294720+0000","last_peered":"2024-04-16T15:37:30.294720+0000","last_clean":"2024-04-16T15:37:30.294720+0000","last_became_active":"2024-04-16T15:37:03.292739+0000","last_became_peered":"2024-04-16T15:37:03.292739+0000","last_unstale":"2024-04-16T15:37:30.294720+0000","last_undegraded":"2024-04-16T15:37:30.294720+0000","last_fullsized":"2024-04-16T15:37:30.294720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:30.294631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:30.294631+0000","last_clean_scrub_stamp":"2024-04-16T15:37:30.294631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:37:50.228842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363133+0000","last_change":"2024-04-16T15:37:19.611848+0000","last_active":"2024-04-16T15:37:29.363133+0000","last_peered":"2024-04-16T15:37:29.363133+0000","last_clean":"2024-04-16T15:37:29.363133+0000","last_became_active":"2024-04-16T15:37:02.282382+0000","last_became_peered":"2024-04-16T15:37:02.282382+0000","last_unstale":"2024-04-16T15:37:29.363133+0000","last_undegraded":"2024-04-16T15:37:29.363133+0000","last_fullsized":"2024-04-16T15:37:29.363133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:19.611767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:19.611767+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.611767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:52.060191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366025+0000","last_change":"2024-04-16T15:37:26.327701+0000","last_active":"2024-04-16T15:37:29.366025+0000","last_peered":"2024-04-16T15:37:29.366025+0000","last_clean":"2024-04-16T15:37:29.366025+0000","last_became_active":"2024-04-16T15:37:03.290620+0000","last_became_peered":"2024-04-16T15:37:03.290620+0000","last_unstale":"2024-04-16T15:37:29.366025+0000","last_undegraded":"2024-04-16T15:37:29.366025+0000","last_fullsized":"2024-04-16T15:37:29.366025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.327593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.327593+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.327593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:10:53.904121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363545+0000","last_change":"2024-04-16T15:37:19.473693+0000","last_active":"2024-04-16T15:37:29.363545+0000","last_peered":"2024-04-16T15:37:29.363545+0000","last_clean":"2024-04-16T15:37:29.363545+0000","last_became_active":"2024-04-16T15:37:02.277210+0000","last_became_peered":"2024-04-16T15:37:02.277210+0000","last_unstale":"2024-04-16T15:37:29.363545+0000","last_undegraded":"2024-04-16T15:37:29.363545+0000","last_fullsized":"2024-04-16T15:37:29.363545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:19.473567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:19.473567+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.473567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:00:14.679285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580458+0000","last_change":"2024-04-16T15:37:26.364033+0000","last_active":"2024-04-16T15:37:29.580458+0000","last_peered":"2024-04-16T15:37:29.580458+0000","last_clean":"2024-04-16T15:37:29.580458+0000","last_became_active":"2024-04-16T15:37:03.292714+0000","last_became_peered":"2024-04-16T15:37:03.292714+0000","last_unstale":"2024-04-16T15:37:29.580458+0000","last_undegraded":"2024-04-16T15:37:29.580458+0000","last_fullsized":"2024-04-16T15:37:29.580458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:26.363929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:26.363929+0000","last_clean_scrub_stamp":"2024-04-16T15:37:26.363929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:18:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366315+0000","last_change":"2024-04-16T15:37:21.330771+0000","last_active":"2024-04-16T15:37:29.366315+0000","last_peered":"2024-04-16T15:37:29.366315+0000","last_clean":"2024-04-16T15:37:29.366315+0000","last_became_active":"2024-04-16T15:37:02.280463+0000","last_became_peered":"2024-04-16T15:37:02.280463+0000","last_unstale":"2024-04-16T15:37:29.366315+0000","last_undegraded":"2024-04-16T15:37:29.366315+0000","last_fullsized":"2024-04-16T15:37:29.366315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-16T15:37:21.330638+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-16T15:37:21.330638+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.330638+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:39.567018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581758+0000","last_change":"2024-04-16T15:37:25.376254+0000","last_active":"2024-04-16T15:37:29.581758+0000","last_peered":"2024-04-16T15:37:29.581758+0000","last_clean":"2024-04-16T15:37:29.581758+0000","last_became_active":"2024-04-16T15:37:03.291282+0000","last_became_peered":"2024-04-16T15:37:03.291282+0000","last_unstale":"2024-04-16T15:37:29.581758+0000","last_undegraded":"2024-04-16T15:37:29.581758+0000","last_fullsized":"2024-04-16T15:37:29.581758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.376146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.376146+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.376146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:09.529699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364082+0000","last_change":"2024-04-16T15:37:18.371729+0000","last_active":"2024-04-16T15:37:29.364082+0000","last_peered":"2024-04-16T15:37:29.364082+0000","last_clean":"2024-04-16T15:37:29.364082+0000","last_became_active":"2024-04-16T15:37:02.274253+0000","last_became_peered":"2024-04-16T15:37:02.274253+0000","last_unstale":"2024-04-16T15:37:29.364082+0000","last_undegraded":"2024-04-16T15:37:29.364082+0000","last_fullsized":"2024-04-16T15:37:29.364082+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T15:37:18.371580+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T15:37:18.371580+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.371580+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:10.850428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:30.354342+0000","last_change":"2024-04-16T15:37:30.354363+0000","last_active":"2024-04-16T15:37:30.354342+0000","last_peered":"2024-04-16T15:37:30.354342+0000","last_clean":"2024-04-16T15:37:30.354342+0000","last_became_active":"2024-04-16T15:37:03.296903+0000","last_became_peered":"2024-04-16T15:37:03.296903+0000","last_unstale":"2024-04-16T15:37:30.354342+0000","last_undegraded":"2024-04-16T15:37:30.354342+0000","last_fullsized":"2024-04-16T15:37:30.354342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:30.354229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:30.354229+0000","last_clean_scrub_stamp":"2024-04-16T15:37:30.354229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:14.507783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580535+0000","last_change":"2024-04-16T15:37:19.327760+0000","last_active":"2024-04-16T15:37:29.580535+0000","last_peered":"2024-04-16T15:37:29.580535+0000","last_clean":"2024-04-16T15:37:29.580535+0000","last_became_active":"2024-04-16T15:37:02.278582+0000","last_became_peered":"2024-04-16T15:37:02.278582+0000","last_unstale":"2024-04-16T15:37:29.580535+0000","last_undegraded":"2024-04-16T15:37:29.580535+0000","last_fullsized":"2024-04-16T15:37:29.580535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:19.327658+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:19.327658+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.327658+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:34.849062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580423+0000","last_change":"2024-04-16T15:37:27.442232+0000","last_active":"2024-04-16T15:37:29.580423+0000","last_peered":"2024-04-16T15:37:29.580423+0000","last_clean":"2024-04-16T15:37:29.580423+0000","last_became_active":"2024-04-16T15:37:03.298133+0000","last_became_peered":"2024-04-16T15:37:03.298133+0000","last_unstale":"2024-04-16T15:37:29.580423+0000","last_undegraded":"2024-04-16T15:37:29.580423+0000","last_fullsized":"2024-04-16T15:37:29.580423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:27.442126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:27.442126+0000","last_clean_scrub_stamp":"2024-04-16T15:37:27.442126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:56.162498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580882+0000","last_change":"2024-04-16T15:37:21.444072+0000","last_active":"2024-04-16T15:37:29.580882+0000","last_peered":"2024-04-16T15:37:29.580882+0000","last_clean":"2024-04-16T15:37:29.580882+0000","last_became_active":"2024-04-16T15:37:02.281407+0000","last_became_peered":"2024-04-16T15:37:02.281407+0000","last_unstale":"2024-04-16T15:37:29.580882+0000","last_undegraded":"2024-04-16T15:37:29.580882+0000","last_fullsized":"2024-04-16T15:37:29.580882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T15:37:21.443955+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T15:37:21.443955+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.443955+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:08:48.553477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580576+0000","last_change":"2024-04-16T15:37:22.475238+0000","last_active":"2024-04-16T15:37:29.580576+0000","last_peered":"2024-04-16T15:37:29.580576+0000","last_clean":"2024-04-16T15:37:29.580576+0000","last_became_active":"2024-04-16T15:37:03.283010+0000","last_became_peered":"2024-04-16T15:37:03.283010+0000","last_unstale":"2024-04-16T15:37:29.580576+0000","last_undegraded":"2024-04-16T15:37:29.580576+0000","last_fullsized":"2024-04-16T15:37:29.580576+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.475101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.475101+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.475101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:51.608979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363097+0000","last_change":"2024-04-16T15:37:16.664608+0000","last_active":"2024-04-16T15:37:29.363097+0000","last_peered":"2024-04-16T15:37:29.363097+0000","last_clean":"2024-04-16T15:37:29.363097+0000","last_became_active":"2024-04-16T15:37:02.280480+0000","last_became_peered":"2024-04-16T15:37:02.280480+0000","last_unstale":"2024-04-16T15:37:29.363097+0000","last_undegraded":"2024-04-16T15:37:29.363097+0000","last_fullsized":"2024-04-16T15:37:29.363097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:16.664514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:16.664514+0000","last_clean_scrub_stamp":"2024-04-16T15:37:16.664514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:55.389306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:31.234405+0000","last_change":"2024-04-16T15:37:31.234446+0000","last_active":"2024-04-16T15:37:31.234405+0000","last_peered":"2024-04-16T15:37:31.234405+0000","last_clean":"2024-04-16T15:37:31.234405+0000","last_became_active":"2024-04-16T15:37:03.290701+0000","last_became_peered":"2024-04-16T15:37:03.290701+0000","last_unstale":"2024-04-16T15:37:31.234405+0000","last_undegraded":"2024-04-16T15:37:31.234405+0000","last_fullsized":"2024-04-16T15:37:31.234405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:31.234282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:31.234282+0000","last_clean_scrub_stamp":"2024-04-16T15:37:31.234282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:24:29.191834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'3","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581016+0000","last_change":"2024-04-16T15:37:19.455396+0000","last_active":"2024-04-16T15:37:29.581016+0000","last_peered":"2024-04-16T15:37:29.581016+0000","last_clean":"2024-04-16T15:37:29.581016+0000","last_became_active":"2024-04-16T15:37:02.277495+0000","last_became_peered":"2024-04-16T15:37:02.277495+0000","last_unstale":"2024-04-16T15:37:29.581016+0000","last_undegraded":"2024-04-16T15:37:29.581016+0000","last_fullsized":"2024-04-16T15:37:29.581016+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:19.455256+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:19.455256+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.455256+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:15.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580839+0000","last_change":"2024-04-16T15:37:22.839417+0000","last_active":"2024-04-16T15:37:29.580839+0000","last_peered":"2024-04-16T15:37:29.580839+0000","last_clean":"2024-04-16T15:37:29.580839+0000","last_became_active":"2024-04-16T15:37:03.300183+0000","last_became_peered":"2024-04-16T15:37:03.300183+0000","last_unstale":"2024-04-16T15:37:29.580839+0000","last_undegraded":"2024-04-16T15:37:29.580839+0000","last_fullsized":"2024-04-16T15:37:29.580839+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.839263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.839263+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.839263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:10:50.415792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580943+0000","last_change":"2024-04-16T15:37:20.474013+0000","last_active":"2024-04-16T15:37:29.580943+0000","last_peered":"2024-04-16T15:37:29.580943+0000","last_clean":"2024-04-16T15:37:29.580943+0000","last_became_active":"2024-04-16T15:37:02.280390+0000","last_became_peered":"2024-04-16T15:37:02.280390+0000","last_unstale":"2024-04-16T15:37:29.580943+0000","last_undegraded":"2024-04-16T15:37:29.580943+0000","last_fullsized":"2024-04-16T15:37:29.580943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.473914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.473914+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.473914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:21:39.548830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363861+0000","last_change":"2024-04-16T15:37:25.390250+0000","last_active":"2024-04-16T15:37:29.363861+0000","last_peered":"2024-04-16T15:37:29.363861+0000","last_clean":"2024-04-16T15:37:29.363861+0000","last_became_active":"2024-04-16T15:37:03.291927+0000","last_became_peered":"2024-04-16T15:37:03.291927+0000","last_unstale":"2024-04-16T15:37:29.363861+0000","last_undegraded":"2024-04-16T15:37:29.363861+0000","last_fullsized":"2024-04-16T15:37:29.363861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.390120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.390120+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.390120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:34.963944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366144+0000","last_change":"2024-04-16T15:37:20.291362+0000","last_active":"2024-04-16T15:37:29.366144+0000","last_peered":"2024-04-16T15:37:29.366144+0000","last_clean":"2024-04-16T15:37:29.366144+0000","last_became_active":"2024-04-16T15:37:02.279724+0000","last_became_peered":"2024-04-16T15:37:02.279724+0000","last_unstale":"2024-04-16T15:37:29.366144+0000","last_undegraded":"2024-04-16T15:37:29.366144+0000","last_fullsized":"2024-04-16T15:37:29.366144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.291247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.291247+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.291247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:03:35.812651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580905+0000","last_change":"2024-04-16T15:37:28.333986+0000","last_active":"2024-04-16T15:37:29.580905+0000","last_peered":"2024-04-16T15:37:29.580905+0000","last_clean":"2024-04-16T15:37:29.580905+0000","last_became_active":"2024-04-16T15:37:03.293059+0000","last_became_peered":"2024-04-16T15:37:03.293059+0000","last_unstale":"2024-04-16T15:37:29.580905+0000","last_undegraded":"2024-04-16T15:37:29.580905+0000","last_fullsized":"2024-04-16T15:37:29.580905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:28.333851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:28.333851+0000","last_clean_scrub_stamp":"2024-04-16T15:37:28.333851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:01.626217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580481+0000","last_change":"2024-04-16T15:37:18.438964+0000","last_active":"2024-04-16T15:37:29.580481+0000","last_peered":"2024-04-16T15:37:29.580481+0000","last_clean":"2024-04-16T15:37:29.580481+0000","last_became_active":"2024-04-16T15:37:02.277437+0000","last_became_peered":"2024-04-16T15:37:02.277437+0000","last_unstale":"2024-04-16T15:37:29.580481+0000","last_undegraded":"2024-04-16T15:37:29.580481+0000","last_fullsized":"2024-04-16T15:37:29.580481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:18.438868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:18.438868+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.438868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:27.976373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363092+0000","last_change":"2024-04-16T15:37:23.588084+0000","last_active":"2024-04-16T15:37:29.363092+0000","last_peered":"2024-04-16T15:37:29.363092+0000","last_clean":"2024-04-16T15:37:29.363092+0000","last_became_active":"2024-04-16T15:37:03.295272+0000","last_became_peered":"2024-04-16T15:37:03.295272+0000","last_unstale":"2024-04-16T15:37:29.363092+0000","last_undegraded":"2024-04-16T15:37:29.363092+0000","last_fullsized":"2024-04-16T15:37:29.363092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.587975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.587975+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.587975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:02.900806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.364323+0000","last_change":"2024-04-16T15:37:20.358851+0000","last_active":"2024-04-16T15:37:29.364323+0000","last_peered":"2024-04-16T15:37:29.364323+0000","last_clean":"2024-04-16T15:37:29.364323+0000","last_became_active":"2024-04-16T15:37:02.277307+0000","last_became_peered":"2024-04-16T15:37:02.277307+0000","last_unstale":"2024-04-16T15:37:29.364323+0000","last_undegraded":"2024-04-16T15:37:29.364323+0000","last_fullsized":"2024-04-16T15:37:29.364323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T15:37:20.358743+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T15:37:20.358743+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.358743+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:10:47.935272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366320+0000","last_change":"2024-04-16T15:37:27.316409+0000","last_active":"2024-04-16T15:37:29.366320+0000","last_peered":"2024-04-16T15:37:29.366320+0000","last_clean":"2024-04-16T15:37:29.366320+0000","last_became_active":"2024-04-16T15:37:03.290478+0000","last_became_peered":"2024-04-16T15:37:03.290478+0000","last_unstale":"2024-04-16T15:37:29.366320+0000","last_undegraded":"2024-04-16T15:37:29.366320+0000","last_fullsized":"2024-04-16T15:37:29.366320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:27.316305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:27.316305+0000","last_clean_scrub_stamp":"2024-04-16T15:37:27.316305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:06.629136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581154+0000","last_change":"2024-04-16T15:37:17.417097+0000","last_active":"2024-04-16T15:37:29.581154+0000","last_peered":"2024-04-16T15:37:29.581154+0000","last_clean":"2024-04-16T15:37:29.581154+0000","last_became_active":"2024-04-16T15:37:02.275195+0000","last_became_peered":"2024-04-16T15:37:02.275195+0000","last_unstale":"2024-04-16T15:37:29.581154+0000","last_undegraded":"2024-04-16T15:37:29.581154+0000","last_fullsized":"2024-04-16T15:37:29.581154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:17.417010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:17.417010+0000","last_clean_scrub_stamp":"2024-04-16T15:37:17.417010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:12.423084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581883+0000","last_change":"2024-04-16T15:37:23.433766+0000","last_active":"2024-04-16T15:37:29.581883+0000","last_peered":"2024-04-16T15:37:29.581883+0000","last_clean":"2024-04-16T15:37:29.581883+0000","last_became_active":"2024-04-16T15:37:03.290649+0000","last_became_peered":"2024-04-16T15:37:03.290649+0000","last_unstale":"2024-04-16T15:37:29.581883+0000","last_undegraded":"2024-04-16T15:37:29.581883+0000","last_fullsized":"2024-04-16T15:37:29.581883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.433624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.433624+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.433624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:53:27.253603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581543+0000","last_change":"2024-04-16T15:37:17.838860+0000","last_active":"2024-04-16T15:37:29.581543+0000","last_peered":"2024-04-16T15:37:29.581543+0000","last_clean":"2024-04-16T15:37:29.581543+0000","last_became_active":"2024-04-16T15:37:02.285836+0000","last_became_peered":"2024-04-16T15:37:02.285836+0000","last_unstale":"2024-04-16T15:37:29.581543+0000","last_undegraded":"2024-04-16T15:37:29.581543+0000","last_fullsized":"2024-04-16T15:37:29.581543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:17.838722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:17.838722+0000","last_clean_scrub_stamp":"2024-04-16T15:37:17.838722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:14:17.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581370+0000","last_change":"2024-04-16T15:37:20.785984+0000","last_active":"2024-04-16T15:37:29.581370+0000","last_peered":"2024-04-16T15:37:29.581370+0000","last_clean":"2024-04-16T15:37:29.581370+0000","last_became_active":"2024-04-16T15:37:03.294569+0000","last_became_peered":"2024-04-16T15:37:03.294569+0000","last_unstale":"2024-04-16T15:37:29.581370+0000","last_undegraded":"2024-04-16T15:37:29.581370+0000","last_fullsized":"2024-04-16T15:37:29.581370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.785847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.785847+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.785847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:41.324872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.581434+0000","last_change":"2024-04-16T15:37:15.830479+0000","last_active":"2024-04-16T15:37:29.581434+0000","last_peered":"2024-04-16T15:37:29.581434+0000","last_clean":"2024-04-16T15:37:29.581434+0000","last_became_active":"2024-04-16T15:37:02.277876+0000","last_became_peered":"2024-04-16T15:37:02.277876+0000","last_unstale":"2024-04-16T15:37:29.581434+0000","last_undegraded":"2024-04-16T15:37:29.581434+0000","last_fullsized":"2024-04-16T15:37:29.581434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:15.830339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:15.830339+0000","last_clean_scrub_stamp":"2024-04-16T15:37:15.830339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:43:54.555131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363053+0000","last_change":"2024-04-16T15:37:21.578300+0000","last_active":"2024-04-16T15:37:29.363053+0000","last_peered":"2024-04-16T15:37:29.363053+0000","last_clean":"2024-04-16T15:37:29.363053+0000","last_became_active":"2024-04-16T15:37:03.289513+0000","last_became_peered":"2024-04-16T15:37:03.289513+0000","last_unstale":"2024-04-16T15:37:29.363053+0000","last_undegraded":"2024-04-16T15:37:29.363053+0000","last_fullsized":"2024-04-16T15:37:29.363053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:21.578192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:21.578192+0000","last_clean_scrub_stamp":"2024-04-16T15:37:21.578192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:09.063095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.363828+0000","last_change":"2024-04-16T15:37:18.446007+0000","last_active":"2024-04-16T15:37:29.363828+0000","last_peered":"2024-04-16T15:37:29.363828+0000","last_clean":"2024-04-16T15:37:29.363828+0000","last_became_active":"2024-04-16T15:37:02.275453+0000","last_became_peered":"2024-04-16T15:37:02.275453+0000","last_unstale":"2024-04-16T15:37:29.363828+0000","last_undegraded":"2024-04-16T15:37:29.363828+0000","last_fullsized":"2024-04-16T15:37:29.363828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:18.445916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:18.445916+0000","last_clean_scrub_stamp":"2024-04-16T15:37:18.445916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:29:59.531603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580203+0000","last_change":"2024-04-16T15:37:22.324347+0000","last_active":"2024-04-16T15:37:29.580203+0000","last_peered":"2024-04-16T15:37:29.580203+0000","last_clean":"2024-04-16T15:37:29.580203+0000","last_became_active":"2024-04-16T15:37:03.292196+0000","last_became_peered":"2024-04-16T15:37:03.292196+0000","last_unstale":"2024-04-16T15:37:29.580203+0000","last_undegraded":"2024-04-16T15:37:29.580203+0000","last_fullsized":"2024-04-16T15:37:29.580203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:22.324182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:22.324182+0000","last_clean_scrub_stamp":"2024-04-16T15:37:22.324182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:43.961072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580057+0000","last_change":"2024-04-16T15:37:20.343283+0000","last_active":"2024-04-16T15:37:29.580057+0000","last_peered":"2024-04-16T15:37:29.580057+0000","last_clean":"2024-04-16T15:37:29.580057+0000","last_became_active":"2024-04-16T15:37:02.278904+0000","last_became_peered":"2024-04-16T15:37:02.278904+0000","last_unstale":"2024-04-16T15:37:29.580057+0000","last_undegraded":"2024-04-16T15:37:29.580057+0000","last_fullsized":"2024-04-16T15:37:29.580057+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:20.343187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:20.343187+0000","last_clean_scrub_stamp":"2024-04-16T15:37:20.343187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:38:38.579566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366203+0000","last_change":"2024-04-16T15:37:25.373498+0000","last_active":"2024-04-16T15:37:29.366203+0000","last_peered":"2024-04-16T15:37:29.366203+0000","last_clean":"2024-04-16T15:37:29.366203+0000","last_became_active":"2024-04-16T15:37:03.288353+0000","last_became_peered":"2024-04-16T15:37:03.288353+0000","last_unstale":"2024-04-16T15:37:29.366203+0000","last_undegraded":"2024-04-16T15:37:29.366203+0000","last_fullsized":"2024-04-16T15:37:29.366203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:25.373389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:25.373389+0000","last_clean_scrub_stamp":"2024-04-16T15:37:25.373389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:42.694408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.580459+0000","last_change":"2024-04-16T15:37:19.533694+0000","last_active":"2024-04-16T15:37:29.580459+0000","last_peered":"2024-04-16T15:37:29.580459+0000","last_clean":"2024-04-16T15:37:29.580459+0000","last_became_active":"2024-04-16T15:37:02.284888+0000","last_became_peered":"2024-04-16T15:37:02.284888+0000","last_unstale":"2024-04-16T15:37:29.580459+0000","last_undegraded":"2024-04-16T15:37:29.580459+0000","last_fullsized":"2024-04-16T15:37:29.580459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:19.533604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:19.533604+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.533604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:41:26.790097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:32.431524+0000","last_change":"2024-04-16T15:37:32.431566+0000","last_active":"2024-04-16T15:37:32.431524+0000","last_peered":"2024-04-16T15:37:32.431524+0000","last_clean":"2024-04-16T15:37:32.431524+0000","last_became_active":"2024-04-16T15:37:03.296579+0000","last_became_peered":"2024-04-16T15:37:03.296579+0000","last_unstale":"2024-04-16T15:37:32.431524+0000","last_undegraded":"2024-04-16T15:37:32.431524+0000","last_fullsized":"2024-04-16T15:37:32.431524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:32.431428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:32.431428+0000","last_clean_scrub_stamp":"2024-04-16T15:37:32.431428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:24:52.814915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366287+0000","last_change":"2024-04-16T15:37:23.359845+0000","last_active":"2024-04-16T15:37:29.366287+0000","last_peered":"2024-04-16T15:37:29.366287+0000","last_clean":"2024-04-16T15:37:29.366287+0000","last_became_active":"2024-04-16T15:37:02.284688+0000","last_became_peered":"2024-04-16T15:37:02.284688+0000","last_unstale":"2024-04-16T15:37:29.366287+0000","last_undegraded":"2024-04-16T15:37:29.366287+0000","last_fullsized":"2024-04-16T15:37:29.366287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T15:37:23.359676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T15:37:23.359676+0000","last_clean_scrub_stamp":"2024-04-16T15:37:23.359676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:15.838525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":222,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T15:37:29.366496+0000","last_change":"2024-04-16T15:37:19.264201+0000","last_active":"2024-04-16T15:37:29.366496+0000","last_peered":"2024-04-16T15:37:29.366496+0000","last_clean":"2024-04-16T15:37:29.366496+0000","last_became_active":"2024-04-16T15:35:36.321713+0000","last_became_peered":"2024-04-16T15:35:36.321713+0000","last_unstale":"2024-04-16T15:37:29.366496+0000","last_undegraded":"2024-04-16T15:37:29.366496+0000","last_fullsized":"2024-04-16T15:37:29.366496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-16T15:37:19.264060+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-16T15:37:19.264060+0000","last_clean_scrub_stamp":"2024-04-16T15:37:19.264060+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:18:29.278064+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1097728,"data_stored":808565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":217097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":216627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":217119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":218161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":216585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":216605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":806917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T15:37:39.417 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T15:37:39.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.554+0000 7f454db50640 1 Processor -- start 2024-04-16T15:37:39.553 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.554+0000 7f454db50640 1 -- start start 2024-04-16T15:37:39.556 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f454db50640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4548145ea0 0x7f45481601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f454db50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 0x7f4548071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f454db50640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4548161120 con 0x7f4548072310 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f454db50640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4548072760 con 0x7f4548145ea0 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f454db50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f4548160b60 con 0x7f454815ccf0 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f4547fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4548072310 0x7f454806de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.80:58488/0 (socket says 172.21.15.80:58488) 2024-04-16T15:37:39.557 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.555+0000 7f4547fff640 1 -- 172.21.15.80:0/2608369597 learned_addr learned my addr 172.21.15.80:0/2608369597 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-04-16T15:37:39.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f453effd640 1 --2- 172.21.15.80:0/2608369597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 0x7f4548071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f45477fe640 1 --2- 172.21.15.80:0/2608369597 >> v2:172.21.15.87:3300/0 conn(0x7f4548145ea0 0x7f45481601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f4546ffd640 1 -- 172.21.15.80:0/2608369597 <== mon.1 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935583908 0 0) 0x7f4548161120 con 0x7f4548072310 2024-04-16T15:37:39.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f453effd640 1 -- 172.21.15.80:0/2608369597 >> v2:172.21.15.87:3300/0 conn(0x7f4548145ea0 msgr2=0x7f45481601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:39.558 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f453effd640 1 --2- 172.21.15.80:0/2608369597 >> v2:172.21.15.87:3300/0 conn(0x7f4548145ea0 0x7f45481601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f453effd640 1 -- 172.21.15.80:0/2608369597 >> v1:172.21.15.87:6789/0 conn(0x7f4548072310 legacy=0x7f454806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.556+0000 7f453effd640 1 -- 172.21.15.80:0/2608369597 --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4548160e40 con 0x7f454815ccf0 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f453effd640 1 --2- 172.21.15.80:0/2608369597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 0x7f4548071dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45300097a0 tx=0x7f453002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e9e822a56ad494 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f4546ffd640 1 -- 172.21.15.80:0/2608369597 <== mon.2 v2:172.21.15.87:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45300315a0 con 0x7f454815ccf0 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f4546ffd640 1 -- 172.21.15.80:0/2608369597 <== mon.2 v2:172.21.15.87:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4530037070 con 0x7f454815ccf0 2024-04-16T15:37:39.559 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f4546ffd640 1 -- 172.21.15.80:0/2608369597 <== mon.2 v2:172.21.15.87:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530031960 con 0x7f454815ccf0 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 -- 172.21.15.80:0/2608369597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 msgr2=0x7f4548071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 --2- 172.21.15.80:0/2608369597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 0x7f4548071dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45300097a0 tx=0x7f453002b840 comp rx=0 tx=0).stop 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 -- 172.21.15.80:0/2608369597 shutdown_connections 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 --2- 172.21.15.80:0/2608369597 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f454815ccf0 0x7f4548071dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 --2- 172.21.15.80:0/2608369597 >> v2:172.21.15.87:3300/0 conn(0x7f4548145ea0 0x7f45481601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.560 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 -- 172.21.15.80:0/2608369597 >> 172.21.15.80:0/2608369597 conn(0x7f4548067d90 msgr2=0x7f454806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:39.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 -- 172.21.15.80:0/2608369597 shutdown_connections 2024-04-16T15:37:39.561 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.557+0000 7f454db50640 1 -- 172.21.15.80:0/2608369597 wait complete. 2024-04-16T15:37:39.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.559+0000 7f454db50640 1 Processor -- start 2024-04-16T15:37:39.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.559+0000 7f454db50640 1 -- start start 2024-04-16T15:37:39.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4548072310 0x7f454815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.565 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f454815ccf0 0x7f45480b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f4548160730 con 0x7f4548145ea0 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4548146280 con 0x7f454815ccf0 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f45481608b0 con 0x7f4548072310 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.566 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40284/0 (socket says 172.21.15.80:40284) 2024-04-16T15:37:39.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 -- 172.21.15.80:0/2601208378 learned_addr learned my addr 172.21.15.80:0/2601208378 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:39.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f45477fe640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4548072310 0x7f454815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f4547fff640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f454815ccf0 0x7f45480b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 -- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4548072310 msgr2=0x7f454815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.567 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4548072310 0x7f454815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 -- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f454815ccf0 msgr2=0x7f45480b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f454815ccf0 0x7f45480b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 -- 172.21.15.80:0/2601208378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454813e0e0 con 0x7f4548145ea0 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f453effd640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4530000c00 tx=0x7f45300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530004230 con 0x7f4548145ea0 2024-04-16T15:37:39.568 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300043f0 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454813e3c0 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530003850 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.560+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454815c410 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.561+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4548068a40 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.562+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45300039f0 con 0x7f4548145ea0 2024-04-16T15:37:39.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.562+0000 7f4544ff9640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 0x7f452806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.562+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f453002f030 con 0x7f4548145ea0 2024-04-16T15:37:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.562+0000 7f45477fe640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 0x7f452806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.563+0000 7f45477fe640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 0x7f452806edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4548143b30 tx=0x7f4538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.567+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4530041070 con 0x7f4548145ea0 2024-04-16T15:37:39.740 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.742+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f45480afb80 con 0x7f4548145ea0 2024-04-16T15:37:39.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.745+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f4530044340 con 0x7f4548145ea0 2024-04-16T15:37:39.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.746+0000 7f4544ff9640 1 -- 172.21.15.80:0/2601208378 <== mon.0 v2:172.21.15.80:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45300b3080 con 0x7f4548145ea0 2024-04-16T15:37:39.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.747+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 msgr2=0x7f452806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.747+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 0x7f452806edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4548143b30 tx=0x7f4538008040 comp rx=0 tx=0).stop 2024-04-16T15:37:39.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.747+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 msgr2=0x7f454813d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.747+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4530000c00 tx=0x7f45300046c0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 shutdown_connections 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f454815ccf0 0x7f45480b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4548145ea0 0x7f454813d690 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f452806c8f0 0x7f452806edb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 --2- 172.21.15.80:0/2601208378 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f4548072310 0x7f454815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 >> 172.21.15.80:0/2601208378 conn(0x7f4548067d90 msgr2=0x7f454806e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:39.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 shutdown_connections 2024-04-16T15:37:39.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.748+0000 7f454db50640 1 -- 172.21.15.80:0/2601208378 wait complete. 2024-04-16T15:37:39.757 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T15:37:39.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T15:37:39.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.863+0000 7f31c504a640 1 Processor -- start 2024-04-16T15:37:39.862 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.863+0000 7f31c504a640 1 -- start start 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 0x7f31c015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c015ef80 0x7f31c00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31c0163350 0x7f31c00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 -- --> v2:172.21.15.80:3300/0 -- mon_getmap magic: 0 -- 0x7f31c0162900 con 0x7f31c0163350 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f31c0162ec0 con 0x7f31c00d1450 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31c504a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f31c00d1d70 con 0x7f31c015ef80 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31bf59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31c0163350 0x7f31c00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.865 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31bf59e640 1 --2- >> v2:172.21.15.80:3300/0 conn(0x7f31c0163350 0x7f31c00d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40294/0 (socket says 172.21.15.80:40294) 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.864+0000 7f31bf59e640 1 -- 172.21.15.80:0/1911153636 learned_addr learned my addr 172.21.15.80:0/1911153636 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 -- 172.21.15.80:0/1911153636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c015ef80 msgr2=0x7f31c00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bed9d640 1 --2- 172.21.15.80:0/1911153636 >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 0x7f31c015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31b659c640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c015ef80 0x7f31c00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c015ef80 0x7f31c00cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 -- 172.21.15.80:0/1911153636 >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 msgr2=0x7f31c015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 --2- 172.21.15.80:0/1911153636 >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 0x7f31c015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 -- 172.21.15.80:0/1911153636 --> v2:172.21.15.80:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c00cfeb0 con 0x7f31c0163350 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bed9d640 1 --2- 172.21.15.80:0/1911153636 >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 0x7f31c015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31bf59e640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c0163350 0x7f31c00d1830 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31c00b7310 tx=0x7f31b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3575fe82d55b624 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.865+0000 7f31be59c640 1 -- 172.21.15.80:0/1911153636 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b802c9e0 con 0x7f31c0163350 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31be59c640 1 -- 172.21.15.80:0/1911153636 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f31b802cb80 con 0x7f31c0163350 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31be59c640 1 -- 172.21.15.80:0/1911153636 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b80343f0 con 0x7f31c0163350 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 -- 172.21.15.80:0/1911153636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c0163350 msgr2=0x7f31c00d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c0163350 0x7f31c00d1830 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f31c00b7310 tx=0x7f31b802be40 comp rx=0 tx=0).stop 2024-04-16T15:37:39.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 -- 172.21.15.80:0/1911153636 shutdown_connections 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c0163350 0x7f31c00d1830 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 --2- 172.21.15.80:0/1911153636 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c015ef80 0x7f31c00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 --2- 172.21.15.80:0/1911153636 >> v2:172.21.15.87:3300/0 conn(0x7f31c00d1450 0x7f31c015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 -- 172.21.15.80:0/1911153636 >> 172.21.15.80:0/1911153636 conn(0x7f31c006ce20 msgr2=0x7f31c006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 -- 172.21.15.80:0/1911153636 shutdown_connections 2024-04-16T15:37:39.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.866+0000 7f31c504a640 1 -- 172.21.15.80:0/1911153636 wait complete. 2024-04-16T15:37:39.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.867+0000 7f31c504a640 1 Processor -- start 2024-04-16T15:37:39.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 -- start start 2024-04-16T15:37:39.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c015ef80 0x7f31c00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 --2- >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c0163350 0x7f31c00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 -- 0x7f31c01637c0 con 0x7f31c00d1450 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31c0162b50 con 0x7f31c015ef80 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31c504a640 1 -- --> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] -- mon_getmap magic: 0 -- 0x7f31c00d2ff0 con 0x7f31c0163350 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31bed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31bed9d640 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40302/0 (socket says 172.21.15.80:40302) 2024-04-16T15:37:39.872 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.868+0000 7f31bed9d640 1 -- 172.21.15.80:0/3349879981 learned_addr learned my addr 172.21.15.80:0/3349879981 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31b659c640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c015ef80 0x7f31c00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bf59e640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c0163350 0x7f31c00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 -- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c0163350 msgr2=0x7f31c00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c0163350 0x7f31c00cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 -- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c015ef80 msgr2=0x7f31c00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c015ef80 0x7f31c00cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 -- 172.21.15.80:0/3349879981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c0156700 con 0x7f31c00d1450 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31bed9d640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c7c0 tx=0x7f31b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.873 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0015070 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f31b0007a30 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c00c83d0 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0007e20 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.869+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c00c8990 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.870+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c00c81d0 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.871+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31b0018070 con 0x7f31c00d1450 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.871+0000 7f31b7fff640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T15:37:39.874 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.871+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f31b008bcc0 con 0x7f31c00d1450 2024-04-16T15:37:39.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.871+0000 7f31b659c640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T15:37:39.875 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.872+0000 7f31b659c640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 0x7f31a006edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31c00b9a30 tx=0x7f31a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T15:37:39.877 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:39.875+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31b0059810 con 0x7f31c00d1450 2024-04-16T15:37:40.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.086+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31c01569e0 con 0x7f31c00d1450 2024-04-16T15:37:40.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.087+0000 7f31b7fff640 1 -- 172.21.15.80:0/3349879981 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+4355 (secure 0 0 0) 0x7f31b005db10 con 0x7f31c00d1450 2024-04-16T15:37:40.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-04-16T15:37:40.086 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6834/743042553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":743042553},{"type":"v1","addr":"172.21.15.87:6834","nonce":743042553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/3593860190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6833","nonce":3593860190},{"type":"v1","addr":"172.21.15.87:6835","nonce":3593860190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T15:37:02.624927+0000","modified":"2024-04-16T15:37:25.815907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5152},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5152":{"gid":5152,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":10,"addr":"172.21.15.80:6836/2311942895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6834","nonce":2311942895},{"type":"v1","addr":"172.21.15.80:6836","nonce":2311942895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5152,"qdb_cluster":[5152]},"id":2}]} 2024-04-16T15:37:40.086 INFO:teuthology.orchestra.run.smithi080.stderr:dumped fsmap epoch 20 2024-04-16T15:37:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 msgr2=0x7f31a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:40.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 0x7f31a006edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31c00b9a30 tx=0x7f31a8008040 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 msgr2=0x7f31c015dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c7c0 tx=0x7f31b000cc80 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 shutdown_connections 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:6832/1620343397,v1:172.21.15.80:6833/1620343397] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3301/0,v1:172.21.15.87:6790/0] conn(0x7f31c0163350 0x7f31c00cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31c015ef80 0x7f31c00cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 --2- 172.21.15.80:0/3349879981 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31c00d1450 0x7f31c015dbe0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T15:37:40.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 >> 172.21.15.80:0/3349879981 conn(0x7f31c006ce20 msgr2=0x7f31c006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T15:37:40.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 shutdown_connections 2024-04-16T15:37:40.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-04-16T15:37:40.089+0000 7f31c504a640 1 -- 172.21.15.80:0/3349879981 wait complete. 2024-04-16T15:37:40.098 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T15:37:40.098 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T15:37:40.099 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T15:37:40.099 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:40.099 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-16T15:37:40.107 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T15:37:40.107 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T15:37:40.108 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.117 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T15:37:40.118 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T15:37:40.118 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.131 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T15:37:40.131 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T15:37:40.131 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.183 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T15:37:40.183 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T15:37:40.184 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T15:37:40.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.215 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T15:37:40.215 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T15:37:40.216 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.282 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T15:37:40.283 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T15:37:40.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.353 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T15:37:40.353 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T15:37:40.353 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2024-04-16T15:37:40.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-16T15:37:40.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-16T15:37:40.418 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T15:37:40.418 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T15:37:40.419 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.458 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T15:37:40.459 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T15:37:40.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.531 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T15:37:40.532 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T15:37:40.532 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.605 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T15:37:40.606 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T15:37:40.606 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.682 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T15:37:40.683 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T15:37:40.683 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T15:37:40.683 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.711 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T15:37:40.712 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T15:37:40.712 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.753 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T15:37:40.753 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T15:37:40.754 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T15:37:40.754 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.766 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T15:37:40.766 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T15:37:40.766 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.807 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T15:37:40.807 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T15:37:40.807 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T15:37:40.858 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T15:37:40.859 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T15:37:40.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-16T15:37:40.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:37:40.897 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T15:37:41.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:37:41.130 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T15:37:41.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:37:41.221 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T15:37:41.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:37:41.277 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T15:37:41.326 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:37:41.327 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T15:37:41.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:37:41.587 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T15:37:41.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:37:41.656 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T15:37:41.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:37:41.714 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T15:37:41.764 INFO:tasks.ceph:Archiving mon data... 2024-04-16T15:37:41.765 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/data/mon.a.tgz 2024-04-16T15:37:41.765 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-04-16T15:37:41.782 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.XqhpKRAh6e 2024-04-16T15:37:41.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XqhpKRAh6e 2024-04-16T15:37:41.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.XqhpKRAh6e 2024-04-16T15:37:42.004 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.XqhpKRAh6e is 308KB 2024-04-16T15:37:42.070 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.XqhpKRAh6e 2024-04-16T15:37:42.085 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/data/mon.b.tgz 2024-04-16T15:37:42.086 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-04-16T15:37:42.103 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.XQBgWnj9w9 2024-04-16T15:37:42.103 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XQBgWnj9w9 2024-04-16T15:37:42.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.XQBgWnj9w9 2024-04-16T15:37:42.346 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.XQBgWnj9w9 is 414KB 2024-04-16T15:37:42.444 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.XQBgWnj9w9 2024-04-16T15:37:42.460 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/data/mon.c.tgz 2024-04-16T15:37:42.460 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-04-16T15:37:42.515 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.hodIWbYR5T 2024-04-16T15:37:42.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hodIWbYR5T 2024-04-16T15:37:42.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.hodIWbYR5T 2024-04-16T15:37:42.746 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.hodIWbYR5T is 414KB 2024-04-16T15:37:42.843 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.hodIWbYR5T 2024-04-16T15:37:42.859 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T15:37:42.859 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T15:37:42.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T15:37:42.947 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T15:37:42.983 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T15:37:42.984 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T15:37:42.985 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi080/crash 2024-04-16T15:37:42.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T15:37:43.023 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi087/crash 2024-04-16T15:37:43.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T15:37:43.051 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T15:37:43.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:43.061 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:43.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:43.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T15:37:43.198 INFO:tasks.ceph:Compressing logs... 2024-04-16T15:37:43.198 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T15:37:43.213 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T15:37:43.287 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T15:37:43.287 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-04-16T15:37:43.287 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44048.log 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37742.log 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.1.44048.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44505.log 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37742.log: /var/log/ceph/ceph-client.admin.37942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37902.log 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.1.44048.log.gz 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37742.log.gz 2024-04-16T15:37:43.288 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.3.44505.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37902.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37902.log.gz 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: 91.1% -- replaced with /var/log/ceph/ceph-client.3.44505.log.gz 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37662.log 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.37662.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37662.log.gz 2024-04-16T15:37:43.289 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37862.log 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37702.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37862.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-04-16T15:37:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37822.log 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.37822.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37822.log.gz 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T15:37:43.291 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 90.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-16T15:37:43.299 INFO:teuthology.orchestra.run.smithi087.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T15:37:43.342 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2024-04-16T15:37:43.342 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2024-04-16T15:37:43.342 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45826.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49011.log 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49541.log 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50434.log 2024-04-16T15:37:43.343 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49247.log 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49011.log.gz 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49541.log.gz 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54965.log 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50434.log: /var/log/ceph/ceph-client.admin.49247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52178.log 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50434.log.gz 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49247.log.gz 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54965.log.gz 2024-04-16T15:37:43.344 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54587.log 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44098.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52178.log.gz 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54587.log.gz 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46555.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54265.log 2024-04-16T15:37:43.345 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50045.log 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53971.log 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50045.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54265.log.gz 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47518.log 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50045.log.gz 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-04-16T15:37:43.346 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53971.log.gz 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51454.log 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49709.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47518.log.gz 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53576.log 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51454.log.gz 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51338.log 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53576.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gzgzip 2024-04-16T15:37:43.347 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3%/var/log/ceph/ceph-client.admin.51338.log: -- replaced with /var/log/ceph/ceph-client.admin.53576.log.gz 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55277.log 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51338.log.gz 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54713.log 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55277.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53790.log 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55277.log.gz 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54349.log 2024-04-16T15:37:43.348 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54713.log.gz 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55235.log 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54349.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53790.log.gz 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55235.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54349.log.gz 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55235.log.gz 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54881.log 2024-04-16T15:37:43.349 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43653.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55542.log 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50213.log 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54881.log.gz 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50213.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55542.log.gz 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47476.log 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50213.log.gz 2024-04-16T15:37:43.350 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52448.log 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44140.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47476.log.gz 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46923.log 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52448.log.gz 2024-04-16T15:37:43.351 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.48471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46923.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54223.log 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46924.log 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37954.log 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46924.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54223.log.gz 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-04-16T15:37:43.352 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37954.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46924.log.gz 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37954.log.gz 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45060.log 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49877.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50392.log 2024-04-16T15:37:43.353 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45060.log.gz 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53036.log 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50392.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50392.log.gz/var/log/ceph/ceph-client.admin.53036.log: 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53746.log 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53036.log.gz 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47770.log 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53746.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2024-04-16T15:37:43.354 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51580.log 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47770.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53746.log.gz 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47770.log.gz 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54797.log 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0%/var/log/ceph/ceph-client.admin.50787.log: -- replaced with /var/log/ceph/ceph-client.admin.51580.log.gz 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50618.log 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2024-04-16T15:37:43.355 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54797.log.gz 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45868.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50618.log.gz 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2024-04-16T15:37:43.356 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49457.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz -5 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47940.log 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52052.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47940.log.gz 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43864.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2024-04-16T15:37:43.357 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53841.log 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48349.log 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.37704.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53841.log.gz 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53492.log 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7%/var/log/ceph/ceph-client.0.48349.log: -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-04-16T15:37:43.358 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52574.log 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51806.log 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52574.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53492.log.gz 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.48349.log.gz 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54755.log 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52574.log.gz 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46822.log 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47728.log 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51806.log.gz 2024-04-16T15:37:43.359 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46822.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54755.log.gz 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47728.log.gz 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46818.log 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47182.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46818.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-04-16T15:37:43.360 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45370.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46818.log.gz -5 --verbose -- 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph.audit.log 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54181.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43696.log 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43696.log.gz 2024-04-16T15:37:43.361 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53618.log 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52994.log 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50171.log: /var/log/ceph/ceph-client.admin.53618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51680.log 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53618.log.gz/var/log/ceph/ceph-client.admin.52994.log: 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2024-04-16T15:37:43.362 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52994.log.gz 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51680.log: /var/log/ceph/ceph-client.admin.45228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51680.log.gz 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49289.log 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45910.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-04-16T15:37:43.363 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52364.log 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51296.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49289.log.gz 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47224.log 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52364.log.gz 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54097.log 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47224.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-04-16T15:37:43.364 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48847.log 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54097.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47224.log.gz 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52658.log 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54097.log.gz 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.2.48847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46539.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52658.log.gz 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.2.48847.log.gz 2024-04-16T15:37:43.365 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54545.log 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45784.log 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54545.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2024-04-16T15:37:43.366 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43970.log 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54545.log.gz 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr:gzip/var/log/ceph/ceph-client.admin.45784.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46541.log 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45784.log.gz 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53925.log 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55403.log 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43970.log.gz 2024-04-16T15:37:43.367 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46541.log.gz 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53925.log.gz 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55403.log.gz 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45412.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T15:37:43.369 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51212.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54139.log 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.1.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46927.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54139.log.gz 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55500.log 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53323.log 2024-04-16T15:37:43.370 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43822.log: /var/log/ceph/ceph-client.admin.55500.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz /var/log/ceph/ceph-client.admin.46819.log 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55500.log.gz 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53323.log: /var/log/ceph/ceph-client.admin.46819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55460.log 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53323.log.gz 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49331.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46819.log.gz 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44224.log 2024-04-16T15:37:43.371 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49961.log 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44224.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55460.log.gz 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44458.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.54013.log 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44224.log.gz 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47392.log 2024-04-16T15:37:43.372 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49961.log: /var/log/ceph/ceph-client.admin.54013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49961.log.gz 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47392.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54013.log.gz 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47392.log.gz 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9%/var/log/ceph/ceph-client.admin.46219.log: -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54671.log 2024-04-16T15:37:43.373 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46540.log 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49667.log: /var/log/ceph/ceph-client.admin.54671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46540.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54671.log.gz 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46540.log.gz 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2024-04-16T15:37:43.374 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53365.log 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52136.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.45454.log 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53365.log: /var/log/ceph/ceph-client.admin.45454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53365.log.gz 2024-04-16T15:37:43.375 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49373.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45454.log.gz 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55151.log 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51412.log 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose 89.4% -- /var/log/ceph/ceph-client.admin.38059.log -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55151.log: /var/log/ceph/ceph-client.admin.51412.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55151.log.gz 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52490.log 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51412.log.gz 2024-04-16T15:37:43.376 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.38059.log: /var/log/ceph/ceph-client.admin.52490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52262.log 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38059.log.gz 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.3.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52490.log.gz 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6%/var/log/ceph/ceph-client.admin.43342.log: -- replaced with /var/log/ceph/ceph-client.admin.52262.log.gz 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2024-04-16T15:37:43.377 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45144.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45742.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-16T15:37:43.378 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52094.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54391.log 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54391.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54391.log.gz 2024-04-16T15:37:43.379 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45270.log 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51848.log 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45270.log: gzip 89.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.53078.log 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2024-04-16T15:37:43.380 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45270.log.gz 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51848.log.gz 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49583.log 92.6% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53078.log.gz 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-04-16T15:37:43.381 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49583.log.gz 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45186.log 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47560.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46206.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45186.log.gz 2024-04-16T15:37:43.382 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5/var/log/ceph/ceph-client.admin.47140.log: --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52952.log 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr: 88.6% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46550.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T15:37:43.383 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55319.log 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52952.log.gz 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55319.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51622.log 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2024-04-16T15:37:43.384 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55319.log.gz 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr: --verbose --/var/log/ceph/ceph-client.admin.51622.log: /var/log/ceph/ceph-client.admin.51890.log 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52220.log: gzip -5 --verbose -- 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51622.log.gz 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.51764.log 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53883.log 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-04-16T15:37:43.385 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51764.log.gz 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51086.log 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46553.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53883.log.gz 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53281.log 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1%/var/log/ceph/ceph-client.admin.51086.log: -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51968.log 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51086.log.gz 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54307.log 2024-04-16T15:37:43.386 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53281.log.gz 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51968.log.gz 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54307.log.gz 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5/var/log/ceph/ceph-client.admin.47098.log: --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46217.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2024-04-16T15:37:43.387 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54055.log 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9%/var/log/ceph/ceph-client.admin.54055.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47686.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.54055.log.gz -- 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr: /var/log/ceph/ceph-client.admin.50308.log 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-04-16T15:37:43.388 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51128.log 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.0.log: gzip/var/log/ceph/ceph-client.admin.50308.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55007.log 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51128.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51128.log.gz 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr: 88.0%/var/log/ceph/ceph-client.admin.52010.log: -- replaced with /var/log/ceph/ceph-client.admin.55007.log.gz 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48969.log 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2024-04-16T15:37:43.389 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55193.log 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr: 88.2%/var/log/ceph/ceph-client.admin.48969.log: -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55193.log.gz 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48969.log.gz 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53702.log 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49163.log 2024-04-16T15:37:43.390 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53702.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53702.log.gz 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47812.log 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49163.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49163.log.gz 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51044.log 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51002.log 2024-04-16T15:37:43.391 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51044.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47812.log.gz 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51044.log.gz 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50003.log 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51002.log: /var/log/ceph/ceph-mds.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51002.log.gz 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50003.log.gz 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43908.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-04-16T15:37:43.392 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45496.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46213.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44308.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49751.log 2024-04-16T15:37:43.393 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55361.log: /var/log/ceph/ceph-client.admin.49751.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49751.log.gz 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51722.log 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.52910.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47602.log 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51722.log: /var/log/ceph/ceph-client.admin.47350.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51722.log.gz 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-04-16T15:37:43.394 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47602.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47602.log.gz 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54923.log 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50576.log 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44182.log: /var/log/ceph/ceph-client.admin.54923.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54923.log.gz 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51538.log 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50576.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50576.log.gz 2024-04-16T15:37:43.395 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53660.log 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.51538.log: /var/log/ceph/ceph-client.admin.53660.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51538.log.gz 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53660.log.gz 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54839.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52742.log 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.46208.log: /var/log/ceph/ceph-client.admin.52742.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-04-16T15:37:43.396 INFO:teuthology.orchestra.run.smithi080.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52742.log.gz 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50087.log 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.47308.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43738.log 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50087.log: /var/log/ceph/ceph-client.admin.43738.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50087.log.gz 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43738.log.gz 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-04-16T15:37:43.397 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.55091.log: /var/log/ceph/ceph-client.admin.46551.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45102.log 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.54629.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45102.log: /var/log/ceph/ceph-client.admin.44350.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45102.log.gz 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-04-16T15:37:43.398 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31673.log 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.45328.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44054.log 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.tmp-client.admin.31673.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31673.log.gz 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.53200.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.44054.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44054.log.gz 2024-04-16T15:37:43.399 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50518.log 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.46552.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr: 89.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49499.log 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50744.log 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50518.log.gz 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2024-04-16T15:37:43.400 INFO:teuthology.orchestra.run.smithi080.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49499.log.gz 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43434.log 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50744.log: /var/log/ceph/ceph-client.admin.53120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50476.log 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.43434.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50744.log.gz 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43434.log.gz 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.50476.log: /var/log/ceph/ceph-client.admin.43611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2024-04-16T15:37:43.401 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49205.log: 87.7% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50476.log.gz 2024-04-16T15:37:43.402 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-04-16T15:37:43.402 INFO:teuthology.orchestra.run.smithi080.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2024-04-16T15:37:43.402 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.49919.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2024-04-16T15:37:43.402 INFO:teuthology.orchestra.run.smithi087.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T15:37:43.403 INFO:teuthology.orchestra.run.smithi087.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T15:37:43.440 INFO:teuthology.orchestra.run.smithi080.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T15:37:43.882 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T15:37:43.903 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T15:37:43.905 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T15:37:43.914 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T15:37:43.923 INFO:teuthology.orchestra.run.smithi087.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T15:37:43.932 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T15:37:43.970 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T15:37:43.972 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-04-16T15:37:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.747s 2024-04-16T15:37:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m2.824s 2024-04-16T15:37:43.972 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.250s 2024-04-16T15:37:43.976 INFO:teuthology.orchestra.run.smithi087.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T15:37:43.978 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-04-16T15:37:43.978 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m0.721s 2024-04-16T15:37:43.978 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m2.771s 2024-04-16T15:37:43.978 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.122s 2024-04-16T15:37:43.978 INFO:tasks.ceph:Archiving logs... 2024-04-16T15:37:43.979 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi080/log 2024-04-16T15:37:43.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T15:37:44.650 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi087/log 2024-04-16T15:37:44.651 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T15:37:45.086 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T15:37:45.096 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T15:37:45.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T15:37:45.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T15:37:45.176 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T15:37:45.186 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T15:37:45.186 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:37:45.189 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T15:37:45.202 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:37:45.204 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +1519us[+1530us] +/- 65ms 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1417us[-1417us] +/- 65ms 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -164us[ -164us] +/- 88ms 2024-04-16T15:37:45.207 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:37:45.209 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T15:37:45.209 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-16T15:37:45.210 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 21 +1529us[+1529us] +/- 65ms 2024-04-16T15:37:45.210 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -1416us[-1428us] +/- 65ms 2024-04-16T15:37:45.210 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -157us[ -157us] +/- 88ms 2024-04-16T15:37:45.210 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T15:37:45.210 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T15:37:45.220 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T15:37:45.221 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T15:37:45.232 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T15:37:45.324 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T15:37:45.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-16T15:37:45.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-16T15:37:45.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-16T15:37:45.396 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:37:45.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:45.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T15:37:45.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:45.460 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T15:37:45.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T15:37:45.499 INFO:teuthology.task.internal:Duration was 542.980320 seconds 2024-04-16T15:37:45.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T15:37:45.509 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T15:37:45.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T15:37:45.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T15:37:45.555 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:37:45.558 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T15:37:45.863 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T15:37:45.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-04-16T15:37:45.863 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T15:37:45.884 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-04-16T15:37:45.884 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T15:37:45.905 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T15:37:45.905 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T15:37:45.927 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T15:37:45.976 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T15:37:45.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:37:45.997 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:37:46.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T15:37:46.131 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T15:37:46.132 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T15:37:46.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T15:37:46.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T15:37:46.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:37:46.205 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:37:46.230 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-04-16T15:37:46.257 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-04-16T15:37:46.274 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:37:46.306 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi080.front.sepia.ceph.com, flagging run as failed 2024-04-16T15:37:46.306 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:37:46.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:46.331 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T15:37:46.342 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T15:37:46.343 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi080 2024-04-16T15:37:46.343 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T15:37:54.350 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T15:37:54.361 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183/remote/smithi080/coredump/1713281824.53201.core.gz: gzip compressed data, was "1713281824.53201.core", last modified: Tue Apr 16 15:37:46 2024, max compression, original size modulo 2^32 268288000 2024-04-16T15:37:54.362 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T15:37:55.470 INFO:teuthology.task.internal: core looks like: /tmp/tmpc69ncxvp: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T15:37:55.500 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i a 2024-04-16T15:37:55.500 DEBUG:teuthology.orchestra.run.smithi080:> which 'ceph-mds -f --cluster ceph -i a' 2024-04-16T15:37:55.520 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T15:37:55.521 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T15:37:55.521 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/which: no a in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T15:37:55.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:55.522 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph-mds 2024-04-16T15:37:55.522 INFO:teuthology.orchestra.run.smithi080.stdout:/usr/bin/ceph 2024-04-16T15:37:55.523 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T15:37:55.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T15:37:55.547 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T15:37:55.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T15:37:55.569 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T15:37:55.569 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T15:37:55.577 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265305 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265306 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265310 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265395 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:28 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265312 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:28 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T15:37:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: 265311 188 -rw-r--r-- 1 ubuntu ubuntu 192371 Apr 16 15:37 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:37:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: 406415 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive/audit 2024-04-16T15:37:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: 406417 152 -rw------- 1 ubuntu ubuntu 152584 Apr 16 15:37 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T15:37:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: 265309 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive/coredump 2024-04-16T15:37:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: 265397 20928 -rw------- 1 root root 268288000 Apr 16 15:37 /home/ubuntu/cephtest/archive/coredump/1713281824.53201.core 2024-04-16T15:37:55.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T15:37:55.594 INFO:teuthology.orchestra.run.smithi080.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T15:37:55.594 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi080 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T15:37:55.606 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T15:37:55.616 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T15:37:55.627 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi080 with status 1: "which 'ceph-mds -f --cluster ceph -i a'" 2024-04-16T15:37:55.628 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T15:37:55.635 INFO:teuthology.orchestra.run.smithi087.stdout: 265305 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest 2024-04-16T15:37:55.635 INFO:teuthology.orchestra.run.smithi087.stdout: 265306 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive 2024-04-16T15:37:55.635 INFO:teuthology.orchestra.run.smithi087.stdout: 265310 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive/syslog 2024-04-16T15:37:55.635 INFO:teuthology.orchestra.run.smithi087.stdout: 265396 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:28 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T15:37:55.635 INFO:teuthology.orchestra.run.smithi087.stdout: 265312 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 15:28 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T15:37:55.636 INFO:teuthology.orchestra.run.smithi087.stdout: 265311 184 -rw-r--r-- 1 ubuntu ubuntu 186330 Apr 16 15:37 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T15:37:55.636 INFO:teuthology.orchestra.run.smithi087.stdout: 404180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 15:37 /home/ubuntu/cephtest/archive/audit 2024-04-16T15:37:55.636 INFO:teuthology.orchestra.run.smithi087.stdout: 404182 128 -rw------- 1 ubuntu ubuntu 128401 Apr 16 15:37 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T15:37:55.637 INFO:teuthology.orchestra.run.smithi087.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T15:37:55.658 DEBUG:teuthology.nuke:shortname: smithi080 2024-04-16T15:37:55.659 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:37:55.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:42.385987', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIx9kZC+lVom0nFnzCWg1XxdZn4eNWQ+XOA2Gv00Mg33JSCk86vxGlXPJQ/FD0YNo+vCjknszownuXqyqAmySRM='} 2024-04-16T15:37:55.683 DEBUG:teuthology.nuke:shortname: smithi087 2024-04-16T15:37:55.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T15:37:55.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:42.387674', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOaAVmZYISIJ2eqh9M2N6NzEeO5QbrKgcEIHdfIeia9rKDrAj+gTp+DfEd8fEp7RZXq7aS8u38p719bgaoGNQI8='} 2024-04-16T15:37:55.731 INFO:teuthology.orchestra.console.smithi080:Power off 2024-04-16T15:37:55.731 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T15:37:55.754 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-04-16T15:37:55.754 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:37:55.771 INFO:teuthology.orchestra.console.smithi087:Power off 2024-04-16T15:37:55.771 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T15:37:55.781 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-16T15:37:55.795 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-04-16T15:37:55.795 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:37:55.819 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-16T15:37:59.782 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:37:59.821 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:37:59.895 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-16T15:37:59.932 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-16T15:38:03.898 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:38:03.934 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:38:04.009 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-04-16T15:38:04.044 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-16T15:38:08.013 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:38:08.046 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T15:38:08.123 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-04-16T15:38:08.158 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-16T15:38:08.225 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-04-16T15:38:08.259 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-04-16T15:38:08.365 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-readahead} duration: 542.9803199768066 failure_reason: 'Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a0999e1dd34c4a5cbbd27a9322047649 status: fail success: false 2024-04-16T15:38:08.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T15:38:08.458 INFO:teuthology.run:FAIL